2024-04-12T19:24:08.828 INFO:root:teuthology version: 0.0.1.dev267+g6c63784 2024-04-12T19:24:08.828 DEBUG:teuthology.run:Teuthology command: teuthology --verbose --archive /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524 --name vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi --description fs/snaps/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps} --owner scheduled_vshankar@teuthology -- /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524/orig.config.yaml 2024-04-12T19:24:08.871 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T19:24:08.958 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524 branch: wip-vshankar-testing-20240411.061452 description: fs/snaps/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps} email: vshankar@redhat.com first_in_suite: false job_id: '7653524' kernel: flavor: default kdb: true sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240411.061452 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability sha1: 324baf8ddb91dea46cac50cb535c306115791355 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: flavor: default sha1: 324baf8ddb91dea46cac50cb535c306115791355 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240411.061452 sha1: 324baf8ddb91dea46cac50cb535c306115791355 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 seed: 7105 sha1: 324baf8ddb91dea46cac50cb535c306115791355 sleep_before_teardown: 0 subset: 463/1024 suite: fs suite_branch: wip-vshankar-testing-20240411.061452 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 324baf8ddb91dea46cac50cb535c306115791355 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEunQAr+mGP/HJ4UiBcFPtfWszRJn0NkjvRCdiM2iZAhJ8qjKSWSXfPNO3BbSBEdxwNQWrNrgQb8ewHiwcJvvMU= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNE3b2hN+giYQQr4Tq4s/n48RFH667cMjgJRUH55dHBcTJrQ2wedifR1B7qlqhbjO8uDauGT5qGu5WeKZV+Pe5Y= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - workunit: clients: all: - fs/snaps timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 6c637841c215537a4502385240412f1966e0faab timestamp: 2024-04-12_03:11:38 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-12T19:24:08.959 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa; will attempt to use it 2024-04-12T19:24:08.959 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks 2024-04-12T19:24:08.959 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-12T19:24:08.961 INFO:teuthology.task.internal:Checking packages... 2024-04-12T19:24:08.986 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '324baf8ddb91dea46cac50cb535c306115791355' 2024-04-12T19:24:08.986 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-12T19:24:08.986 INFO:teuthology.packaging:ref: None 2024-04-12T19:24:08.986 INFO:teuthology.packaging:tag: None 2024-04-12T19:24:08.986 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240411.061452 2024-04-12T19:24:08.986 INFO:teuthology.packaging:sha1: 324baf8ddb91dea46cac50cb535c306115791355 2024-04-12T19:24:08.986 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240411.061452 2024-04-12T19:24:09.203 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2879.g324baf8d 2024-04-12T19:24:09.205 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-12T19:24:09.211 INFO:teuthology.task.internal:no buildpackages task found 2024-04-12T19:24:09.211 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-12T19:24:09.264 INFO:teuthology.task.internal:Saving configuration 2024-04-12T19:24:09.280 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-12T19:24:09.285 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-12T19:24:09.311 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-12 19:18:43.133524', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEunQAr+mGP/HJ4UiBcFPtfWszRJn0NkjvRCdiM2iZAhJ8qjKSWSXfPNO3BbSBEdxwNQWrNrgQb8ewHiwcJvvMU='} 2024-04-12T19:24:09.332 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-12 19:18:43.134782', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNE3b2hN+giYQQr4Tq4s/n48RFH667cMjgJRUH55dHBcTJrQ2wedifR1B7qlqhbjO8uDauGT5qGu5WeKZV+Pe5Y='} 2024-04-12T19:24:09.332 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-12T19:24:09.338 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-12T19:24:09.338 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-12T19:24:09.338 INFO:teuthology.run_tasks:Running task console_log... 2024-04-12T19:24:09.454 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f017a3abf70>, signals=[15]) 2024-04-12T19:24:09.455 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-12T19:24:09.460 INFO:teuthology.task.internal:Opening connections... 2024-04-12T19:24:09.460 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T19:24:09.462 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T19:24:09.555 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-04-12T19:24:09.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T19:24:09.643 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-12T19:24:09.649 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-04-12T19:24:09.666 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-04-12T19:24:09.666 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-04-12T19:24:09.723 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2024-04-12T19:24:09.723 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2024-04-12T19:24:09.723 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2024-04-12T19:24:09.723 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2024-04-12T19:24:09.723 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2024-04-12T19:24:09.723 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2024-04-12T19:24:09.723 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-12T19:24:09.723 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-04-12T19:24:09.723 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2024-04-12T19:24:09.724 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-12T19:24:09.724 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2024-04-12T19:24:09.724 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-12T19:24:09.724 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-12T19:24:09.724 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-12T19:24:09.724 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-04-12T19:24:09.749 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-04-12T19:24:09.766 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-04-12T19:24:09.766 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-04-12T19:24:09.820 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="CentOS Stream" 2024-04-12T19:24:09.820 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="9" 2024-04-12T19:24:09.820 INFO:teuthology.orchestra.run.smithi171.stdout:ID="centos" 2024-04-12T19:24:09.821 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE="rhel fedora" 2024-04-12T19:24:09.821 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="9" 2024-04-12T19:24:09.821 INFO:teuthology.orchestra.run.smithi171.stdout:PLATFORM_ID="platform:el9" 2024-04-12T19:24:09.821 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="CentOS Stream 9" 2024-04-12T19:24:09.821 INFO:teuthology.orchestra.run.smithi171.stdout:ANSI_COLOR="0;31" 2024-04-12T19:24:09.821 INFO:teuthology.orchestra.run.smithi171.stdout:LOGO="fedora-logo-icon" 2024-04-12T19:24:09.821 INFO:teuthology.orchestra.run.smithi171.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-04-12T19:24:09.821 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://centos.org/" 2024-04-12T19:24:09.821 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-12T19:24:09.821 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-04-12T19:24:09.821 INFO:teuthology.orchestra.run.smithi171.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-12T19:24:09.821 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-04-12T19:24:09.840 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-12T19:24:09.849 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-12T19:24:09.865 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-12T19:24:09.865 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-04-12T19:24:09.868 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-04-12T19:24:09.884 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-12T19:24:09.890 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-12T19:24:09.890 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-04-12T19:24:09.925 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-04-12T19:24:09.945 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-12T19:24:10.003 INFO:teuthology.run_tasks:Running task kernel... 2024-04-12T19:24:10.016 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'} 2024-04-12T19:24:10.017 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}}, timeout 300 2024-04-12T19:24:10.017 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-12T19:24:10.017 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-12T19:24:10.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T19:24:10.034 DEBUG:teuthology.task.kernel:sha1 for mon.a is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T19:24:10.034 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-12T19:24:10.034 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-04-12T19:24:10.035 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T19:24:10.035 DEBUG:teuthology.task.kernel:sha1 for mon.b is 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T19:24:10.035 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8"... 2024-04-12T19:24:10.036 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-04-12T19:24:10.091 INFO:teuthology.orchestra.run.smithi131.stdout:5.14.0-361.el9.x86_64 2024-04-12T19:24:10.092 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T19:24:10.092 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-12T19:24:10.092 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T19:24:10.096 INFO:teuthology.orchestra.run.smithi171.stdout:5.14.0-361.el9.x86_64 2024-04-12T19:24:10.096 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T19:24:10.096 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-04-12T19:24:10.096 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T19:24:10.242 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum upgrade -y linux-firmware 2024-04-12T19:24:10.303 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum upgrade -y linux-firmware 2024-04-12T19:24:12.491 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS-9 - AppStream 13 MB/s | 8.1 MB 00:00 2024-04-12T19:24:12.590 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-9 - AppStream 12 MB/s | 8.1 MB 00:00 2024-04-12T19:24:14.100 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS-9 - BaseOS 8.2 MB/s | 2.5 MB 00:00 2024-04-12T19:24:14.349 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-9 - BaseOS 6.9 MB/s | 2.5 MB 00:00 2024-04-12T19:24:15.297 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.0 MB 00:00 2024-04-12T19:24:15.982 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.0 MB 00:01 2024-04-12T19:24:17.215 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 23 MB/s | 19 MB 00:00 2024-04-12T19:24:17.991 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-04-12T19:24:22.034 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 13 MB/s | 6.2 MB 00:00 2024-04-12T19:24:22.749 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.2 MB 00:01 2024-04-12T19:24:23.686 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 16 kB 00:00 2024-04-12T19:24:24.694 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 20 kB/s | 16 kB 00:00 2024-04-12T19:24:25.178 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 16 MB/s | 21 MB 00:01 2024-04-12T19:24:26.803 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-04-12T19:24:30.495 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2024-04-12T19:24:31.942 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 13 kB/s | 1.7 kB 00:00 2024-04-12T19:24:32.729 INFO:teuthology.orchestra.run.smithi131.stderr:Modular dependency problems: 2024-04-12T19:24:32.729 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-12T19:24:32.729 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 1: conflicting requests 2024-04-12T19:24:32.729 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.729 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 2: conflicting requests 2024-04-12T19:24:32.729 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.729 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 3: conflicting requests 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 4: conflicting requests 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 5: conflicting requests 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 6: conflicting requests 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 7: conflicting requests 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 8: conflicting requests 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 9: conflicting requests 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.730 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 10: conflicting requests 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 11: conflicting requests 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 12: conflicting requests 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 13: conflicting requests 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 14: conflicting requests 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 15: conflicting requests 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 16: conflicting requests 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.731 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 17: conflicting requests 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 18: conflicting requests 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 19: conflicting requests 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 20: conflicting requests 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 21: conflicting requests 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 22: conflicting requests 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 23: conflicting requests 2024-04-12T19:24:32.732 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 24: conflicting requests 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 25: conflicting requests 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 26: conflicting requests 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 27: conflicting requests 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 28: conflicting requests 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 29: conflicting requests 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 30: conflicting requests 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.733 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 31: conflicting requests 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 32: conflicting requests 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 33: conflicting requests 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 34: conflicting requests 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 35: conflicting requests 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 36: conflicting requests 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 37: conflicting requests 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.734 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 39: conflicting requests 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.735 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.736 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.737 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.738 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T19:24:32.738 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T19:24:33.263 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-12T19:24:33.272 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-12T19:24:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-04-12T19:24:33.273 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-12T19:24:33.273 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2024-04-12T19:24:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-04-12T19:24:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:24:33.273 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-12T19:24:33.273 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-04-12T19:24:33.273 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 1 Package 2024-04-12T19:24:33.273 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:24:33.273 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 376 M 2024-04-12T19:24:33.273 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-12T19:24:34.192 INFO:teuthology.orchestra.run.smithi171.stderr:Modular dependency problems: 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 1: conflicting requests 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 2: conflicting requests 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 3: conflicting requests 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 4: conflicting requests 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 5: conflicting requests 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 6: conflicting requests 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.193 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 7: conflicting requests 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 8: conflicting requests 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 9: conflicting requests 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 10: conflicting requests 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 11: conflicting requests 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 12: conflicting requests 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 13: conflicting requests 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.194 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 14: conflicting requests 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 15: conflicting requests 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 16: conflicting requests 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 17: conflicting requests 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 18: conflicting requests 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 19: conflicting requests 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 20: conflicting requests 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.195 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 21: conflicting requests 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 22: conflicting requests 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 23: conflicting requests 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 24: conflicting requests 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 25: conflicting requests 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 26: conflicting requests 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 27: conflicting requests 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 28: conflicting requests 2024-04-12T19:24:34.196 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 29: conflicting requests 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 30: conflicting requests 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 31: conflicting requests 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 32: conflicting requests 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 33: conflicting requests 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 34: conflicting requests 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.197 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 35: conflicting requests 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 36: conflicting requests 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 37: conflicting requests 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 39: conflicting requests 2024-04-12T19:24:34.198 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.199 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.200 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T19:24:34.201 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.201 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.201 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.201 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T19:24:34.722 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-12T19:24:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-12T19:24:34.731 INFO:teuthology.orchestra.run.smithi171.stdout: Package Architecture Version Repository Size 2024-04-12T19:24:34.731 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-12T19:24:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-04-12T19:24:34.732 INFO:teuthology.orchestra.run.smithi171.stdout: linux-firmware noarch 20240219-143.el9 baseos 376 M 2024-04-12T19:24:34.732 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:24:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-12T19:24:34.732 INFO:teuthology.orchestra.run.smithi171.stdout:================================================================================ 2024-04-12T19:24:34.733 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 1 Package 2024-04-12T19:24:34.733 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:24:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 376 M 2024-04-12T19:24:34.734 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-12T19:24:38.796 INFO:teuthology.orchestra.run.smithi131.stdout:linux-firmware-20240219-143.el9.noarch.rpm 70 MB/s | 376 MB 00:05 2024-04-12T19:24:38.796 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-12T19:24:38.796 INFO:teuthology.orchestra.run.smithi131.stdout:Total 68 MB/s | 376 MB 00:05 2024-04-12T19:24:41.838 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-12T19:24:41.989 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-12T19:24:41.989 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-12T19:24:45.170 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-12T19:24:45.170 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-12T19:24:52.613 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-12T19:24:52.966 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-12T19:24:53.051 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-12T19:24:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-12T19:24:54.318 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-12T19:24:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-12T19:24:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:24:54.732 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2024-04-12T19:24:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-12T19:24:54.732 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:24:54.732 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-12T19:24:55.074 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on mon.a... 2024-04-12T19:24:55.074 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T19:24:55.221 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ 2024-04-12T19:24:55.221 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-12T19:24:55.226 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi131.front.sepia.ceph.com to complete... 2024-04-12T19:25:06.857 INFO:teuthology.orchestra.run.smithi171.stdout:linux-firmware-20240219-143.el9.noarch.rpm 12 MB/s | 376 MB 00:32 2024-04-12T19:25:06.857 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-12T19:25:06.857 INFO:teuthology.orchestra.run.smithi171.stdout:Total 12 MB/s | 376 MB 00:32 2024-04-12T19:25:07.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12 19:25:07 URL:https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm [357344123/357344123] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-12T19:25:07.811 INFO:teuthology.orchestra.run.smithi131.stderr:FINISHED --2024-04-12 19:25:07-- 2024-04-12T19:25:07.811 INFO:teuthology.orchestra.run.smithi131.stderr:Total wall clock time: 13s 2024-04-12T19:25:07.811 INFO:teuthology.orchestra.run.smithi131.stderr:Downloaded: 1 files, 341M in 12s (27.9 MB/s) 2024-04-12T19:25:07.814 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on mon.a... 2024-04-12T19:25:07.814 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-12T19:25:09.862 INFO:teuthology.orchestra.run.smithi131.stdout:Verifying... ######################################## 2024-04-12T19:25:09.891 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-12T19:25:09.964 INFO:teuthology.orchestra.run.smithi131.stdout:Preparing... ######################################## 2024-04-12T19:25:10.044 INFO:teuthology.orchestra.run.smithi131.stdout:Updating / installing... 2024-04-12T19:25:10.060 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-12T19:25:10.060 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-12T19:25:13.263 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-12T19:25:13.263 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-12T19:25:18.034 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-6.9.0_rc3_g3f60ed14f7c1-1 ######################################## 2024-04-12T19:25:20.514 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-12T19:25:21.044 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-12T19:25:21.136 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-12T19:25:22.083 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2024-04-12T19:25:22.083 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : linux-firmware-20240219-143.el9.noarch 1/2 2024-04-12T19:25:22.495 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2024-04-12T19:25:22.495 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:25:22.495 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-04-12T19:25:22.496 INFO:teuthology.orchestra.run.smithi171.stdout: linux-firmware-20240219-143.el9.noarch 2024-04-12T19:25:22.496 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:25:22.496 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-12T19:25:22.835 INFO:teuthology.task.kernel:Downloading kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on mon.b... 2024-04-12T19:25:22.835 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 2024-04-12T19:25:23.056 INFO:teuthology.task.kernel:fetching, builder baseurl is https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ 2024-04-12T19:25:23.056 DEBUG:teuthology.orchestra.run.smithi171:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/ --input-file=- 2024-04-12T19:25:23.058 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi171.front.sepia.ceph.com to complete... 2024-04-12T19:25:34.946 INFO:teuthology.orchestra.run.smithi131.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-12T19:25:35.157 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12 19:25:35 URL:https://3.chacra.ceph.com/r/kernel/testing/3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_g3f60ed14f7c1-1.x86_64.rpm [357344123/357344123] -> "/tmp/kernel.x86_64.rpm" [1] 2024-04-12T19:25:35.157 INFO:teuthology.orchestra.run.smithi171.stderr:FINISHED --2024-04-12 19:25:35-- 2024-04-12T19:25:35.157 INFO:teuthology.orchestra.run.smithi171.stderr:Total wall clock time: 12s 2024-04-12T19:25:35.157 INFO:teuthology.orchestra.run.smithi171.stderr:Downloaded: 1 files, 341M in 12s (28.9 MB/s) 2024-04-12T19:25:35.160 INFO:teuthology.task.kernel:Installing kernel 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 on mon.b... 2024-04-12T19:25:35.160 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-04-12T19:25:37.250 INFO:teuthology.orchestra.run.smithi171.stdout:Verifying... ######################################## 2024-04-12T19:25:37.394 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing... ######################################## 2024-04-12T19:25:37.473 INFO:teuthology.orchestra.run.smithi171.stdout:Updating / installing... 2024-04-12T19:25:45.469 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-6.9.0_rc3_g3f60ed14f7c1-1 ######################################## 2024-04-12T19:25:57.789 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-12T19:25:57.790 DEBUG:teuthology.orchestra.run.smithi131:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-12T19:25:57.867 INFO:teuthology.orchestra.run.smithi131.stdout:/boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:25:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:/boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:25:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:/boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:25:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/System.map 2024-04-12T19:25:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/config 2024-04-12T19:25:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel 2024-04-12T19:25:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch 2024-04-12T19:25:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86 2024-04-12T19:25:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto 2024-04-12T19:25:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-12T19:25:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-12T19:25:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-12T19:25:57.868 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-12T19:25:57.869 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-12T19:25:57.870 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-12T19:25:57.871 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-12T19:25:57.872 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-12T19:25:57.873 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata 2024-04-12T19:25:57.874 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ata_generic.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-12T19:25:57.875 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-12T19:25:57.876 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sis.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-12T19:25:57.877 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay 2024-04-12T19:25:57.878 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/brd.ko 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/loop.ko 2024-04-12T19:25:57.879 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/virtio_blk.ko 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkfront.ko 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char 2024-04-12T19:25:57.880 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-12T19:25:57.881 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm.ko 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/uv_mmtimer.ko 2024-04-12T19:25:57.882 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/virtio_console.ko 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common 2024-04-12T19:25:57.883 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-12T19:25:57.884 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-12T19:25:57.885 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/edd.ko 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-12T19:25:57.886 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-12T19:25:57.887 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-12T19:25:57.888 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-12T19:25:57.889 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-12T19:25:57.890 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-12T19:25:57.891 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-12T19:25:57.892 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-12T19:25:57.893 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-12T19:25:57.894 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-12T19:25:57.895 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-12T19:25:57.896 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-12T19:25:57.897 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-12T19:25:57.898 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-12T19:25:57.899 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-12T19:25:57.899 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-12T19:25:57.899 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-12T19:25:57.899 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-12T19:25:57.901 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-12T19:25:57.901 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-12T19:25:57.901 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-12T19:25:57.902 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-12T19:25:57.903 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-12T19:25:57.904 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-dev.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw 2024-04-12T19:25:57.905 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert 2024-04-12T19:25:57.906 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-12T19:25:57.907 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-12T19:25:57.908 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-12T19:25:57.909 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-12T19:25:57.910 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-12T19:25:57.911 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mfd-core.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-12T19:25:57.912 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-12T19:25:57.913 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci 2024-04-12T19:25:57.914 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-12T19:25:57.915 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-12T19:25:57.916 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-12T19:25:57.917 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-12T19:25:57.918 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-12T19:25:57.919 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-12T19:25:57.920 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb 2024-04-12T19:25:57.921 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-12T19:25:57.922 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-12T19:25:57.923 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek 2024-04-12T19:25:57.924 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-12T19:25:57.925 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti 2024-04-12T19:25:57.926 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154 2024-04-12T19:25:57.927 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/net_failover.ko 2024-04-12T19:25:57.928 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-12T19:25:57.929 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/dp83640.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-12T19:25:57.930 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slhc.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-12T19:25:57.931 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tun.ko 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/virtio_net.ko 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netfront.ko 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-12T19:25:57.932 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia 2024-04-12T19:25:57.933 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-12T19:25:57.934 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-12T19:25:57.935 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-12T19:25:57.936 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-12T19:25:57.937 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-12T19:25:57.938 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-12T19:25:57.939 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-12T19:25:57.940 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-12T19:25:57.941 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-12T19:25:57.942 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-12T19:25:57.943 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-12T19:25:57.944 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-12T19:25:57.945 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-12T19:25:57.946 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-12T19:25:57.947 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-12T19:25:57.948 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-12T19:25:57.949 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-12T19:25:57.950 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-12T19:25:57.951 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-12T19:25:57.952 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-12T19:25:57.953 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-12T19:25:57.954 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-12T19:25:57.955 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci 2024-04-12T19:25:57.956 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio 2024-04-12T19:25:57.957 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio.ko 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_balloon.ko 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_mmio.ko 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci.ko 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_ring.ko 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-12T19:25:57.958 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-12T19:25:57.959 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-12T19:25:57.960 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs 2024-04-12T19:25:57.961 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph 2024-04-12T19:25:57.962 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/fat.ko 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/vfat.ko 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse 2024-04-12T19:25:57.963 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/fuse.ko 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix 2024-04-12T19:25:57.964 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-12T19:25:57.965 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-12T19:25:57.966 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-12T19:25:57.967 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-12T19:25:57.968 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster 2024-04-12T19:25:57.969 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs 2024-04-12T19:25:57.970 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf 2024-04-12T19:25:57.971 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu/rcutorture.ko 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/asn1_encoder.ko 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-12T19:25:57.972 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-12T19:25:57.973 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd/zstd_compress.ko 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-12T19:25:57.974 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-12T19:25:57.975 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-12T19:25:57.976 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph 2024-04-12T19:25:57.977 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/failover.ko 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver/dns_resolver.ko 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-12T19:25:57.978 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-12T19:25:57.979 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-12T19:25:57.980 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-12T19:25:57.981 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-12T19:25:57.982 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-12T19:25:57.983 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-12T19:25:57.984 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-12T19:25:57.985 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-12T19:25:57.986 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-12T19:25:57.987 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-12T19:25:57.988 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-12T19:25:57.989 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-12T19:25:57.990 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-12T19:25:57.991 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_quota.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tunnel.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-12T19:25:57.992 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-12T19:25:57.993 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-12T19:25:57.994 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-12T19:25:57.995 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-12T19:25:57.996 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds 2024-04-12T19:25:57.997 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-12T19:25:57.998 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-12T19:25:57.999 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-12T19:25:58.000 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc 2024-04-12T19:25:58.001 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys 2024-04-12T19:25:58.002 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys/trusted.ko 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-12T19:25:58.003 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-12T19:25:58.004 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-12T19:25:58.004 INFO:teuthology.orchestra.run.smithi131.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-12T19:25:58.008 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:25:58.008 DEBUG:teuthology.orchestra.run.smithi131:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-12T19:25:58.031 INFO:teuthology.orchestra.run.smithi131.stdout:postinstall scriptlet (using /bin/sh): 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g3f60ed14f7c1 /lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout:for file in vmlinuz System.map config; do 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1"; then 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: cp "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1" 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: fi 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout:done 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout:if [ -d "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" ] && \ 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" >/dev/null 2>&1; then 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout: cp -r "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-12T19:25:58.032 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2024-04-12T19:25:58.033 INFO:teuthology.orchestra.run.smithi131.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep" ]; then 2024-04-12T19:25:58.033 INFO:teuthology.orchestra.run.smithi131.stdout: /usr/sbin/depmod 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:25:58.033 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2024-04-12T19:25:58.033 INFO:teuthology.orchestra.run.smithi131.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-12T19:25:58.033 INFO:teuthology.orchestra.run.smithi131.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-12T19:25:58.033 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-install remove 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:25:58.033 INFO:teuthology.orchestra.run.smithi131.stdout:fi 2024-04-12T19:25:58.034 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -qi grub2-tools 2024-04-12T19:25:58.119 INFO:teuthology.orchestra.run.smithi131.stdout:Name : grub2-tools 2024-04-12T19:25:58.119 INFO:teuthology.orchestra.run.smithi131.stdout:Epoch : 1 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:Version : 2.06 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:Release : 68.el9 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: x86_64 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:Group : Unspecified 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:Size : 8264254 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:License : GPLv3+ 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:Packager : builder@centos.org 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:Vendor : CentOS 2024-04-12T19:25:58.120 INFO:teuthology.orchestra.run.smithi131.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-12T19:25:58.121 INFO:teuthology.orchestra.run.smithi131.stdout:Summary : Support tools for GRUB. 2024-04-12T19:25:58.121 INFO:teuthology.orchestra.run.smithi131.stdout:Description : 2024-04-12T19:25:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:25:58.121 INFO:teuthology.orchestra.run.smithi131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-12T19:25:58.121 INFO:teuthology.orchestra.run.smithi131.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-12T19:25:58.121 INFO:teuthology.orchestra.run.smithi131.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-12T19:25:58.121 INFO:teuthology.orchestra.run.smithi131.stdout:hardware devices. 2024-04-12T19:25:58.121 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:25:58.121 INFO:teuthology.orchestra.run.smithi131.stdout:This subpackage provides tools for support of all platforms. 2024-04-12T19:25:58.122 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-12T19:25:58.122 INFO:teuthology.task.kernel:Updating grub on smithi131 to boot 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:25:58.122 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-12T19:25:58.670 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2024-04-12T19:26:00.167 INFO:teuthology.orchestra.run.smithi131.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-12T19:26:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:done 2024-04-12T19:26:00.194 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-04-12T19:26:00.208 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.eraOZpcnkx 2024-04-12T19:26:00.209 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.eraOZpcnkx 2024-04-12T19:26:00.277 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.eraOZpcnkx 2024-04-12T19:26:00.414 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.eraOZpcnkx is 6KB 2024-04-12T19:26:00.462 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.eraOZpcnkx 2024-04-12T19:26:00.476 DEBUG:teuthology.orchestra.run.smithi131:> sudo /bin/ls /boot/loader/entries || true 2024-04-12T19:26:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-12T19:26:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-12T19:26:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-12T19:26:00.542 INFO:teuthology.orchestra.run.smithi131.stdout:15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1.conf 2024-04-12T19:26:00.543 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:26:00.702 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2024-04-12T19:26:03.013 INFO:teuthology.orchestra.run.smithi171.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-04-12T19:26:26.050 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-04-12T19:26:26.050 DEBUG:teuthology.orchestra.run.smithi171:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-04-12T19:26:26.124 INFO:teuthology.orchestra.run.smithi171.stdout:/boot/System.map-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:26:26.124 INFO:teuthology.orchestra.run.smithi171.stdout:/boot/config-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:26:26.124 INFO:teuthology.orchestra.run.smithi171.stdout:/boot/vmlinuz-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:26:26.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/System.map 2024-04-12T19:26:26.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/config 2024-04-12T19:26:26.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel 2024-04-12T19:26:26.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch 2024-04-12T19:26:26.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86 2024-04-12T19:26:26.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto 2024-04-12T19:26:26.124 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crc32c-intel.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-avx2.ko 2024-04-12T19:26:26.125 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-amd.ko 2024-04-12T19:26:26.126 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm-intel.ko 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/arch/x86/kvm/kvm.ko 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ansi_cprng.ko 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/anubis.ko 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/arc4.ko 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_memcpy.ko 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_pq.ko 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_raid6_recov.ko 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_tx.ko 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/async_xor.ko 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/async_tx/raid6test.ko 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authenc.ko 2024-04-12T19:26:26.127 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/authencesn.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blake2b_generic.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_common.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/blowfish_generic.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/camellia_generic.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast5_generic.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast6_generic.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cast_common.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/ccm.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cmac.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crc32_generic.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_engine.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/crypto_user.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/cts.ko 2024-04-12T19:26:26.128 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/des_generic.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/dh_generic.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/echainiv.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/essiv.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/fcrypt.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/khazad.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/lz4hc.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/md4.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/michael_mic.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcbc.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/pcrypt.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/rmd160.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/seed.ko 2024-04-12T19:26:26.129 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/serpent_generic.ko 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tcrypt.ko 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/tea.ko 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_common.ko 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/twofish_generic.ko 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/vmac.ko 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/wp512.ko 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xcbc.ko 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xor.ko 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/crypto/xxhash_generic.ko 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_ipmi.ko 2024-04-12T19:26:26.130 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/acpi_pad.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/ec_sys.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/platform_profile.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbs.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/sbshc.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/acpi/video.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/acard-ahci.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ahci_platform.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/ata_generic.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/libahci_platform.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_acpi.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ali.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_amd.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_artop.ko 2024-04-12T19:26:26.131 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atiixp.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_atp867x.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd640.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cmd64x.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_cypress.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_efar.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt366.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt37x.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x2n.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_hpt3x3.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it8213.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_it821x.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_jmicron.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_marvell.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_mpiix.ko 2024-04-12T19:26:26.132 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_netcell.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ninja32.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87410.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_ns87415.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_oldpiix.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_opti.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_optidma.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pcmcia.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc2027x.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_piccolo.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_rdc.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sch.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_serverworks.ko 2024-04-12T19:26:26.133 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sil680.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sis.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_sl82c105.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_triflex.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pata_via.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/pdc_adma.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_inic162x.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_mv.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_nv.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_promise.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_qstor.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sil24.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sis.ko 2024-04-12T19:26:26.134 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_svw.ko 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_sx4.ko 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_uli.ko 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_via.ko 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ata/sata_vsc.ko 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/auxdisplay/ks0108.ko 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-i2c.ko 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/base/regmap/regmap-mmio.ko 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/bcma/bcma.ko 2024-04-12T19:26:26.135 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/aoe/aoe.ko 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/brd.ko 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/drbd/drbd.ko 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/floppy.ko 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/loop.ko 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/nbd.ko 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/null_blk/null_blk.ko 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/pktcdvd.ko 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/rbd.ko 2024-04-12T19:26:26.136 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/virtio_blk.ko 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/xen-blkfront.ko 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/block/zram/zram.ko 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hangcheck-timer.ko 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/amd-rng.ko 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/intel-rng.ko 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/via-rng.ko 2024-04-12T19:26:26.137 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/hw_random/virtio-rng.ko 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_si.ko 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/lp.ko 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/mwave/mwave.ko 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/ppdev.ko 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tlclk.ko 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm 2024-04-12T19:26:26.138 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_atmel.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_infineon.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_nsc.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/uv_mmtimer.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/char/virtio_console.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/p4-clockmod.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/powernow-k8.ko 2024-04-12T19:26:26.139 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/cpufreq/speedstep-lib.ko 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/ccp/ccp.ko 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-aes.ko 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/padlock-sha.ko 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio 2024-04-12T19:26:26.140 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dca/dca.ko 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/dw/dw_dmac.ko 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/dma/ioat/ioatdma.ko 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/amd64_edac.ko 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/e752x_edac.ko 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/edac_mce_amd.ko 2024-04-12T19:26:26.141 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3000_edac.ko 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i3200_edac.ko 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5100_edac.ko 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i5400_edac.ko 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7300_edac.ko 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i7core_edac.ko 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/i82975x_edac.ko 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/ie31200_edac.ko 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/sb_edac.ko 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/edac/x38_edac.ko 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/edd.ko 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/firmware/iscsi_ibft.ko 2024-04-12T19:26:26.142 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-ich.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/gpio/gpio-viperboard.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-appleir.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-aureal.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-axff.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-dr.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elecom.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-elo.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-emsff.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gaff.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gt683r.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-gyration.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-kbd.ko 2024-04-12T19:26:26.143 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtek-mouse.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-holtekff.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-hyperv.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-icade.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-keytouch.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-kye.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lcpower.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-led.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-lenovo.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-dj.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-multitouch.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-ortek.ko 2024-04-12T19:26:26.144 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-penmount.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-petalynx.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-picolcd.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-pl.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-plantronics.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-primax.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-rmi.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-arvo.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-common.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-isku.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kone.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-konepure.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-lua.ko 2024-04-12T19:26:26.145 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-pyra.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-ryos.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat-savu.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-roccat.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-saitek.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-samsung.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sensor-hub.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sjoy.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sony.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-speedlink.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-steelseries.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-sunplus.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-thrustmaster.ko 2024-04-12T19:26:26.146 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tivo.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-tmff.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-topseed.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-twinhan.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-uclogic.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-waltop.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-wiimote.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-xinmo.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zpff.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/hid-zydacron.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/uhid.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hid/wacom.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_balloon.ko 2024-04-12T19:26:26.147 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_utils.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hv/hv_vmbus.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/abituguru3.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/acpi_power_meter.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7414.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ad7418.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adc128d818.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1025.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1026.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1029.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm1031.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adm9240.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ads7828.ko 2024-04-12T19:26:26.148 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7410.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7411.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7462.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7470.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7475.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/adt7x10.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/amc6821.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/applesmc.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asb100.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asc7621.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/asus_atk0110.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/atxp1.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/coretemp.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/dme1737.ko 2024-04-12T19:26:26.149 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds1621.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ds620.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc1403.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/emc6w201.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71805f.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f71882fg.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/f75375s.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fam15h_power.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/fschmd.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g760a.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/g762.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl518sm.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/gl520sm.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/hwmon-vid.ko 2024-04-12T19:26:26.150 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5500_temp.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/i5k_amb.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmaem.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ibmpex.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina209.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ina2xx.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/it87.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k10temp.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/k8temp.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lineage-pem.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm63.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm73.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm75.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm77.ko 2024-04-12T19:26:26.151 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm78.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm80.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm83.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm85.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm87.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm90.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm92.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm93.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95234.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95241.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/lm95245.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc2945.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4151.ko 2024-04-12T19:26:26.152 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4215.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4222.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4245.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4260.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/ltc4261.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max16065.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1619.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max1668.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max197.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6639.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6650.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/max6697.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/mcp3021.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6683.ko 2024-04-12T19:26:26.153 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775-core.ko 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct6775.ko 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/nct7802.ko 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87360.ko 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pc87427.ko 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pcf8591.ko 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max16064.ko 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max34440.ko 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/max8688.ko 2024-04-12T19:26:26.154 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/powr1220.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5627.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch5636.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sch56xx-common.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht15.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sht21.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/shtc1.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/sis5595.ko 2024-04-12T19:26:26.155 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47b397.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m1.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/smsc47m192.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/thmc50.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp102.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp103.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp401.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/tmp421.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via-cputemp.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/via686a.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt1211.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/vt8231.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627ehf.ko 2024-04-12T19:26:26.156 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83627hf.ko 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83781d.ko 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83791d.ko 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83792d.ko 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83793.ko 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83795.ko 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l785ts.ko 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/hwmon/w83l786ng.ko 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-04-12T19:26:26.157 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-i801.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-isch.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-parport.ko 2024-04-12T19:26:26.158 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-via.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-dev.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-mux.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-smbus.ko 2024-04-12T19:26:26.159 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/i2c/i2c-stub.ko 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_cm.ko 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_core.ko 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_umad.ko 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/iw_cm.ko 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_cm.ko 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4 2024-04-12T19:26:26.160 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-04-12T19:26:26.161 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/fm801-gp.ko 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/gameport/gameport.ko 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/joydev.ko 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/keyboard/gpio_keys.ko 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/appletouch.ko 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/bcm5974.ko 2024-04-12T19:26:26.162 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/cyapatp.ko 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/elan_i2c.ko 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/sermouse.ko 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/synaptics_usb.ko 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/mouse/vsxxxaa.ko 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/rmi4/rmi_core.ko 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/altera_ps2.ko 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/arc_ps2.ko 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/serio/serio_raw.ko 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/input/sparse-keymap.ko 2024-04-12T19:26:26.163 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-blinkm.ko 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lm3530.ko 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-lp3944.ko 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/leds-ss4200.ko 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-04-12T19:26:26.164 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/bcache/bcache.ko 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-bio-prison.ko 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache-smq.ko 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-cache.ko 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-crypt.ko 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-delay.ko 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-flakey.ko 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-log-userspace.ko 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-multipath.ko 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-queue-length.ko 2024-04-12T19:26:26.165 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-raid.ko 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-round-robin.ko 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-service-time.ko 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-switch.ko 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-thin-pool.ko 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/dm-verity.ko 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid0.ko 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid1.ko 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid10.ko 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/md/raid456.ko 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion 2024-04-12T19:26:26.166 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptbase.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptctl.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptfc.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptlan.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptsas.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptscsih.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/message/fusion/mptspi.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_ich.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/lpc_sch.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/mfd-core.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/sm501.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/viperboard.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/vx855.ko 2024-04-12T19:26:26.167 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/mfd/wl1273-core.ko 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds9802als.ko 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/apds990x.ko 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/bh1770glc.ko 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/cb710/cb710.ko 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/at24.ko 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/eeprom/max6875.ko 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/enclosure.ko 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/hpilo.ko 2024-04-12T19:26:26.168 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29003.ko 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/isl29020.ko 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-me.ko 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei-txe.ko 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/mei/mei.ko 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-gru/gru.ko 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xp.ko 2024-04-12T19:26:26.169 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpc.ko 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_7xx1.ko 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tifm_core.ko 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/tsl2550.ko 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_balloon.ko 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/bonding/bonding.ko 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/b53/b53_common.ko 2024-04-12T19:26:26.170 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/bcm-sf2.ko 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6060.ko 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/dummy.ko 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/eql.ko 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/8390.ko 2024-04-12T19:26:26.171 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/agere/et131x.ko 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-04-12T19:26:26.172 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-04-12T19:26:26.173 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-04-12T19:26:26.174 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-04-12T19:26:26.175 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/dnet.ko 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ethoc.ko 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/fealnx.ko 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e100.ko 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-04-12T19:26:26.176 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-04-12T19:26:26.177 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/jme.ko 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/skge.ko 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-04-12T19:26:26.178 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-04-12T19:26:26.179 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/atp.ko 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-04-12T19:26:26.180 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis190.ko 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sis/sis900.ko 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac 2024-04-12T19:26:26.181 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/cassini.ko 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/niu.ko 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sungem.ko 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/ti/tlan.ko 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-04-12T19:26:26.182 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/geneve.ko 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ieee802154/fakelb.ko 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ifb.ko 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ipvlan/ipvlan.ko 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvlan.ko 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/macvtap.ko 2024-04-12T19:26:26.183 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio.ko 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mdio/mdio-regmap.ko 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/mii.ko 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/net_failover.ko 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/netconsole.ko 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/nlmon.ko 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs-lynx.ko 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/amd.ko 2024-04-12T19:26:26.184 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm7xxx.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/bcm87xx.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/broadcom.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/cicada.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/davicom.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/dp83640.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/et1011c.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/icplus.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/lxt.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/marvell.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/micrel.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/national.ko 2024-04-12T19:26:26.185 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/phylink.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/qsemi.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/realtek.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/smsc.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/ste10Xp.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/phy/vitesse.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/bsd_comp.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_async.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_deflate.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_generic.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_mppe.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/ppp_synctty.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppoe.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pppox.ko 2024-04-12T19:26:26.186 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/ppp/pptp.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slhc.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/slip/slip.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/sungem_phy.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tap.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_activebackup.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_broadcast.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_random.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/tun.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/veth.ko 2024-04-12T19:26:26.187 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/virtio_net.ko 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/vxlan/vxlan.ko 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netback/xen-netback.ko 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/net/xen-netfront.ko 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ntb/ntb.ko 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme-core.ko 2024-04-12T19:26:26.188 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/nvme/host/nvme.ko 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport.ko 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_cs.ko 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_pc.ko 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/parport/parport_serial.ko 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/pcie/aer_inject.ko 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pci/xen-pcifront.ko 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/i82092.ko 2024-04-12T19:26:26.189 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/pd6729.ko 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pcmcia/yenta_socket.ko 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acer-wmi.ko 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/acerhdf.ko 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/apple-gmux.ko 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-laptop.ko 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/asus-wmi.ko 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/classmate-laptop.ko 2024-04-12T19:26:26.190 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/hdaps.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/intel_ips.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/msi-wmi.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/mxm-wmi.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-laptop.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/samsung-q10.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/topstar-laptop.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-04-12T19:26:26.191 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/toshiba_haps.ko 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi-bmof.ko 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/platform/x86/wmi.ko 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_common.ko 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/powercap/intel_rapl_msr.ko 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-gpio.ko 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps-ldisc.ko 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/clients/pps_parport.ko 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/pps/pps_core.ko 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp.ko 2024-04-12T19:26:26.192 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ptp/ptp_kvm.ko 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ras/amd/fmpm.ko 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-bq32k.ko 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1286.ko 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1307.ko 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1374.ko 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1511.ko 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1553.ko 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1672.ko 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds1742.ko 2024-04-12T19:26:26.193 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds2404.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-ds3232.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-em3027.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-fm3130.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl12022.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-isl1208.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m41t80.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t35.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-m48t59.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-max6900.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-msm6242.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf2127.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf85063.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8523.ko 2024-04-12T19:26:26.194 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8563.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-pcf8583.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rp5c01.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rs5c372.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8025.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-rx8581.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/rtc/rtc-x1205.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-9xxx.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-sas.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/3w-xxxx.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/BusLogic.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/a100u2w.ko 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid 2024-04-12T19:26:26.195 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aacraid/aacraid.ko 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/advansys.ko 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/am53c974.ko 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/atp870u.ko 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bfa/bfa.ko 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc 2024-04-12T19:26:26.196 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ch.ko 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/csiostor/csiostor.ko 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dc395x.ko 2024-04-12T19:26:26.197 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/dmx3191d.ko 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esas2r/esas2r.ko 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/esp_scsi.ko 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/fcoe.ko 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic 2024-04-12T19:26:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/fnic/fnic.ko 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hpsa.ko 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hptiop.ko 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/hv_storvsc.ko 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/initio.ko 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ipr.ko 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ips.ko 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/isci/isci.ko 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/iscsi_tcp.ko 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libfc/libfc.ko 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi.ko 2024-04-12T19:26:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libiscsi_tcp.ko 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/libsas/libsas.ko 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/lpfc/lpfc.ko 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid.ko 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvsas/mvsas.ko 2024-04-12T19:26:26.200 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/mvumi.ko 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/pmcraid.ko 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla1280.ko 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/raid_class.ko 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_debug.ko 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_fc.ko 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-04-12T19:26:26.201 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_sas.ko 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_spi.ko 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/scsi_transport_srp.ko 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/ses.ko 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/st.ko 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/stex.ko 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/virtio_scsi.ko 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/vmw_pvscsi.ko 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/scsi/wd719x.ko 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ssb/ssb.ko 2024-04-12T19:26:26.202 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/loopback/tcm_loop.ko 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_file.ko 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_iblock.ko 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_mod.ko 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_pscsi.ko 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/target_core_user.ko 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel 2024-04-12T19:26:26.203 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-04-12T19:26:26.204 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_gsm.ko 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/n_hdlc.ko 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/nozomi.ko 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-04-12T19:26:26.205 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/arc_uart.ko 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/tty/serial/jsm/jsm.ko 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/core/ufshcd-core.ko 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio.ko 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_aec.ko 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_cif.ko 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_pci_generic.ko 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/uio/uio_sercos3.ko 2024-04-12T19:26:26.206 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-acm.ko 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/cdc-wdm.ko 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usblp.ko 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/class/usbtmc.ko 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/host/sl811-hcd.ko 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/mdc800.ko 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/image/microtek.ko 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/adutux.ko 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/appledisplay.ko 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi26.ko 2024-04-12T19:26:26.207 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/emi62.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ezusb.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/idmouse.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/iowarrior.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/isight_firmware.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/ldusb.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/legousbtower.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/trancevibrator.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usb3503.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usblcd.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/usbsevseg.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/uss720.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/misc/yurex.ko 2024-04-12T19:26:26.208 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy 2024-04-12T19:26:26.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/phy/phy-generic.ko 2024-04-12T19:26:26.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial 2024-04-12T19:26:26.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/aircable.ko 2024-04-12T19:26:26.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ark3116.ko 2024-04-12T19:26:26.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/belkin_sa.ko 2024-04-12T19:26:26.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ch341.ko 2024-04-12T19:26:26.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cp210x.ko 2024-04-12T19:26:26.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cyberjack.ko 2024-04-12T19:26:26.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/cypress_m8.ko 2024-04-12T19:26:26.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/digi_acceleport.ko 2024-04-12T19:26:26.209 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/empeg.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ftdi_sio.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/garmin_gps.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_edgeport.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/io_ti.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipaq.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ipw.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ir-usb.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/keyspan_pda.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kl5kusb105.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/kobil_sct.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mct_u232.ko 2024-04-12T19:26:26.210 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7720.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/mos7840.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/navman.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/omninet.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/opticon.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/option.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/oti6858.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/pl2303.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcaux.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/qcserial.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/quatech2.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/safe_serial.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/sierra.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/spcp8x5.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ssu100.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/symbolserial.ko 2024-04-12T19:26:26.211 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_debug.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/usb_wwan.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/visor.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/whiteheat.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/serial/xsens_mt.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/uas.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-alauda.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-cypress.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-datafab.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-freecom.ko 2024-04-12T19:26:26.212 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-isd200.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-karma.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-onetouch.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-realtek.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr09.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-sddr55.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/ums-usbat.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/storage/usb-storage.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-core.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/usbip-host.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-04-12T19:26:26.213 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/pci/vfio-pci.ko 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio.ko 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost.ko 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_iotlb.ko 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_net.ko 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/vhost/vhost_scsi.ko 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/apple_bl.ko 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/lcd.ko 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/video/backlight/platform_lcd.ko 2024-04-12T19:26:26.214 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio.ko 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_balloon.ko 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_mmio.ko 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci.ko 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/virtio/virtio_ring.ko 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2482.ko 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/masters/ds2490.ko 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-04-12T19:26:26.215 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_smem.ko 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/slaves/w1_therm.ko 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/w1/wire.ko 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim1535_wdt.ko 2024-04-12T19:26:26.216 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/alim7101_wdt.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/f71808e_wdt.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/hpwdt.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/i6300esb.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/iTCO_wdt.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ib700wdt.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ibmasr.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it8712f_wdt.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/it87_wdt.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/machzwd.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/nv_tco.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_pci.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/pcwd_usb.ko 2024-04-12T19:26:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sch311x_wdt.ko 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/softdog.ko 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/sp5100_tco.ko 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/via_wdt.ko 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83877f_wdt.ko 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/w83977f_wdt.ko 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/wdt_pci.ko 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/watchdog/xen_wdt.ko 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-acpi-processor.ko 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-evtchn.ko 2024-04-12T19:26:26.218 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntalloc.ko 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-gntdev.ko 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xen-privcmd.ko 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/drivers/xen/xenfs/xenfs.ko 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/9p/9p.ko 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/affs/affs.ko 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs 2024-04-12T19:26:26.219 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/befs/befs.ko 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/binfmt_misc.ko 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/btrfs/btrfs.ko 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cachefiles/cachefiles.ko 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ceph/ceph.ko 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/coda/coda.ko 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/cramfs/cramfs.ko 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/dlm/dlm.ko 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs 2024-04-12T19:26:26.220 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ecryptfs/ecryptfs.ko 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/f2fs/f2fs.ko 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/fat.ko 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/msdos.ko 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fat/vfat.ko 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/cuse.ko 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/fuse/fuse.ko 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/gfs2/gfs2.ko 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfs/hfs.ko 2024-04-12T19:26:26.221 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/hfsplus/hfsplus.ko 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/isofs/isofs.ko 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/jfs/jfs.ko 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/lockd/lockd.ko 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/minix/minix.ko 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/netfs/netfs.ko 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs 2024-04-12T19:26:26.222 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfs.ko 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv3.ko 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs/nfsv4.ko 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/grace.ko 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfs_common/nfs_acl.ko 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nfsd/nfsd.ko 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2 2024-04-12T19:26:26.223 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nilfs2/nilfs2.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-celtic.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-centeuro.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-croatian.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-cyrillic.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-gaelic.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-greek.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-iceland.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-inuit.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-roman.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-romanian.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/mac-turkish.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1250.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1251.ko 2024-04-12T19:26:26.224 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp1255.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp737.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp775.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp850.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp852.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp855.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp857.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp860.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp861.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp862.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp863.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp864.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp865.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp866.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp869.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp874.ko 2024-04-12T19:26:26.225 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp932.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp936.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp949.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_cp950.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_euc-jp.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-1.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-13.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-14.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-15.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-2.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-3.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-4.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-5.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-6.ko 2024-04-12T19:26:26.226 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-7.ko 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_iso8859-9.ko 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-r.ko 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-ru.ko 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_koi8-u.ko 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_ucs2_utils.ko 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/nls/nls_utf8.ko 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-04-12T19:26:26.227 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2.ko 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/overlayfs/overlay.ko 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/pstore/ramoops.ko 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/reiserfs/reiserfs.ko 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/romfs/romfs.ko 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/client/cifs.ko 2024-04-12T19:26:26.228 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_arc4.ko 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/smb/common/cifs_md4.ko 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/squashfs/squashfs.ko 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/sysv/sysv.ko 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/udf/udf.ko 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/ufs/ufs.ko 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/fs/xfs/xfs.ko 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu 2024-04-12T19:26:26.229 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/rcu/rcutorture.ko 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/torture.ko 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/asn1_encoder.ko 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc-itu-t.ko 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crc8.ko 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libarc4.ko 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/crypto/libdes.ko 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/libcrc32c.ko 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lru_cache.ko 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4 2024-04-12T19:26:26.230 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4_compress.ko 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/lz4/lz4hc_compress.ko 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/math/cordic.ko 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/raid6/raid6_pq.ko 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/reed_solomon/reed_solomon.ko 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_bm.ko 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_fsm.ko 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/ts_kmp.ko 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/lib/zstd/zstd_compress.ko 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/mm/hwpoison-inject.ko 2024-04-12T19:26:26.231 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net 2024-04-12T19:26:26.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan 2024-04-12T19:26:26.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/6lowpan.ko 2024-04-12T19:26:26.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_dest.ko 2024-04-12T19:26:26.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_fragment.ko 2024-04-12T19:26:26.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_hop.ko 2024-04-12T19:26:26.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_ipv6.ko 2024-04-12T19:26:26.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_mobility.ko 2024-04-12T19:26:26.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_routing.ko 2024-04-12T19:26:26.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/6lowpan/nhc_udp.ko 2024-04-12T19:26:26.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802 2024-04-12T19:26:26.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/garp.ko 2024-04-12T19:26:26.232 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/mrp.ko 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/p8022.ko 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/psnap.ko 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/802/stp.ko 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/8021q/8021q.ko 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet.ko 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_fd.ko 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_rdma.ko 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/9p/9pnet_virtio.ko 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/batman-adv/batman-adv.ko 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge 2024-04-12T19:26:26.233 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/br_netfilter.ko 2024-04-12T19:26:26.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/bridge.ko 2024-04-12T19:26:26.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter 2024-04-12T19:26:26.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-04-12T19:26:26.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_among.ko 2024-04-12T19:26:26.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arp.ko 2024-04-12T19:26:26.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-04-12T19:26:26.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-04-12T19:26:26.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip.ko 2024-04-12T19:26:26.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-04-12T19:26:26.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_limit.ko 2024-04-12T19:26:26.234 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_log.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_snat.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_stp.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/ebtables.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-04-12T19:26:26.235 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-04-12T19:26:26.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph 2024-04-12T19:26:26.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ceph/libceph.ko 2024-04-12T19:26:26.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core 2024-04-12T19:26:26.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/failover.ko 2024-04-12T19:26:26.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/core/pktgen.ko 2024-04-12T19:26:26.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp 2024-04-12T19:26:26.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp.ko 2024-04-12T19:26:26.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_diag.ko 2024-04-12T19:26:26.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv4.ko 2024-04-12T19:26:26.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dccp/dccp_ipv6.ko 2024-04-12T19:26:26.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver 2024-04-12T19:26:26.236 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dns_resolver/dns_resolver.ko 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/dsa_core.ko 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_brcm.ko 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_dsa.ko 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_none.ko 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/dsa/tag_trailer.ko 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154.ko 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ieee802154/ieee802154_socket.ko 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4 2024-04-12T19:26:26.237 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ah4.ko 2024-04-12T19:26:26.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/esp4.ko 2024-04-12T19:26:26.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/fou.ko 2024-04-12T19:26:26.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/gre.ko 2024-04-12T19:26:26.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/inet_diag.ko 2024-04-12T19:26:26.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_gre.ko 2024-04-12T19:26:26.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_tunnel.ko 2024-04-12T19:26:26.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ip_vti.ko 2024-04-12T19:26:26.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipcomp.ko 2024-04-12T19:26:26.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/ipip.ko 2024-04-12T19:26:26.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter 2024-04-12T19:26:26.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arp_tables.ko 2024-04-12T19:26:26.238 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-04-12T19:26:26.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-04-12T19:26:26.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-04-12T19:26:26.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-04-12T19:26:26.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-04-12T19:26:26.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-04-12T19:26:26.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-04-12T19:26:26.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-04-12T19:26:26.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-04-12T19:26:26.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/iptable_security.ko 2024-04-12T19:26:26.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-04-12T19:26:26.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-04-12T19:26:26.239 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_bic.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_dctcp.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_diag.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_highspeed.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_htcp.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_hybla.ko 2024-04-12T19:26:26.240 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_illinois.ko 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_lp.ko 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_scalable.ko 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_vegas.ko 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_veno.ko 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_westwood.ko 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tcp_yeah.ko 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/tunnel4.ko 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_diag.ko 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/udp_tunnel.ko 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv4/xfrm4_tunnel.ko 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ah6.ko 2024-04-12T19:26:26.241 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/esp6.ko 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/fou6.ko 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_tunnel.ko 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ip6_vti.ko 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/ipcomp6.ko 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-04-12T19:26:26.242 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-04-12T19:26:26.243 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/sit.ko 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/tunnel6.ko 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/ipv6/xfrm6_tunnel.ko 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/key/af_key.ko 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_core.ko 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_debugfs.ko 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_eth.ko 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip.ko 2024-04-12T19:26:26.244 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ip6.ko 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_netlink.ko 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/l2tp/l2tp_ppp.ko 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/llc/llc.ko 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mac802154/mac802154.ko 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/mpls/mpls_gso.ko 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set.ko 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-04-12T19:26:26.245 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-04-12T19:26:26.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-04-12T19:26:26.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-04-12T19:26:26.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-04-12T19:26:26.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-04-12T19:26:26.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-04-12T19:26:26.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-04-12T19:26:26.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-04-12T19:26:26.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-04-12T19:26:26.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-04-12T19:26:26.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-04-12T19:26:26.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-04-12T19:26:26.246 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-04-12T19:26:26.247 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conncount.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_h323.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_irc.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sane.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_sip.ko 2024-04-12T19:26:26.248 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_dup_netdev.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_flow_table_inet.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_log_syslog.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_amanda.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_ftp.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_irc.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_sip.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_nat_tftp.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_synproxy_core.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nf_tables.ko 2024-04-12T19:26:26.249 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_acct.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_log.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_osf.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nfnetlink_queue.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_chain_nat.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_compat.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_ct.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_dup_netdev.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fib.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_fwd_netdev.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_hash.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_limit.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_log.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_masq.ko 2024-04-12T19:26:26.250 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_nat.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_numgen.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_queue.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_quota.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_redir.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_reject_inet.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_socket.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/nft_tunnel.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_AUDIT.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CHECKSUM.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CLASSIFY.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_CT.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_DSCP.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HL.ko 2024-04-12T19:26:26.251 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_HMARK.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_IDLETIMER.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LED.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_LOG.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_MASQUERADE.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NETMAP.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFLOG.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_NFQUEUE.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_RATEEST.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_REDIRECT.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_SECMARK.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPMSS.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TEE.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TPROXY.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_TRACE.ko 2024-04-12T19:26:26.252 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_addrtype.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_bpf.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cgroup.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cluster.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_comment.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connbytes.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlabel.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connlimit.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_connmark.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_conntrack.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_cpu.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dccp.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_devgroup.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_dscp.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ecn.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_esp.ko 2024-04-12T19:26:26.253 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hashlimit.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_helper.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_hl.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipcomp.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_iprange.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_ipvs.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_l2tp.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_length.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_limit.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mac.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_mark.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_multiport.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nat.ko 2024-04-12T19:26:26.254 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_nfacct.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_osf.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_owner.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_physdev.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_pkttype.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_policy.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_quota.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_rateest.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_realm.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_recent.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_sctp.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_set.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_socket.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_state.ko 2024-04-12T19:26:26.255 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_statistic.ko 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_string.ko 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_tcpmss.ko 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_time.ko 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netfilter/xt_u32.ko 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/netlink/netlink_diag.ko 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/nsh/nsh.ko 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/openvswitch.ko 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-geneve.ko 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-gre.ko 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/openvswitch/vport-vxlan.ko 2024-04-12T19:26:26.256 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/packet/af_packet_diag.ko 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds.ko 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_rdma.ko 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/rds/rds_tcp.ko 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_csum.ko 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_gact.ko 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_mirred.ko 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_nat.ko 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_pedit.ko 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_police.ko 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_simple.ko 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_skbedit.ko 2024-04-12T19:26:26.257 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/act_vlan.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_basic.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_bpf.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_flow.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_fw.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_route.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/cls_u32.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_cmp.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_ipset.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_meta.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_nbyte.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_text.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/em_u32.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_choke.ko 2024-04-12T19:26:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_codel.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_drr.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_fq.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_gred.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hfsc.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_hhf.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_htb.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_ingress.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_mqprio_lib.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_multiq.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_netem.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_pie.ko 2024-04-12T19:26:26.259 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_plug.ko 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_prio.ko 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_qfq.ko 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_red.ko 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfb.ko 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_sfq.ko 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_tbf.ko 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sched/sch_teql.ko 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp.ko 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sctp/sctp_diag.ko 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-04-12T19:26:26.260 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/sunrpc.ko 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc.ko 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/tipc/tipc_diag.ko 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/unix/unix_diag.ko 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock.ko 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_diag.ko 2024-04-12T19:26:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/vmw_vsock/vsock_loopback.ko 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/net/xfrm/xfrm_ipcomp.ko 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/kernel/security/keys/trusted-keys/trusted.ko 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.alias.bin 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.alias.bin 2024-04-12T19:26:26.262 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.bin 2024-04-12T19:26:26.263 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.builtin.modinfo 2024-04-12T19:26:26.263 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep 2024-04-12T19:26:26.263 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep.bin 2024-04-12T19:26:26.263 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.devname 2024-04-12T19:26:26.263 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.order 2024-04-12T19:26:26.263 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.softdep 2024-04-12T19:26:26.263 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols 2024-04-12T19:26:26.263 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.symbols.bin 2024-04-12T19:26:26.263 INFO:teuthology.orchestra.run.smithi171.stdout:/lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-12T19:26:26.267 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:26:26.267 DEBUG:teuthology.orchestra.run.smithi171:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-04-12T19:26:26.289 INFO:teuthology.orchestra.run.smithi171.stdout:postinstall scriptlet (using /bin/sh): 2024-04-12T19:26:26.289 INFO:teuthology.orchestra.run.smithi171.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-12T19:26:26.289 INFO:teuthology.orchestra.run.smithi171.stdout: /usr/bin/kernel-install add 6.9.0-rc3-g3f60ed14f7c1 /lib/modules/6.9.0-rc3-g3f60ed14f7c1/vmlinuz 2024-04-12T19:26:26.289 INFO:teuthology.orchestra.run.smithi171.stdout:fi 2024-04-12T19:26:26.289 INFO:teuthology.orchestra.run.smithi171.stdout:for file in vmlinuz System.map config; do 2024-04-12T19:26:26.289 INFO:teuthology.orchestra.run.smithi171.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1"; then 2024-04-12T19:26:26.289 INFO:teuthology.orchestra.run.smithi171.stdout: cp "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/${file}" "/boot/${file}-6.9.0-rc3-g3f60ed14f7c1" 2024-04-12T19:26:26.289 INFO:teuthology.orchestra.run.smithi171.stdout: fi 2024-04-12T19:26:26.289 INFO:teuthology.orchestra.run.smithi171.stdout:done 2024-04-12T19:26:26.289 INFO:teuthology.orchestra.run.smithi171.stdout:if [ -d "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" ] && \ 2024-04-12T19:26:26.290 INFO:teuthology.orchestra.run.smithi171.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" >/dev/null 2>&1; then 2024-04-12T19:26:26.290 INFO:teuthology.orchestra.run.smithi171.stdout: rm -rf "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-12T19:26:26.290 INFO:teuthology.orchestra.run.smithi171.stdout: cp -r "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/dtb" "/boot/dtb-6.9.0-rc3-g3f60ed14f7c1" 2024-04-12T19:26:26.290 INFO:teuthology.orchestra.run.smithi171.stdout:fi 2024-04-12T19:26:26.290 INFO:teuthology.orchestra.run.smithi171.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-g3f60ed14f7c1/modules.dep" ]; then 2024-04-12T19:26:26.290 INFO:teuthology.orchestra.run.smithi171.stdout: /usr/sbin/depmod 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:26:26.290 INFO:teuthology.orchestra.run.smithi171.stdout:fi 2024-04-12T19:26:26.290 INFO:teuthology.orchestra.run.smithi171.stdout:preuninstall scriptlet (using /bin/sh): 2024-04-12T19:26:26.290 INFO:teuthology.orchestra.run.smithi171.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-04-12T19:26:26.290 INFO:teuthology.orchestra.run.smithi171.stdout:kernel-install remove 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:26:26.290 INFO:teuthology.orchestra.run.smithi171.stdout:fi 2024-04-12T19:26:26.291 DEBUG:teuthology.orchestra.run.smithi171:> sudo rpm -qi grub2-tools 2024-04-12T19:26:26.366 INFO:teuthology.orchestra.run.smithi171.stdout:Name : grub2-tools 2024-04-12T19:26:26.366 INFO:teuthology.orchestra.run.smithi171.stdout:Epoch : 1 2024-04-12T19:26:26.366 INFO:teuthology.orchestra.run.smithi171.stdout:Version : 2.06 2024-04-12T19:26:26.366 INFO:teuthology.orchestra.run.smithi171.stdout:Release : 68.el9 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: x86_64 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:Group : Unspecified 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:Size : 8264254 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:License : GPLv3+ 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:Packager : builder@centos.org 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:Vendor : CentOS 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-12T19:26:26.367 INFO:teuthology.orchestra.run.smithi171.stdout:Summary : Support tools for GRUB. 2024-04-12T19:26:26.368 INFO:teuthology.orchestra.run.smithi171.stdout:Description : 2024-04-12T19:26:26.368 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:26:26.368 INFO:teuthology.orchestra.run.smithi171.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-12T19:26:26.368 INFO:teuthology.orchestra.run.smithi171.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-12T19:26:26.368 INFO:teuthology.orchestra.run.smithi171.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-12T19:26:26.368 INFO:teuthology.orchestra.run.smithi171.stdout:hardware devices. 2024-04-12T19:26:26.368 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:26:26.368 INFO:teuthology.orchestra.run.smithi171.stdout:This subpackage provides tools for support of all platforms. 2024-04-12T19:26:26.369 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-12T19:26:26.369 INFO:teuthology.task.kernel:Updating grub on smithi171 to boot 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:26:26.369 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-12T19:26:26.938 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-04-12T19:26:28.353 INFO:teuthology.orchestra.run.smithi171.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-04-12T19:26:28.397 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-04-12T19:26:28.398 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-04-12T19:26:28.413 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.iYBqaaBdfk 2024-04-12T19:26:28.413 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.iYBqaaBdfk 2024-04-12T19:26:28.483 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.iYBqaaBdfk 2024-04-12T19:26:28.622 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.iYBqaaBdfk is 6KB 2024-04-12T19:26:28.672 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.iYBqaaBdfk 2024-04-12T19:26:28.686 DEBUG:teuthology.orchestra.run.smithi171:> sudo /bin/ls /boot/loader/entries || true 2024-04-12T19:26:28.751 INFO:teuthology.orchestra.run.smithi171.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-04-12T19:26:28.751 INFO:teuthology.orchestra.run.smithi171.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-04-12T19:26:28.751 INFO:teuthology.orchestra.run.smithi171.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-04-12T19:26:28.751 INFO:teuthology.orchestra.run.smithi171.stdout:15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1.conf 2024-04-12T19:26:28.752 DEBUG:teuthology.orchestra.run.smithi171:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:26:28.898 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now 2024-04-12T19:26:30.707 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-12T19:26:30.707 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-12T19:26:30.708 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T19:26:49.119 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.131 2024-04-12T19:26:58.126 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-12T19:26:58.127 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T19:26:58.901 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-12T19:26:58.902 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-12T19:26:58.902 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T19:27:17.278 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-12T19:27:26.286 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-12T19:27:26.287 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T19:27:29.342 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-12T19:27:41.354 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-12T19:27:41.355 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T19:27:58.146 DEBUG:teuthology.orchestra.remote:timed out 2024-04-12T19:28:10.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-12T19:28:10.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T19:28:10.607 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-04-12T19:28:11.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-12T19:28:11.316 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-12T19:28:11.317 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-04-12T19:28:11.367 INFO:teuthology.orchestra.run.smithi131.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:28:11.368 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:28:11.368 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-12T19:28:11.368 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-12T19:28:12.369 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-12T19:28:12.369 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-12T19:28:12.529 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2024-04-12T19:28:12.611 DEBUG:teuthology.parallel:result is None 2024-04-12T19:28:41.357 DEBUG:teuthology.orchestra.remote:timed out 2024-04-12T19:28:56.379 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-12T19:28:56.380 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T19:28:56.764 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-04-12T19:28:57.473 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-12T19:28:57.473 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-g3f60ed14f7c1"... 2024-04-12T19:28:57.473 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-04-12T19:28:57.525 INFO:teuthology.orchestra.run.smithi171.stdout:6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:28:57.525 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-g3f60ed14f7c1 vs 6.9.0-rc3-g3f60ed14f7c1 2024-04-12T19:28:57.525 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-12T19:28:57.525 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-12T19:28:58.526 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-12T19:28:58.526 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-12T19:28:58.672 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1 2024-04-12T19:28:58.745 DEBUG:teuthology.parallel:result is None 2024-04-12T19:28:58.745 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-12T19:28:58.757 INFO:teuthology.task.internal:Creating test directory... 2024-04-12T19:28:58.757 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-12T19:28:58.765 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-12T19:28:58.821 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-12T19:28:58.831 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-12T19:28:58.891 INFO:teuthology.task.internal:Creating archive directory... 2024-04-12T19:28:58.891 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-12T19:28:58.898 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-12T19:28:58.973 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-12T19:28:58.980 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-12T19:28:58.980 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-12T19:28:58.986 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-12T19:28:59.080 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-12T19:28:59.087 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-12T19:28:59.123 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-12T19:28:59.128 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-12T19:28:59.133 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-12T19:28:59.140 INFO:teuthology.task.internal:Configuring sudo... 2024-04-12T19:28:59.140 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-12T19:28:59.148 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-12T19:28:59.241 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-12T19:28:59.250 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-12T19:28:59.250 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-12T19:28:59.257 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-12T19:28:59.311 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-12T19:28:59.391 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-12T19:28:59.529 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-12T19:28:59.613 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-12T19:28:59.711 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:28:59.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-12T19:28:59.803 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-12T19:28:59.891 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-12T19:29:00.011 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-12T19:29:00.093 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-12T19:29:00.189 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:29:00.189 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-12T19:29:00.285 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-04-12T19:29:00.293 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-04-12T19:29:00.413 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-12T19:29:00.460 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-12T19:29:00.810 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-12T19:29:00.818 INFO:teuthology.task.internal:Starting timer... 2024-04-12T19:29:00.819 INFO:teuthology.run_tasks:Running task pcp... 2024-04-12T19:29:00.939 INFO:teuthology.run_tasks:Running task selinux... 2024-04-12T19:29:00.948 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-04-12T19:29:00.949 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2024-04-12T19:29:01.081 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: 2024-04-12T19:29:01.086 DEBUG:teuthology.orchestra.run.smithi171:> sudo service auditd rotate 2024-04-12T19:29:01.226 INFO:teuthology.orchestra.run.smithi171.stdout:Rotating logs: 2024-04-12T19:29:01.231 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-12T19:29:01.231 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2024-04-12T19:29:01.279 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2024-04-12T19:29:01.280 DEBUG:teuthology.orchestra.run.smithi171:> /usr/sbin/getenforce 2024-04-12T19:29:01.327 INFO:teuthology.orchestra.run.smithi171.stdout:Permissive 2024-04-12T19:29:01.327 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi131.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi171.front.sepia.ceph.com': 'permissive'} 2024-04-12T19:29:01.327 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-12T19:29:01.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T19:29:01.415 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-12T19:29:01.506 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T19:29:01.507 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-12T19:29:01.507 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2024-04-12T19:29:01.669 DEBUG:teuthology.orchestra.run.smithi171:> sudo /usr/sbin/setenforce permissive 2024-04-12T19:29:01.765 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-12T19:29:01.776 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-12T19:29:01.794 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-12T19:29:01.796 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi131.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-12T19:35:08.002 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi131.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-04-12T19:35:08.004 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-12T19:35:08.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T19:35:08.153 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-04-12T19:35:08.311 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-04-12T19:35:08.311 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-12T19:35:08.311 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-12T19:35:08.451 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-04-12T19:35:08.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-12T19:35:08.613 INFO:teuthology.run_tasks:Running task clock... 2024-04-12T19:35:08.623 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-12T19:35:08.624 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-12T19:35:08.624 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-12T19:35:08.632 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-12T19:35:08.632 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-12T19:35:08.724 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-12T19:35:08.734 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-12T19:35:08.776 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-12T19:35:08.789 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-12T19:35:08.867 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2024-04-12T19:35:08.885 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: ntpd: command not found 2024-04-12T19:35:08.906 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2024-04-12T19:35:08.928 INFO:teuthology.orchestra.run.smithi171.stdout:506 Cannot talk to daemon 2024-04-12T19:35:08.952 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-12T19:35:08.979 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-12T19:35:09.004 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-12T19:35:09.030 INFO:teuthology.orchestra.run.smithi171.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-12T19:35:09.147 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-04-12T19:35:09.155 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-12T19:35:09.156 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-04-12T19:35:09.156 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T19:35:09.156 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T19:35:09.156 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T19:35:09.156 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T19:35:09.160 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-04-12T19:35:09.168 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-12T19:35:09.169 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-04-12T19:35:09.169 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T19:35:09.169 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T19:35:09.169 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T19:35:09.169 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T19:35:09.170 INFO:teuthology.run_tasks:Running task install... 2024-04-12T19:35:09.179 DEBUG:teuthology.task.install:project ceph 2024-04-12T19:35:09.179 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '324baf8ddb91dea46cac50cb535c306115791355'}} 2024-04-12T19:35:09.179 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '324baf8ddb91dea46cac50cb535c306115791355'} 2024-04-12T19:35:09.179 INFO:teuthology.task.install:Using flavor: default 2024-04-12T19:35:09.185 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-12T19:35:09.185 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-12T19:35:09.185 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '324baf8ddb91dea46cac50cb535c306115791355', 'tag': None, 'wait_for_package': False} 2024-04-12T19:35:09.186 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=324baf8ddb91dea46cac50cb535c306115791355 2024-04-12T19:35:09.188 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '324baf8ddb91dea46cac50cb535c306115791355', 'tag': None, 'wait_for_package': False} 2024-04-12T19:35:09.188 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=324baf8ddb91dea46cac50cb535c306115791355 2024-04-12T19:35:09.344 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/ 2024-04-12T19:35:09.344 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2879.g324baf8d 2024-04-12T19:35:09.348 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/ 2024-04-12T19:35:09.348 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2879.g324baf8d 2024-04-12T19:35:09.626 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-12T19:35:09.627 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:35:09.627 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-12T19:35:09.634 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240411.061452/324baf8ddb91dea46cac50cb535c306115791355/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-12T19:35:09.634 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:35:09.634 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-12T19:35:09.723 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-12T19:35:09.724 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/324baf8ddb91dea46cac50cb535c306115791355/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-12T19:35:09.733 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-04-12T19:35:09.734 DEBUG:teuthology.orchestra.run.smithi171:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/324baf8ddb91dea46cac50cb535c306115791355/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-12T19:35:09.862 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-12T19:35:09.873 DEBUG:teuthology.orchestra.run.smithi171:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-12T19:35:09.993 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-12T19:35:10.002 DEBUG:teuthology.orchestra.run.smithi171:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-12T19:35:10.080 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2024-04-12T19:35:10.084 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2024-04-12T19:35:10.086 INFO:teuthology.orchestra.run.smithi171.stdout:check_obsoletes = 1 2024-04-12T19:35:10.090 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum clean all 2024-04-12T19:35:10.437 INFO:teuthology.orchestra.run.smithi171.stdout:74 files removed 2024-04-12T19:35:10.461 INFO:teuthology.orchestra.run.smithi131.stdout:74 files removed 2024-04-12T19:35:10.476 DEBUG:teuthology.orchestra.run.smithi171:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-12T19:35:10.502 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-04-12T19:35:11.339 INFO:teuthology.orchestra.run.smithi171.stdout:ceph packages for x86_64 234 kB/s | 83 kB 00:00 2024-04-12T19:35:11.570 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 149 kB/s | 83 kB 00:00 2024-04-12T19:35:12.098 INFO:teuthology.orchestra.run.smithi171.stdout:ceph noarch packages 17 kB/s | 11 kB 00:00 2024-04-12T19:35:12.112 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 26 kB/s | 11 kB 00:00 2024-04-12T19:35:12.765 INFO:teuthology.orchestra.run.smithi171.stdout:ceph source packages 3.2 kB/s | 1.9 kB 00:00 2024-04-12T19:35:12.871 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 2.8 kB/s | 1.9 kB 00:00 2024-04-12T19:35:13.722 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-9 - AppStream 9.2 MB/s | 8.1 MB 00:00 2024-04-12T19:35:13.892 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS-9 - AppStream 8.6 MB/s | 8.1 MB 00:00 2024-04-12T19:35:15.828 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS-9 - BaseOS 4.2 MB/s | 2.5 MB 00:00 2024-04-12T19:35:15.925 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS-9 - BaseOS 4.7 MB/s | 2.5 MB 00:00 2024-04-12T19:35:17.650 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 6.5 MB/s | 8.0 MB 00:01 2024-04-12T19:35:27.581 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - BaseOS 733 kB/s | 8.0 MB 00:11 2024-04-12T19:35:29.581 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - AppStream 25 MB/s | 19 MB 00:00 2024-04-12T19:35:30.196 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 1.7 MB/s | 19 MB 00:11 2024-04-12T19:35:33.981 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-04-12T19:35:35.707 INFO:teuthology.orchestra.run.smithi171.stdout:CentOS Stream 9 - Extras packages 50 kB/s | 16 kB 00:00 2024-04-12T19:35:36.246 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 3.4 MB/s | 6.2 MB 00:01 2024-04-12T19:35:37.930 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-04-12T19:35:38.273 INFO:teuthology.orchestra.run.smithi171.stdout:Extra Packages for Enterprise Linux 8.9 MB/s | 21 MB 00:02 2024-04-12T19:35:39.707 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-04-12T19:35:44.242 INFO:teuthology.orchestra.run.smithi171.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-04-12T19:35:45.807 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 8.9 kB/s | 1.7 kB 00:00 2024-04-12T19:35:46.893 INFO:teuthology.orchestra.run.smithi171.stderr:Modular dependency problems: 2024-04-12T19:35:46.893 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 1: conflicting requests 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 2: conflicting requests 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 3: conflicting requests 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 4: conflicting requests 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 5: conflicting requests 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 6: conflicting requests 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.894 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 7: conflicting requests 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 8: conflicting requests 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 9: conflicting requests 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 10: conflicting requests 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 11: conflicting requests 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 12: conflicting requests 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 13: conflicting requests 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.895 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 14: conflicting requests 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 15: conflicting requests 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 16: conflicting requests 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 17: conflicting requests 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 18: conflicting requests 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 19: conflicting requests 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 20: conflicting requests 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.896 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 21: conflicting requests 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 22: conflicting requests 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 23: conflicting requests 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 24: conflicting requests 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 25: conflicting requests 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 26: conflicting requests 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 27: conflicting requests 2024-04-12T19:35:46.897 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 28: conflicting requests 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 29: conflicting requests 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 30: conflicting requests 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 31: conflicting requests 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 32: conflicting requests 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 33: conflicting requests 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 34: conflicting requests 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.898 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 35: conflicting requests 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 36: conflicting requests 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 37: conflicting requests 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 39: conflicting requests 2024-04-12T19:35:46.899 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.900 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.901 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.902 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.902 INFO:teuthology.orchestra.run.smithi171.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T19:35:46.902 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.902 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.902 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T19:35:46.902 INFO:teuthology.orchestra.run.smithi171.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T19:35:47.517 INFO:teuthology.orchestra.run.smithi171.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-12T19:35:47.518 INFO:teuthology.orchestra.run.smithi171.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-12T19:35:47.540 INFO:teuthology.orchestra.run.smithi171.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-12T19:35:47.541 INFO:teuthology.orchestra.run.smithi171.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-12T19:35:47.543 INFO:teuthology.orchestra.run.smithi171.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-12T19:35:47.544 INFO:teuthology.orchestra.run.smithi171.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-12T19:35:47.547 INFO:teuthology.orchestra.run.smithi171.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-12T19:35:47.550 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-12T19:35:47.552 INFO:teuthology.orchestra.run.smithi171.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-12T19:35:47.654 INFO:teuthology.orchestra.run.smithi171.stdout:Dependencies resolved. 2024-04-12T19:35:47.674 INFO:teuthology.orchestra.run.smithi171.stdout:========================================================================================= 2024-04-12T19:35:47.674 INFO:teuthology.orchestra.run.smithi171.stdout: Package Arch Version Repository Size 2024-04-12T19:35:47.674 INFO:teuthology.orchestra.run.smithi171.stdout:========================================================================================= 2024-04-12T19:35:47.674 INFO:teuthology.orchestra.run.smithi171.stdout:Installing: 2024-04-12T19:35:47.674 INFO:teuthology.orchestra.run.smithi171.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-12T19:35:47.674 INFO:teuthology.orchestra.run.smithi171.stdout: ceph x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 6.6 k 2024-04-12T19:35:47.674 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 5.4 M 2024-04-12T19:35:47.674 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 889 k 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 145 k 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 1.5 M 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 142 k 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 3.5 M 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 7.4 M 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 49 k 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 10 M 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 49 M 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 264 k 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 762 k 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 224 k 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 27 k 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 18 k 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-12T19:35:47.675 INFO:teuthology.orchestra.run.smithi171.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 32 k 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 746 k 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 127 k 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 161 k 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 320 k 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 297 k 2024-04-12T19:35:47.676 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 99 k 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 85 k 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 3.1 M 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 171 k 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrading: 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-12T19:35:47.677 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: librados2 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 3.4 M 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 3.1 M 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-12T19:35:47.678 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-12T19:35:47.679 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-12T19:35:47.679 INFO:teuthology.orchestra.run.smithi171.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-12T19:35:47.679 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-12T19:35:47.679 INFO:teuthology.orchestra.run.smithi171.stdout:Installing dependencies: 2024-04-12T19:35:47.679 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-12T19:35:47.679 INFO:teuthology.orchestra.run.smithi171.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-12T19:35:47.679 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-12T19:35:47.679 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 21 M 2024-04-12T19:35:47.679 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 34 k 2024-04-12T19:35:47.679 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 2.4 M 2024-04-12T19:35:47.679 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 249 k 2024-04-12T19:35:47.679 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 4.7 M 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 17 M 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 16 k 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 25 k 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-12T19:35:47.680 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 164 k 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 500 k 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 5.2 M 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-12T19:35:47.681 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-12T19:35:47.682 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 45 k 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 135 k 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-12T19:35:47.683 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-12T19:35:47.684 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-12T19:35:47.685 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-12T19:35:47.686 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout:Installing weak dependencies: 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction Summary 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout:========================================================================================= 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout:Install 150 Packages 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout:Upgrade 24 Packages 2024-04-12T19:35:47.687 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:35:47.688 INFO:teuthology.orchestra.run.smithi171.stdout:Total download size: 229 M 2024-04-12T19:35:47.688 INFO:teuthology.orchestra.run.smithi171.stdout:Downloading Packages: 2024-04-12T19:35:48.475 INFO:teuthology.orchestra.run.smithi131.stderr:Modular dependency problems: 2024-04-12T19:35:48.475 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 1: conflicting requests 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module container-tools:rhel8:820240321091303:20125149.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 2: conflicting requests 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module eclipse:rhel8:820201023100746:b230ed4e.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 3: conflicting requests 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module freeradius:3.0:8080020230117180605:89170a74.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 4: conflicting requests 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module gimp:2.8:8000020190628145146:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 5: conflicting requests 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module go-toolset:rhel8:820240401160413:b754926a.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 6: conflicting requests 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module httpd:2.4:820240216084734:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.476 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 7: conflicting requests 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module idm:client:820240307184541:49cc9d1b.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 8: conflicting requests 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module inkscape:0.92.3:8080020221205124429:3e031279.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 9: conflicting requests 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module jmc:rhel8:8050020211110222101:6392b1f8.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 10: conflicting requests 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module llvm-toolset:rhel8:820240205133135:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 11: conflicting requests 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module log4j:2:8080020221205124743:9d367344.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 12: conflicting requests 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module mailman:2.1:820230727085757:77fc8825.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 13: conflicting requests 2024-04-12T19:35:48.477 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module mariadb:10.3:8030020210419150013:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 14: conflicting requests 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module maven:3.5:8060020211203142015:c0229ad2.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 15: conflicting requests 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module mercurial:4.8:8000020190628020724:4148dfdf.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 16: conflicting requests 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module mod_auth_openidc:2.3:820230721123832:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 17: conflicting requests 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module mysql:8.0:8040020210901180257:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 18: conflicting requests 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module nginx:1.14:8000020211221191913:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 19: conflicting requests 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module nodejs:10:8040020210120182536:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.478 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 20: conflicting requests 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl:5.26:8000020190628020724:55190bc5.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 21: conflicting requests 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module php:7.2:8020020200507003613:2c7ca891.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 22: conflicting requests 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module postgresql:10:820230223114800:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 23: conflicting requests 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module python27:2.7:820240208011952:182f7c73.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 24: conflicting requests 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module python36:3.6:8050020210825152031:982725ab.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 25: conflicting requests 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module python38:3.8:820230810143931:64c1cd5a.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 26: conflicting requests 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module python39:3.9:820240214182535:17377f89.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.479 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 27: conflicting requests 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module redis:5:8040020211019153849:9f9e2e7e.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 28: conflicting requests 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module rhn-tools:1.0:8010020191114034948:f69d1239.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 29: conflicting requests 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module ruby:2.5:820230627084142:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 30: conflicting requests 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module rust-toolset:rhel8:820240119204620:b09eea91.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 31: conflicting requests 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module satellite-5-client:1.0:8010020191114035551:cdc1202b.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 32: conflicting requests 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module squid:4:820240319173245:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 33: conflicting requests 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module subversion:1.10:8070020220711155714:78111232.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.480 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 34: conflicting requests 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module swig:3.0:8030020200706142531:30b713e6.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 35: conflicting requests 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module varnish:6:8050020211109225449:b4937e53.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 36: conflicting requests 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module virt:rhel:820240314161907:9edba152.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 37: conflicting requests 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:7cc0a66d.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:8030020200716155257:b967a9a2.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-libwww-perl:6.34:820230811133638:36f9fae6.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 38: cannot install the best candidate for the job 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:a5949e2e.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:8010020191114031501:be2e4737.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.481 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:2ab761e1.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-YAML:1.24:820230223114759:86e45846.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 39: conflicting requests 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:8030020200715230104:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:082fdf2f.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-IO-Socket-SSL:2.066:820230223114759:fbe42456.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 40: cannot install the best candidate for the job 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:16b3ab4d.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:8010020191114031513:e1f37755.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.482 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-FCGI:0.78:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 41: cannot install the best candidate for the job 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:1e4bbb35.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:8030020200716150652:ea09926d.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:0ccef39c.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBI:1.641:820230223114759:dbc5bc9a.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 42: cannot install the best candidate for the job 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:8030020200716174729:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-SQLite:1.58:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 43: cannot install the best candidate for the job 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:56fce90f.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:8030020200716213634:98a3c9d0.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.483 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:06b7596e.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.484 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-Pg:3.7:820230223114759:d2fc5d76.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.484 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 44: cannot install the best candidate for the job 2024-04-12T19:35:48.484 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:3a70019f.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.484 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:8030020200716171139:cccafca5.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.484 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:6fdf7e5d.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.484 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-DBD-MySQL:4.046:820230223114759:d4326aba.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.484 INFO:teuthology.orchestra.run.smithi131.stderr: Problem 45: cannot install the best candidate for the job 2024-04-12T19:35:48.484 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8010020191120175858:95fce66d.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.484 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:8030020200723233049:09acf126.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.484 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:436af1ae.x86_64 from CentOS-AppStream 2024-04-12T19:35:48.484 INFO:teuthology.orchestra.run.smithi131.stderr: - nothing provides module(platform:el8) needed by module perl-App-cpanminus:1.7044:820230223114759:b12195ea.x86_64 from CentOS-AppStream 2024-04-12T19:35:49.026 INFO:teuthology.orchestra.run.smithi171.stdout:(1/174): ceph-19.0.0-2879.g324baf8d.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-04-12T19:35:49.082 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-12T19:35:49.084 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-04-12T19:35:49.106 INFO:teuthology.orchestra.run.smithi131.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-04-12T19:35:49.107 INFO:teuthology.orchestra.run.smithi131.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-04-12T19:35:49.108 INFO:teuthology.orchestra.run.smithi131.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-04-12T19:35:49.110 INFO:teuthology.orchestra.run.smithi131.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-04-12T19:35:49.112 INFO:teuthology.orchestra.run.smithi131.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-04-12T19:35:49.116 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-04-12T19:35:49.117 INFO:teuthology.orchestra.run.smithi131.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-04-12T19:35:49.215 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-04-12T19:35:49.236 INFO:teuthology.orchestra.run.smithi131.stdout:========================================================================================= 2024-04-12T19:35:49.236 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-04-12T19:35:49.236 INFO:teuthology.orchestra.run.smithi131.stdout:========================================================================================= 2024-04-12T19:35:49.236 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-04-12T19:35:49.236 INFO:teuthology.orchestra.run.smithi131.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-04-12T19:35:49.236 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 6.6 k 2024-04-12T19:35:49.236 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 5.4 M 2024-04-12T19:35:49.236 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 889 k 2024-04-12T19:35:49.236 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 145 k 2024-04-12T19:35:49.236 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 1.5 M 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 142 k 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 3.5 M 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 7.4 M 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 49 k 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 10 M 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 49 M 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 264 k 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 762 k 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 224 k 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-shell x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 27 k 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 18 k 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-04-12T19:35:49.237 INFO:teuthology.orchestra.run.smithi131.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel x86_64 0.3.112-1.el8 CentOS-BaseOS 18 k 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 32 k 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 746 k 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 127 k 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 161 k 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 320 k 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 297 k 2024-04-12T19:35:49.238 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 99 k 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 85 k 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 3.1 M 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 171 k 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager x86_64 1:1.47.4-1.el9 baseos 2.3 M 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-libnm x86_64 1:1.47.4-1.el9 baseos 1.8 M 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-team x86_64 1:1.47.4-1.el9 baseos 42 k 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-tui x86_64 1:1.47.4-1.el9 baseos 249 k 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-04-12T19:35:49.239 INFO:teuthology.orchestra.run.smithi131.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 3.4 M 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 3.1 M 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: xfsdump x86_64 3.1.12-4.el9 baseos 323 k 2024-04-12T19:35:49.240 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 21 M 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 34 k 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 2.4 M 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 249 k 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 4.7 M 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 17 M 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2879.g324baf8d.el9 ceph-noarch 16 k 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 25 k 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-04-12T19:35:49.241 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 164 k 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-04-12T19:35:49.242 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 500 k 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 5.2 M 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma x86_64 6.9.6-1.el9.5 baseos 218 k 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-04-12T19:35:49.243 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 45 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:19.0.0-2879.g324baf8d.el9 ceph 135 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-04-12T19:35:49.244 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:2.28.2-1.el9 epel 203 k 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-04-12T19:35:49.245 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-04-12T19:35:49.246 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-04-12T19:35:49.247 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel x86_64 1.2.11-40.el9 appstream 45 k 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout:Installing weak dependencies: 2024-04-12T19:35:49.248 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-04-12T19:35:49.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:35:49.249 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-04-12T19:35:49.249 INFO:teuthology.orchestra.run.smithi131.stdout:========================================================================================= 2024-04-12T19:35:49.249 INFO:teuthology.orchestra.run.smithi131.stdout:Install 150 Packages 2024-04-12T19:35:49.249 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 24 Packages 2024-04-12T19:35:49.249 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:35:49.249 INFO:teuthology.orchestra.run.smithi171.stdout:(2/174): ceph-fuse-19.0.0-2879.g324baf8d.el9.x8 4.1 MB/s | 889 kB 00:00 2024-04-12T19:35:49.250 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 229 M 2024-04-12T19:35:49.250 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-04-12T19:35:49.293 INFO:teuthology.orchestra.run.smithi171.stdout:(3/174): ceph-immutable-object-cache-19.0.0-287 2.9 MB/s | 145 kB 00:00 2024-04-12T19:35:49.477 INFO:teuthology.orchestra.run.smithi171.stdout:(4/174): ceph-mds-19.0.0-2879.g324baf8d.el9.x86 13 MB/s | 2.4 MB 00:00 2024-04-12T19:35:49.594 INFO:teuthology.orchestra.run.smithi171.stdout:(5/174): ceph-mgr-19.0.0-2879.g324baf8d.el9.x86 13 MB/s | 1.5 MB 00:00 2024-04-12T19:35:49.936 INFO:teuthology.orchestra.run.smithi171.stdout:(6/174): ceph-mon-19.0.0-2879.g324baf8d.el9.x86 14 MB/s | 4.7 MB 00:00 2024-04-12T19:35:50.495 INFO:teuthology.orchestra.run.smithi171.stdout:(7/174): ceph-base-19.0.0-2879.g324baf8d.el9.x8 3.1 MB/s | 5.4 MB 00:01 2024-04-12T19:35:50.867 INFO:teuthology.orchestra.run.smithi131.stdout:(1/174): ceph-19.0.0-2879.g324baf8d.el9.x86_64. 11 kB/s | 6.6 kB 00:00 2024-04-12T19:35:51.062 INFO:teuthology.orchestra.run.smithi171.stdout:(8/174): ceph-osd-19.0.0-2879.g324baf8d.el9.x86 15 MB/s | 17 MB 00:01 2024-04-12T19:35:51.120 INFO:teuthology.orchestra.run.smithi171.stdout:(9/174): ceph-selinux-19.0.0-2879.g324baf8d.el9 441 kB/s | 25 kB 00:00 2024-04-12T19:35:51.850 INFO:teuthology.orchestra.run.smithi131.stdout:(2/174): ceph-fuse-19.0.0-2879.g324baf8d.el9.x8 905 kB/s | 889 kB 00:00 2024-04-12T19:35:52.000 INFO:teuthology.orchestra.run.smithi131.stdout:(3/174): ceph-immutable-object-cache-19.0.0-287 972 kB/s | 145 kB 00:00 2024-04-12T19:35:52.368 INFO:teuthology.orchestra.run.smithi171.stdout:(10/174): ceph-radosgw-19.0.0-2879.g324baf8d.el 5.3 MB/s | 10 MB 00:01 2024-04-12T19:35:52.504 INFO:teuthology.orchestra.run.smithi171.stdout:(11/174): cephfs-mirror-19.0.0-2879.g324baf8d.e 1.6 MB/s | 224 kB 00:00 2024-04-12T19:35:52.629 INFO:teuthology.orchestra.run.smithi171.stdout:(12/174): cephfs-shell-19.0.0-2879.g324baf8d.el 218 kB/s | 27 kB 00:00 2024-04-12T19:35:52.762 INFO:teuthology.orchestra.run.smithi171.stdout:(13/174): libcephfs-devel-19.0.0-2879.g324baf8d 239 kB/s | 32 kB 00:00 2024-04-12T19:35:53.013 INFO:teuthology.orchestra.run.smithi171.stdout:(14/174): libcephfs2-19.0.0-2879.g324baf8d.el9. 2.9 MB/s | 746 kB 00:00 2024-04-12T19:35:53.155 INFO:teuthology.orchestra.run.smithi171.stdout:(15/174): libcephsqlite-19.0.0-2879.g324baf8d.e 1.1 MB/s | 164 kB 00:00 2024-04-12T19:35:53.201 INFO:teuthology.orchestra.run.smithi131.stdout:(4/174): ceph-mds-19.0.0-2879.g324baf8d.el9.x86 2.0 MB/s | 2.4 MB 00:01 2024-04-12T19:35:53.263 INFO:teuthology.orchestra.run.smithi171.stdout:(16/174): librados-devel-19.0.0-2879.g324baf8d. 1.2 MB/s | 127 kB 00:00 2024-04-12T19:35:53.414 INFO:teuthology.orchestra.run.smithi171.stdout:(17/174): libradosstriper1-19.0.0-2879.g324baf8 3.3 MB/s | 500 kB 00:00 2024-04-12T19:35:53.609 INFO:teuthology.orchestra.run.smithi131.stdout:(5/174): ceph-base-19.0.0-2879.g324baf8d.el9.x8 1.6 MB/s | 5.4 MB 00:03 2024-04-12T19:35:53.993 INFO:teuthology.orchestra.run.smithi131.stdout:(6/174): ceph-mgr-19.0.0-2879.g324baf8d.el9.x86 1.9 MB/s | 1.5 MB 00:00 2024-04-12T19:35:54.456 INFO:teuthology.orchestra.run.smithi171.stdout:(18/174): librgw2-19.0.0-2879.g324baf8d.el9.x86 5.0 MB/s | 5.2 MB 00:01 2024-04-12T19:35:54.573 INFO:teuthology.orchestra.run.smithi171.stdout:(19/174): python3-ceph-argparse-19.0.0-2879.g32 391 kB/s | 45 kB 00:00 2024-04-12T19:35:55.126 INFO:teuthology.orchestra.run.smithi131.stdout:(7/174): ceph-mon-19.0.0-2879.g324baf8d.el9.x86 3.1 MB/s | 4.7 MB 00:01 2024-04-12T19:35:55.156 INFO:teuthology.orchestra.run.smithi171.stdout:(20/174): ceph-test-19.0.0-2879.g324baf8d.el9.x 12 MB/s | 49 MB 00:04 2024-04-12T19:35:55.190 INFO:teuthology.orchestra.run.smithi171.stdout:(21/174): python3-ceph-common-19.0.0-2879.g324b 219 kB/s | 135 kB 00:00 2024-04-12T19:35:55.240 INFO:teuthology.orchestra.run.smithi171.stdout:(22/174): python3-cephfs-19.0.0-2879.g324baf8d. 1.9 MB/s | 161 kB 00:00 2024-04-12T19:35:55.307 INFO:teuthology.orchestra.run.smithi171.stdout:(23/174): python3-rbd-19.0.0-2879.g324baf8d.el9 4.4 MB/s | 297 kB 00:00 2024-04-12T19:35:55.358 INFO:teuthology.orchestra.run.smithi171.stdout:(24/174): python3-rgw-19.0.0-2879.g324baf8d.el9 2.0 MB/s | 99 kB 00:00 2024-04-12T19:35:55.378 INFO:teuthology.orchestra.run.smithi131.stdout:(8/174): ceph-common-19.0.0-2879.g324baf8d.el9. 4.1 MB/s | 21 MB 00:05 2024-04-12T19:35:55.391 INFO:teuthology.orchestra.run.smithi171.stdout:(25/174): python3-rados-19.0.0-2879.g324baf8d.e 1.6 MB/s | 320 kB 00:00 2024-04-12T19:35:55.408 INFO:teuthology.orchestra.run.smithi171.stdout:(26/174): rbd-fuse-19.0.0-2879.g324baf8d.el9.x8 1.7 MB/s | 85 kB 00:00 2024-04-12T19:35:55.459 INFO:teuthology.orchestra.run.smithi171.stdout:(27/174): rbd-nbd-19.0.0-2879.g324baf8d.el9.x86 3.4 MB/s | 171 kB 00:00 2024-04-12T19:35:55.460 INFO:teuthology.orchestra.run.smithi131.stdout:(9/174): ceph-selinux-19.0.0-2879.g324baf8d.el9 307 kB/s | 25 kB 00:00 2024-04-12T19:35:55.759 INFO:teuthology.orchestra.run.smithi171.stdout:(28/174): ceph-common-19.0.0-2879.g324baf8d.el9 3.0 MB/s | 21 MB 00:06 2024-04-12T19:35:55.809 INFO:teuthology.orchestra.run.smithi171.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2879.g 98 kB/s | 34 kB 00:00 2024-04-12T19:35:55.935 INFO:teuthology.orchestra.run.smithi171.stdout:(30/174): ceph-mgr-cephadm-19.0.0-2879.g324baf8 817 kB/s | 142 kB 00:00 2024-04-12T19:35:56.060 INFO:teuthology.orchestra.run.smithi171.stdout:(31/174): rbd-mirror-19.0.0-2879.g324baf8d.el9. 4.6 MB/s | 3.1 MB 00:00 2024-04-12T19:35:56.177 INFO:teuthology.orchestra.run.smithi171.stdout:(32/174): ceph-mgr-dashboard-19.0.0-2879.g324ba 9.7 MB/s | 3.5 MB 00:00 2024-04-12T19:35:56.210 INFO:teuthology.orchestra.run.smithi171.stdout:(33/174): ceph-mgr-modules-core-19.0.0-2879.g32 1.6 MB/s | 249 kB 00:00 2024-04-12T19:35:56.235 INFO:teuthology.orchestra.run.smithi171.stdout:(34/174): ceph-mgr-rook-19.0.0-2879.g324baf8d.e 858 kB/s | 49 kB 00:00 2024-04-12T19:35:56.286 INFO:teuthology.orchestra.run.smithi171.stdout:(35/174): ceph-volume-19.0.0-2879.g324baf8d.el9 5.2 MB/s | 264 kB 00:00 2024-04-12T19:35:56.311 INFO:teuthology.orchestra.run.smithi171.stdout:(36/174): ceph-prometheus-alerts-19.0.0-2879.g3 165 kB/s | 16 kB 00:00 2024-04-12T19:35:56.394 INFO:teuthology.orchestra.run.smithi171.stdout:(37/174): cephadm-19.0.0-2879.g324baf8d.el9.noa 6.9 MB/s | 762 kB 00:00 2024-04-12T19:35:56.420 INFO:teuthology.orchestra.run.smithi171.stdout:(38/174): cephfs-top-19.0.0-2879.g324baf8d.el9. 169 kB/s | 18 kB 00:00 2024-04-12T19:35:56.645 INFO:teuthology.orchestra.run.smithi171.stdout:(39/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 71 kB/s | 18 kB 00:00 2024-04-12T19:35:56.754 INFO:teuthology.orchestra.run.smithi171.stdout:(40/174): fuse-2.9.9-15.el9.x86_64.rpm 242 kB/s | 80 kB 00:00 2024-04-12T19:35:56.971 INFO:teuthology.orchestra.run.smithi171.stdout:(41/174): jq-1.6-16.el9.x86_64.rpm 577 kB/s | 187 kB 00:00 2024-04-12T19:35:57.013 INFO:teuthology.orchestra.run.smithi171.stdout:(42/174): libgfortran-11.4.1-3.el9.x86_64.rpm 3.0 MB/s | 803 kB 00:00 2024-04-12T19:35:57.018 INFO:teuthology.orchestra.run.smithi131.stdout:(10/174): ceph-radosgw-19.0.0-2879.g324baf8d.el 5.3 MB/s | 10 MB 00:01 2024-04-12T19:35:57.054 INFO:teuthology.orchestra.run.smithi171.stdout:(43/174): libquadmath-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2024-04-12T19:35:57.094 INFO:teuthology.orchestra.run.smithi131.stdout:(11/174): cephfs-mirror-19.0.0-2879.g324baf8d.e 3.0 MB/s | 224 kB 00:00 2024-04-12T19:35:57.096 INFO:teuthology.orchestra.run.smithi171.stdout:(44/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 218 kB 00:00 2024-04-12T19:35:57.138 INFO:teuthology.orchestra.run.smithi171.stdout:(45/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-04-12T19:35:57.177 INFO:teuthology.orchestra.run.smithi131.stdout:(12/174): cephfs-shell-19.0.0-2879.g324baf8d.el 328 kB/s | 27 kB 00:00 2024-04-12T19:35:57.230 INFO:teuthology.orchestra.run.smithi171.stdout:(46/174): python3-ply-3.11-14.el9.noarch.rpm 1.1 MB/s | 106 kB 00:00 2024-04-12T19:35:57.236 INFO:teuthology.orchestra.run.smithi131.stdout:(13/174): libcephfs-devel-19.0.0-2879.g324baf8d 552 kB/s | 32 kB 00:00 2024-04-12T19:35:57.289 INFO:teuthology.orchestra.run.smithi171.stdout:(47/174): python3-cryptography-36.0.1-4.el9.x86 6.4 MB/s | 1.2 MB 00:00 2024-04-12T19:35:57.314 INFO:teuthology.orchestra.run.smithi171.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-04-12T19:35:57.373 INFO:teuthology.orchestra.run.smithi171.stdout:(49/174): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-04-12T19:35:57.386 INFO:teuthology.orchestra.run.smithi131.stdout:(14/174): libcephfs2-19.0.0-2879.g324baf8d.el9. 4.9 MB/s | 746 kB 00:00 2024-04-12T19:35:57.406 INFO:teuthology.orchestra.run.smithi171.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.3 MB/s | 215 kB 00:00 2024-04-12T19:35:57.445 INFO:teuthology.orchestra.run.smithi131.stdout:(15/174): libcephsqlite-19.0.0-2879.g324baf8d.e 2.8 MB/s | 164 kB 00:00 2024-04-12T19:35:57.495 INFO:teuthology.orchestra.run.smithi131.stdout:(16/174): librados-devel-19.0.0-2879.g324baf8d. 2.5 MB/s | 127 kB 00:00 2024-04-12T19:35:57.595 INFO:teuthology.orchestra.run.smithi131.stdout:(17/174): libradosstriper1-19.0.0-2879.g324baf8 4.9 MB/s | 500 kB 00:00 2024-04-12T19:35:58.287 INFO:teuthology.orchestra.run.smithi131.stdout:(18/174): librgw2-19.0.0-2879.g324baf8d.el9.x86 7.6 MB/s | 5.2 MB 00:00 2024-04-12T19:35:58.337 INFO:teuthology.orchestra.run.smithi131.stdout:(19/174): python3-ceph-argparse-19.0.0-2879.g32 924 kB/s | 45 kB 00:00 2024-04-12T19:35:58.388 INFO:teuthology.orchestra.run.smithi131.stdout:(20/174): python3-ceph-common-19.0.0-2879.g324b 2.7 MB/s | 135 kB 00:00 2024-04-12T19:35:58.390 INFO:teuthology.orchestra.run.smithi171.stdout:(51/174): ceph-mgr-diskprediction-local-19.0.0- 3.0 MB/s | 7.4 MB 00:02 2024-04-12T19:35:58.463 INFO:teuthology.orchestra.run.smithi131.stdout:(21/174): python3-cephfs-19.0.0-2879.g324baf8d. 2.1 MB/s | 161 kB 00:00 2024-04-12T19:35:58.547 INFO:teuthology.orchestra.run.smithi131.stdout:(22/174): python3-rados-19.0.0-2879.g324baf8d.e 3.8 MB/s | 320 kB 00:00 2024-04-12T19:35:58.772 INFO:teuthology.orchestra.run.smithi131.stdout:(23/174): ceph-osd-19.0.0-2879.g324baf8d.el9.x8 3.5 MB/s | 17 MB 00:04 2024-04-12T19:35:58.805 INFO:teuthology.orchestra.run.smithi131.stdout:(24/174): python3-rbd-19.0.0-2879.g324baf8d.el9 1.1 MB/s | 297 kB 00:00 2024-04-12T19:35:58.856 INFO:teuthology.orchestra.run.smithi131.stdout:(25/174): rbd-fuse-19.0.0-2879.g324baf8d.el9.x8 1.7 MB/s | 85 kB 00:00 2024-04-12T19:35:58.889 INFO:teuthology.orchestra.run.smithi131.stdout:(26/174): python3-rgw-19.0.0-2879.g324baf8d.el9 854 kB/s | 99 kB 00:00 2024-04-12T19:35:59.006 INFO:teuthology.orchestra.run.smithi131.stdout:(27/174): rbd-nbd-19.0.0-2879.g324baf8d.el9.x86 1.4 MB/s | 171 kB 00:00 2024-04-12T19:35:59.107 INFO:teuthology.orchestra.run.smithi131.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2879.g 345 kB/s | 34 kB 00:00 2024-04-12T19:35:59.215 INFO:teuthology.orchestra.run.smithi131.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2879.g324baf8 1.3 MB/s | 142 kB 00:00 2024-04-12T19:35:59.333 INFO:teuthology.orchestra.run.smithi131.stdout:(30/174): rbd-mirror-19.0.0-2879.g324baf8d.el9. 6.5 MB/s | 3.1 MB 00:00 2024-04-12T19:35:59.449 INFO:teuthology.orchestra.run.smithi171.stdout:(52/174): automake-1.16.2-8.el9.noarch.rpm 332 kB/s | 689 kB 00:02 2024-04-12T19:35:59.482 INFO:teuthology.orchestra.run.smithi171.stdout:(53/174): boost-program-options-1.75.0-8.el9.x8 98 kB/s | 107 kB 00:01 2024-04-12T19:35:59.891 INFO:teuthology.orchestra.run.smithi171.stdout:(54/174): bison-3.7.4-5.el9.x86_64.rpm 380 kB/s | 943 kB 00:02 2024-04-12T19:36:00.041 INFO:teuthology.orchestra.run.smithi131.stdout:(31/174): ceph-mgr-dashboard-19.0.0-2879.g324ba 4.3 MB/s | 3.5 MB 00:00 2024-04-12T19:36:00.233 INFO:teuthology.orchestra.run.smithi131.stdout:(32/174): ceph-mgr-diskprediction-local-19.0.0- 8.2 MB/s | 7.4 MB 00:00 2024-04-12T19:36:00.267 INFO:teuthology.orchestra.run.smithi131.stdout:(33/174): ceph-mgr-modules-core-19.0.0-2879.g32 1.1 MB/s | 249 kB 00:00 2024-04-12T19:36:00.274 INFO:teuthology.orchestra.run.smithi171.stdout:(55/174): elfutils-libelf-devel-0.190-2.el9.x86 26 kB/s | 21 kB 00:00 2024-04-12T19:36:00.285 INFO:teuthology.orchestra.run.smithi131.stdout:(34/174): ceph-mgr-rook-19.0.0-2879.g324baf8d.e 1.0 MB/s | 49 kB 00:00 2024-04-12T19:36:00.384 INFO:teuthology.orchestra.run.smithi131.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2879.g3 142 kB/s | 16 kB 00:00 2024-04-12T19:36:00.418 INFO:teuthology.orchestra.run.smithi131.stdout:(36/174): ceph-volume-19.0.0-2879.g324baf8d.el9 1.9 MB/s | 264 kB 00:00 2024-04-12T19:36:00.459 INFO:teuthology.orchestra.run.smithi131.stdout:(37/174): cephfs-top-19.0.0-2879.g324baf8d.el9. 446 kB/s | 18 kB 00:00 2024-04-12T19:36:00.660 INFO:teuthology.orchestra.run.smithi131.stdout:(38/174): cephadm-19.0.0-2879.g324baf8d.el9.noa 2.7 MB/s | 762 kB 00:00 2024-04-12T19:36:00.677 INFO:teuthology.orchestra.run.smithi131.stdout:(39/174): libaio-devel-0.3.112-1.el8.x86_64.rpm 81 kB/s | 18 kB 00:00 2024-04-12T19:36:00.699 INFO:teuthology.orchestra.run.smithi171.stdout:(56/174): flexiblas-3.0.4-8.el9.x86_64.rpm 40 kB/s | 33 kB 00:00 2024-04-12T19:36:00.785 INFO:teuthology.orchestra.run.smithi131.stdout:(40/174): fuse-2.9.9-15.el9.x86_64.rpm 646 kB/s | 80 kB 00:00 2024-04-12T19:36:00.819 INFO:teuthology.orchestra.run.smithi131.stdout:(41/174): jq-1.6-16.el9.x86_64.rpm 1.3 MB/s | 187 kB 00:00 2024-04-12T19:36:00.877 INFO:teuthology.orchestra.run.smithi131.stdout:(42/174): libquadmath-11.4.1-3.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-04-12T19:36:00.900 INFO:teuthology.orchestra.run.smithi171.stdout:(57/174): flex-2.6.4-9.el9.x86_64.rpm 221 kB/s | 313 kB 00:01 2024-04-12T19:36:00.919 INFO:teuthology.orchestra.run.smithi131.stdout:(43/174): libgfortran-11.4.1-3.el9.x86_64.rpm 5.9 MB/s | 803 kB 00:00 2024-04-12T19:36:00.953 INFO:teuthology.orchestra.run.smithi131.stdout:(44/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.9 MB/s | 218 kB 00:00 2024-04-12T19:36:01.014 INFO:teuthology.orchestra.run.smithi131.stdout:(45/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.6 MB/s | 253 kB 00:00 2024-04-12T19:36:01.062 INFO:teuthology.orchestra.run.smithi131.stdout:(46/174): python3-ply-3.11-14.el9.noarch.rpm 2.3 MB/s | 106 kB 00:00 2024-04-12T19:36:01.120 INFO:teuthology.orchestra.run.smithi131.stdout:(47/174): python3-cryptography-36.0.1-4.el9.x86 7.4 MB/s | 1.2 MB 00:00 2024-04-12T19:36:01.154 INFO:teuthology.orchestra.run.smithi131.stdout:(48/174): python3-pycparser-2.20-6.el9.noarch.r 1.5 MB/s | 135 kB 00:00 2024-04-12T19:36:01.188 INFO:teuthology.orchestra.run.smithi131.stdout:(49/174): python3-requests-2.25.1-8.el9.noarch. 1.9 MB/s | 125 kB 00:00 2024-04-12T19:36:01.221 INFO:teuthology.orchestra.run.smithi131.stdout:(50/174): python3-urllib3-1.26.5-5.el9.noarch.r 3.1 MB/s | 215 kB 00:00 2024-04-12T19:36:01.475 INFO:teuthology.orchestra.run.smithi171.stdout:(58/174): flexiblas-openblas-openmp-3.0.4-8.el9 23 kB/s | 18 kB 00:00 2024-04-12T19:36:01.847 INFO:teuthology.orchestra.run.smithi131.stdout:(51/174): ceph-test-19.0.0-2879.g324baf8d.el9.x 7.6 MB/s | 49 MB 00:06 2024-04-12T19:36:01.925 INFO:teuthology.orchestra.run.smithi171.stdout:(59/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 156 kB/s | 160 kB 00:01 2024-04-12T19:36:01.980 INFO:teuthology.orchestra.run.smithi131.stdout:(52/174): automake-1.16.2-8.el9.noarch.rpm 870 kB/s | 689 kB 00:00 2024-04-12T19:36:02.005 INFO:teuthology.orchestra.run.smithi131.stdout:(53/174): boost-program-options-1.75.0-8.el9.x8 679 kB/s | 107 kB 00:00 2024-04-12T19:36:02.056 INFO:teuthology.orchestra.run.smithi131.stdout:(54/174): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-04-12T19:36:02.081 INFO:teuthology.orchestra.run.smithi131.stdout:(55/174): elfutils-libelf-devel-0.190-2.el9.x86 216 kB/s | 21 kB 00:00 2024-04-12T19:36:02.106 INFO:teuthology.orchestra.run.smithi131.stdout:(56/174): flexiblas-3.0.4-8.el9.x86_64.rpm 659 kB/s | 33 kB 00:00 2024-04-12T19:36:02.140 INFO:teuthology.orchestra.run.smithi131.stdout:(57/174): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-04-12T19:36:02.174 INFO:teuthology.orchestra.run.smithi131.stdout:(58/174): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-04-12T19:36:02.207 INFO:teuthology.orchestra.run.smithi131.stdout:(59/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-04-12T19:36:02.233 INFO:teuthology.orchestra.run.smithi131.stdout:(60/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 784 kB/s | 45 kB 00:00 2024-04-12T19:36:02.292 INFO:teuthology.orchestra.run.smithi171.stdout:(60/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 55 kB/s | 45 kB 00:00 2024-04-12T19:36:02.299 INFO:teuthology.orchestra.run.smithi131.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-04-12T19:36:02.342 INFO:teuthology.orchestra.run.smithi131.stdout:(62/174): libtool-2.4.6-45.el9.x86_64.rpm 5.3 MB/s | 582 kB 00:00 2024-04-12T19:36:02.425 INFO:teuthology.orchestra.run.smithi131.stdout:(63/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.7 MB/s | 3.0 MB 00:00 2024-04-12T19:36:02.467 INFO:teuthology.orchestra.run.smithi131.stdout:(64/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 153 kB/s | 25 kB 00:00 2024-04-12T19:36:02.484 INFO:teuthology.orchestra.run.smithi131.stdout:(65/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 335 kB/s | 47 kB 00:00 2024-04-12T19:36:02.518 INFO:teuthology.orchestra.run.smithi131.stdout:(66/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-04-12T19:36:02.585 INFO:teuthology.orchestra.run.smithi131.stdout:(67/174): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-04-12T19:36:02.602 INFO:teuthology.orchestra.run.smithi131.stdout:(68/174): openblas-0.3.21-2.el9.x86_64.rpm 302 kB/s | 35 kB 00:00 2024-04-12T19:36:02.727 INFO:teuthology.orchestra.run.smithi131.stdout:(69/174): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-04-12T19:36:02.836 INFO:teuthology.orchestra.run.smithi131.stdout:(70/174): openblas-openmp-0.3.21-2.el9.x86_64.r 15 MB/s | 4.7 MB 00:00 2024-04-12T19:36:02.894 INFO:teuthology.orchestra.run.smithi131.stdout:(71/174): postgresql-contrib-13.14-1.el9.x86_64 5.4 MB/s | 911 kB 00:00 2024-04-12T19:36:02.961 INFO:teuthology.orchestra.run.smithi131.stdout:(72/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 11 MB/s | 4.1 MB 00:00 2024-04-12T19:36:02.994 INFO:teuthology.orchestra.run.smithi131.stdout:(73/174): postgresql-private-libs-13.14-1.el9.x 845 kB/s | 133 kB 00:00 2024-04-12T19:36:03.062 INFO:teuthology.orchestra.run.smithi131.stdout:(74/174): protobuf-3.14.0-13.el9.x86_64.rpm 10 MB/s | 1.0 MB 00:00 2024-04-12T19:36:03.120 INFO:teuthology.orchestra.run.smithi131.stdout:(75/174): python3-attrs-20.3.0-7.el9.noarch.rpm 700 kB/s | 87 kB 00:00 2024-04-12T19:36:03.262 INFO:teuthology.orchestra.run.smithi131.stdout:(76/174): postgresql-server-13.14-1.el9.x86_64. 16 MB/s | 5.8 MB 00:00 2024-04-12T19:36:03.296 INFO:teuthology.orchestra.run.smithi131.stdout:(77/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2024-04-12T19:36:03.338 INFO:teuthology.orchestra.run.smithi131.stdout:(78/174): python3-jinja2-2.11.3-5.el9.noarch.rp 3.3 MB/s | 248 kB 00:00 2024-04-12T19:36:03.363 INFO:teuthology.orchestra.run.smithi131.stdout:(79/174): python3-jsonpatch-1.21-16.el9.noarch. 387 kB/s | 26 kB 00:00 2024-04-12T19:36:03.397 INFO:teuthology.orchestra.run.smithi131.stdout:(80/174): python3-jsonpointer-2.0-4.el9.noarch. 332 kB/s | 19 kB 00:00 2024-04-12T19:36:03.430 INFO:teuthology.orchestra.run.smithi131.stdout:(81/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-04-12T19:36:03.455 INFO:teuthology.orchestra.run.smithi131.stdout:(82/174): python3-markupsafe-1.1.1-12.el9.x86_6 602 kB/s | 35 kB 00:00 2024-04-12T19:36:03.522 INFO:teuthology.orchestra.run.smithi131.stdout:(83/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-04-12T19:36:03.639 INFO:teuthology.orchestra.run.smithi131.stdout:(84/174): python3-babel-2.9.1-2.el9.noarch.rpm 10 MB/s | 6.0 MB 00:00 2024-04-12T19:36:03.673 INFO:teuthology.orchestra.run.smithi131.stdout:(85/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.5 MB/s | 222 kB 00:00 2024-04-12T19:36:03.698 INFO:teuthology.orchestra.run.smithi131.stdout:(86/174): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-04-12T19:36:03.724 INFO:teuthology.orchestra.run.smithi131.stdout:(87/174): python3-prettytable-0.7.2-27.el9.noar 849 kB/s | 42 kB 00:00 2024-04-12T19:36:03.782 INFO:teuthology.orchestra.run.smithi131.stdout:(88/174): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-04-12T19:36:03.809 INFO:teuthology.orchestra.run.smithi171.stdout:(61/174): librdkafka-1.6.1-102.el9.x86_64.rpm 352 kB/s | 662 kB 00:01 2024-04-12T19:36:03.816 INFO:teuthology.orchestra.run.smithi131.stdout:(89/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-04-12T19:36:03.858 INFO:teuthology.orchestra.run.smithi131.stdout:(90/174): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 279 kB 00:00 2024-04-12T19:36:03.883 INFO:teuthology.orchestra.run.smithi131.stdout:(91/174): python3-pytz-2021.1-5.el9.noarch.rpm 762 kB/s | 51 kB 00:00 2024-04-12T19:36:03.917 INFO:teuthology.orchestra.run.smithi131.stdout:(92/174): python3-requests-oauthlib-1.3.0-12.el 929 kB/s | 54 kB 00:00 2024-04-12T19:36:04.017 INFO:teuthology.orchestra.run.smithi131.stdout:(93/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.7 MB/s | 5.1 MB 00:00 2024-04-12T19:36:04.017 INFO:teuthology.orchestra.run.smithi171.stdout:(62/174): libtool-2.4.6-45.el9.x86_64.rpm 338 kB/s | 582 kB 00:01 2024-04-12T19:36:04.042 INFO:teuthology.orchestra.run.smithi131.stdout:(94/174): python3-toml-0.10.2-6.el9.noarch.rpm 335 kB/s | 42 kB 00:00 2024-04-12T19:36:04.093 INFO:teuthology.orchestra.run.smithi131.stdout:(95/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 590 kB/s | 44 kB 00:00 2024-04-12T19:36:04.126 INFO:teuthology.orchestra.run.smithi131.stdout:(96/174): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-04-12T19:36:04.152 INFO:teuthology.orchestra.run.smithi131.stdout:(97/174): qatlib-service-24.02.0-1.el9.x86_64.r 622 kB/s | 36 kB 00:00 2024-04-12T19:36:04.179 INFO:teuthology.orchestra.run.smithi131.stdout:(98/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 909 kB/s | 47 kB 00:00 2024-04-12T19:36:04.213 INFO:teuthology.orchestra.run.smithi131.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 4.9 MB/s | 305 kB 00:00 2024-04-12T19:36:04.238 INFO:teuthology.orchestra.run.smithi131.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-04-12T19:36:04.366 INFO:teuthology.orchestra.run.smithi131.stdout:(101/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 627 kB/s | 94 kB 00:00 2024-04-12T19:36:04.406 INFO:teuthology.orchestra.run.smithi131.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 382 kB/s | 64 kB 00:00 2024-04-12T19:36:04.431 INFO:teuthology.orchestra.run.smithi131.stdout:(103/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 679 kB/s | 45 kB 00:00 2024-04-12T19:36:04.531 INFO:teuthology.orchestra.run.smithi131.stdout:(104/174): lua-devel-5.4.4-4.el9.x86_64.rpm 179 kB/s | 22 kB 00:00 2024-04-12T19:36:04.743 INFO:teuthology.orchestra.run.smithi171.stdout:(63/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 27 kB/s | 25 kB 00:00 2024-04-12T19:36:04.824 INFO:teuthology.orchestra.run.smithi131.stdout:(105/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 17 MB/s | 16 MB 00:00 2024-04-12T19:36:04.865 INFO:teuthology.orchestra.run.smithi131.stdout:(106/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.6 MB/s | 548 kB 00:00 2024-04-12T19:36:04.868 INFO:teuthology.orchestra.run.smithi171.stdout:(64/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 56 kB/s | 47 kB 00:00 2024-04-12T19:36:04.907 INFO:teuthology.orchestra.run.smithi131.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 477 kB/s | 19 kB 00:00 2024-04-12T19:36:04.941 INFO:teuthology.orchestra.run.smithi131.stdout:(108/174): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-04-12T19:36:04.983 INFO:teuthology.orchestra.run.smithi131.stdout:(109/174): protobuf-compiler-3.14.0-13.el9.x86_ 1.5 MB/s | 863 kB 00:00 2024-04-12T19:36:05.029 INFO:teuthology.orchestra.run.smithi131.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 300 kB/s | 26 kB 00:00 2024-04-12T19:36:05.075 INFO:teuthology.orchestra.run.smithi131.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.5 MB/s | 67 kB 00:00 2024-04-12T19:36:05.108 INFO:teuthology.orchestra.run.smithi131.stdout:(112/174): liboath-2.6.7-2.el9.x86_64.rpm 390 kB/s | 49 kB 00:00 2024-04-12T19:36:05.133 INFO:teuthology.orchestra.run.smithi131.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 2.6 MB/s | 151 kB 00:00 2024-04-12T19:36:05.251 INFO:teuthology.orchestra.run.smithi131.stdout:(114/174): libarrow-9.0.0-10.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-04-12T19:36:05.284 INFO:teuthology.orchestra.run.smithi131.stdout:(115/174): python3-asyncssh-2.13.2-5.el9.noarch 3.6 MB/s | 548 kB 00:00 2024-04-12T19:36:05.310 INFO:teuthology.orchestra.run.smithi131.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 750 kB/s | 43 kB 00:00 2024-04-12T19:36:05.335 INFO:teuthology.orchestra.run.smithi131.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 651 kB/s | 32 kB 00:00 2024-04-12T19:36:05.360 INFO:teuthology.orchestra.run.smithi131.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 302 kB/s | 15 kB 00:00 2024-04-12T19:36:05.394 INFO:teuthology.orchestra.run.smithi131.stdout:(119/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-04-12T19:36:05.444 INFO:teuthology.orchestra.run.smithi131.stdout:(120/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 2.4 MB/s | 838 kB 00:00 2024-04-12T19:36:05.478 INFO:teuthology.orchestra.run.smithi131.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-04-12T19:36:05.503 INFO:teuthology.orchestra.run.smithi131.stdout:(122/174): python3-colorama-0.4.4-12.el9.noarch 611 kB/s | 35 kB 00:00 2024-04-12T19:36:05.537 INFO:teuthology.orchestra.run.smithi131.stdout:(123/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.1 MB/s | 303 kB 00:00 2024-04-12T19:36:05.571 INFO:teuthology.orchestra.run.smithi131.stdout:(124/174): python3-google-auth-2.28.2-1.el9.noa 2.2 MB/s | 203 kB 00:00 2024-04-12T19:36:05.604 INFO:teuthology.orchestra.run.smithi131.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-04-12T19:36:05.629 INFO:teuthology.orchestra.run.smithi131.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 186 kB/s | 11 kB 00:00 2024-04-12T19:36:05.671 INFO:teuthology.orchestra.run.smithi131.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 268 kB/s | 18 kB 00:00 2024-04-12T19:36:05.688 INFO:teuthology.orchestra.run.smithi131.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 400 kB/s | 23 kB 00:00 2024-04-12T19:36:05.705 INFO:teuthology.orchestra.run.smithi131.stdout:(129/174): python3-jaraco-functools-3.5.0-2.el9 594 kB/s | 19 kB 00:00 2024-04-12T19:36:05.722 INFO:teuthology.orchestra.run.smithi131.stdout:(130/174): python3-jaraco-text-3.2.0-6.el9.noar 598 kB/s | 20 kB 00:00 2024-04-12T19:36:05.755 INFO:teuthology.orchestra.run.smithi131.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 1.4 MB/s | 46 kB 00:00 2024-04-12T19:36:05.806 INFO:teuthology.orchestra.run.smithi131.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 10 MB/s | 1.0 MB 00:00 2024-04-12T19:36:05.826 INFO:teuthology.orchestra.run.smithi171.stdout:(65/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 551 kB/s | 3.0 MB 00:05 2024-04-12T19:36:05.873 INFO:teuthology.orchestra.run.smithi131.stdout:(133/174): python3-grpcio-1.46.7-10.el9.x86_64. 5.5 MB/s | 2.0 MB 00:00 2024-04-12T19:36:05.898 INFO:teuthology.orchestra.run.smithi131.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 558 kB/s | 79 kB 00:00 2024-04-12T19:36:05.923 INFO:teuthology.orchestra.run.smithi131.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 496 kB/s | 58 kB 00:00 2024-04-12T19:36:05.935 INFO:teuthology.orchestra.run.smithi171.stdout:(66/174): lua-5.4.4-4.el9.x86_64.rpm 177 kB/s | 188 kB 00:01 2024-04-12T19:36:05.948 INFO:teuthology.orchestra.run.smithi131.stdout:(136/174): python3-portend-3.1.0-2.el9.noarch.r 330 kB/s | 16 kB 00:00 2024-04-12T19:36:05.974 INFO:teuthology.orchestra.run.smithi131.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-04-12T19:36:05.985 INFO:teuthology.orchestra.run.smithi171.stdout:(67/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 236 kB/s | 292 kB 00:01 2024-04-12T19:36:06.002 INFO:teuthology.orchestra.run.smithi131.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 572 kB/s | 28 kB 00:00 2024-04-12T19:36:06.024 INFO:teuthology.orchestra.run.smithi131.stdout:(139/174): python3-repoze-lru-0.7-16.el9.noarch 623 kB/s | 31 kB 00:00 2024-04-12T19:36:06.058 INFO:teuthology.orchestra.run.smithi131.stdout:(140/174): python3-pecan-1.4.2-3.el9.noarch.rpm 1.4 MB/s | 272 kB 00:00 2024-04-12T19:36:06.083 INFO:teuthology.orchestra.run.smithi131.stdout:(141/174): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-04-12T19:36:06.277 INFO:teuthology.orchestra.run.smithi131.stdout:(142/174): python3-tempora-5.0.0-2.el9.noarch.r 164 kB/s | 36 kB 00:00 2024-04-12T19:36:06.334 INFO:teuthology.orchestra.run.smithi131.stdout:(143/174): python3-routes-2.5.1-5.el9.noarch.rp 565 kB/s | 188 kB 00:00 2024-04-12T19:36:06.359 INFO:teuthology.orchestra.run.smithi131.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 185 kB/s | 51 kB 00:00 2024-04-12T19:36:06.384 INFO:teuthology.orchestra.run.smithi131.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-04-12T19:36:06.418 INFO:teuthology.orchestra.run.smithi131.stdout:(146/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-04-12T19:36:06.443 INFO:teuthology.orchestra.run.smithi131.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 346 kB/s | 20 kB 00:00 2024-04-12T19:36:06.477 INFO:teuthology.orchestra.run.smithi131.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-04-12T19:36:06.514 INFO:teuthology.orchestra.run.smithi131.stdout:(149/174): python3-werkzeug-2.0.3-3.el9.1.noarc 2.7 MB/s | 427 kB 00:00 2024-04-12T19:36:06.582 INFO:teuthology.orchestra.run.smithi131.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-04-12T19:36:06.594 INFO:teuthology.orchestra.run.smithi171.stdout:(68/174): openblas-0.3.21-2.el9.x86_64.rpm 46 kB/s | 35 kB 00:00 2024-04-12T19:36:06.690 INFO:teuthology.orchestra.run.smithi131.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 21 MB/s | 2.3 MB 00:00 2024-04-12T19:36:06.790 INFO:teuthology.orchestra.run.smithi131.stdout:(152/174): NetworkManager-libnm-1.47.4-1.el9.x8 18 MB/s | 1.8 MB 00:00 2024-04-12T19:36:06.824 INFO:teuthology.orchestra.run.smithi131.stdout:(153/174): NetworkManager-team-1.47.4-1.el9.x86 1.3 MB/s | 42 kB 00:00 2024-04-12T19:36:06.874 INFO:teuthology.orchestra.run.smithi131.stdout:(154/174): NetworkManager-tui-1.47.4-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-04-12T19:36:06.916 INFO:teuthology.orchestra.run.smithi131.stdout:(155/174): acl-2.3.1-4.el9.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-04-12T19:36:06.969 INFO:teuthology.orchestra.run.smithi131.stdout:(156/174): elfutils-debuginfod-client-0.190-2.e 740 kB/s | 36 kB 00:00 2024-04-12T19:36:07.017 INFO:teuthology.orchestra.run.smithi131.stdout:(157/174): elfutils-libelf-0.190-2.el9.x86_64.r 3.8 MB/s | 192 kB 00:00 2024-04-12T19:36:07.067 INFO:teuthology.orchestra.run.smithi131.stdout:(158/174): elfutils-libs-0.190-2.el9.x86_64.rpm 5.1 MB/s | 256 kB 00:00 2024-04-12T19:36:07.109 INFO:teuthology.orchestra.run.smithi131.stdout:(159/174): libacl-2.3.1-4.el9.x86_64.rpm 561 kB/s | 23 kB 00:00 2024-04-12T19:36:07.159 INFO:teuthology.orchestra.run.smithi131.stdout:(160/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.2 MB/s | 108 kB 00:00 2024-04-12T19:36:07.235 INFO:teuthology.orchestra.run.smithi131.stdout:(161/174): librbd1-19.0.0-2879.g324baf8d.el9.x8 4.4 MB/s | 3.1 MB 00:00 2024-04-12T19:36:07.268 INFO:teuthology.orchestra.run.smithi131.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 1.4 MB/s | 155 kB 00:00 2024-04-12T19:36:07.310 INFO:teuthology.orchestra.run.smithi131.stdout:(163/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-04-12T19:36:07.335 INFO:teuthology.orchestra.run.smithi131.stdout:(164/174): libmount-2.37.4-18.el9.x86_64.rpm 1.3 MB/s | 136 kB 00:00 2024-04-12T19:36:07.361 INFO:teuthology.orchestra.run.smithi131.stdout:(165/174): libuuid-2.37.4-18.el9.x86_64.rpm 580 kB/s | 29 kB 00:00 2024-04-12T19:36:07.438 INFO:teuthology.orchestra.run.smithi131.stdout:(166/174): librados2-19.0.0-2879.g324baf8d.el9. 3.5 MB/s | 3.4 MB 00:00 2024-04-12T19:36:07.503 INFO:teuthology.orchestra.run.smithi131.stdout:(167/174): openssl-3.0.7-27.el9.x86_64.rpm 7.3 MB/s | 1.2 MB 00:00 2024-04-12T19:36:07.597 INFO:teuthology.orchestra.run.smithi131.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 9.2 MB/s | 2.2 MB 00:00 2024-04-12T19:36:07.637 INFO:teuthology.orchestra.run.smithi131.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 3.4 MB/s | 465 kB 00:00 2024-04-12T19:36:07.662 INFO:teuthology.orchestra.run.smithi131.stdout:(170/174): util-linux-user-2.37.4-18.el9.x86_64 487 kB/s | 31 kB 00:00 2024-04-12T19:36:07.696 INFO:teuthology.orchestra.run.smithi131.stdout:(171/174): xfsdump-3.1.12-4.el9.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2024-04-12T19:36:07.779 INFO:teuthology.orchestra.run.smithi131.stdout:(172/174): util-linux-2.37.4-18.el9.x86_64.rpm 6.7 MB/s | 2.3 MB 00:00 2024-04-12T19:36:07.830 INFO:teuthology.orchestra.run.smithi131.stdout:(173/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 6.5 MB/s | 1.1 MB 00:00 2024-04-12T19:36:07.855 INFO:teuthology.orchestra.run.smithi131.stdout:(174/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 469 kB/s | 74 kB 00:00 2024-04-12T19:36:07.861 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-04-12T19:36:07.862 INFO:teuthology.orchestra.run.smithi131.stdout:Total 12 MB/s | 229 MB 00:18 2024-04-12T19:36:07.936 INFO:teuthology.orchestra.run.smithi171.stdout:(69/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 2.1 MB/s | 4.1 MB 00:01 2024-04-12T19:36:09.886 INFO:teuthology.orchestra.run.smithi171.stdout:(70/174): postgresql-13.14-1.el9.x86_64.rpm 494 kB/s | 1.6 MB 00:03 2024-04-12T19:36:10.220 INFO:teuthology.orchestra.run.smithi171.stdout:(71/174): postgresql-contrib-13.14-1.el9.x86_64 399 kB/s | 911 kB 00:02 2024-04-12T19:36:11.053 INFO:teuthology.orchestra.run.smithi171.stdout:(72/174): postgresql-private-libs-13.14-1.el9.x 114 kB/s | 133 kB 00:01 2024-04-12T19:36:11.532 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-04-12T19:36:11.922 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-04-12T19:36:11.923 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-04-12T19:36:13.486 INFO:teuthology.orchestra.run.smithi171.stdout:(73/174): protobuf-3.14.0-13.el9.x86_64.rpm 425 kB/s | 1.0 MB 00:02 2024-04-12T19:36:14.278 INFO:teuthology.orchestra.run.smithi171.stdout:(74/174): openblas-openmp-0.3.21-2.el9.x86_64.r 582 kB/s | 4.7 MB 00:08 2024-04-12T19:36:14.437 INFO:teuthology.orchestra.run.smithi171.stdout:(75/174): python3-attrs-20.3.0-7.el9.noarch.rpm 92 kB/s | 87 kB 00:00 2024-04-12T19:36:14.558 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-04-12T19:36:14.559 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-04-12T19:36:15.612 INFO:teuthology.orchestra.run.smithi171.stdout:(76/174): python3-devel-3.9.17-2.el9.x86_64.rpm 209 kB/s | 245 kB 00:01 2024-04-12T19:36:16.887 INFO:teuthology.orchestra.run.smithi171.stdout:(77/174): python3-jinja2-2.11.3-5.el9.noarch.rp 195 kB/s | 248 kB 00:01 2024-04-12T19:36:17.712 INFO:teuthology.orchestra.run.smithi171.stdout:(78/174): python3-jsonpatch-1.21-16.el9.noarch. 31 kB/s | 26 kB 00:00 2024-04-12T19:36:18.488 INFO:teuthology.orchestra.run.smithi171.stdout:(79/174): python3-jsonpointer-2.0-4.el9.noarch. 25 kB/s | 19 kB 00:00 2024-04-12T19:36:19.438 INFO:teuthology.orchestra.run.smithi171.stdout:(80/174): python3-mako-1.1.4-6.el9.noarch.rpm 181 kB/s | 172 kB 00:00 2024-04-12T19:36:20.246 INFO:teuthology.orchestra.run.smithi171.stdout:(81/174): postgresql-server-13.14-1.el9.x86_64. 594 kB/s | 5.8 MB 00:09 2024-04-12T19:36:20.355 INFO:teuthology.orchestra.run.smithi171.stdout:(82/174): python3-markupsafe-1.1.1-12.el9.x86_6 38 kB/s | 35 kB 00:00 2024-04-12T19:36:21.647 INFO:teuthology.orchestra.run.smithi171.stdout:(83/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 194 kB/s | 250 kB 00:01 2024-04-12T19:36:22.010 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-04-12T19:36:22.120 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-12T19:36:22.169 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-12T19:36:22.199 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-12T19:36:22.244 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-12T19:36:22.341 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-12T19:36:22.447 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-12T19:36:22.508 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-12T19:36:22.539 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-12T19:36:22.633 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-12T19:36:22.755 INFO:teuthology.orchestra.run.smithi171.stdout:(84/174): python3-oauthlib-3.1.1-5.el9.noarch.r 201 kB/s | 222 kB 00:01 2024-04-12T19:36:23.050 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-12T19:36:23.096 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 10/198 2024-04-12T19:36:23.247 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 10/198 2024-04-12T19:36:23.272 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 11/198 2024-04-12T19:36:23.392 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 11/198 2024-04-12T19:36:23.428 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:19.0.0-2879.g324baf8d.el9.x86_64 12/198 2024-04-12T19:36:23.495 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-12T19:36:23.547 INFO:teuthology.orchestra.run.smithi171.stdout:(85/174): python3-packaging-20.9-5.el9.noarch.r 98 kB/s | 77 kB 00:00 2024-04-12T19:36:23.787 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-12T19:36:23.852 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-12T19:36:23.877 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 16/198 2024-04-12T19:36:24.023 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 16/198 2024-04-12T19:36:24.053 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86 17/198 2024-04-12T19:36:24.127 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86 17/198 2024-04-12T19:36:24.180 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-12T19:36:24.205 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-12T19:36:24.268 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-12T19:36:24.406 INFO:teuthology.orchestra.run.smithi171.stdout:(86/174): python3-babel-2.9.1-2.el9.noarch.rpm 603 kB/s | 6.0 MB 00:10 2024-04-12T19:36:24.431 INFO:teuthology.orchestra.run.smithi171.stdout:(87/174): python3-prettytable-0.7.2-27.el9.noar 48 kB/s | 42 kB 00:00 2024-04-12T19:36:24.550 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-12T19:36:24.598 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-12T19:36:24.639 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-12T19:36:24.953 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-12T19:36:25.138 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-12T19:36:25.210 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-12T19:36:25.364 INFO:teuthology.orchestra.run.smithi171.stdout:(88/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 170 kB/s | 159 kB 00:00 2024-04-12T19:36:25.374 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-12T19:36:25.432 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-12T19:36:25.464 INFO:teuthology.orchestra.run.smithi171.stdout:(89/174): python3-protobuf-3.14.0-13.el9.noarch 255 kB/s | 269 kB 00:01 2024-04-12T19:36:25.749 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-12T19:36:25.938 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-12T19:36:26.076 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-12T19:36:26.114 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-12T19:36:26.194 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-12T19:36:26.303 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-12T19:36:26.348 INFO:teuthology.orchestra.run.smithi171.stdout:(90/174): python3-pytz-2021.1-5.el9.noarch.rpm 58 kB/s | 51 kB 00:00 2024-04-12T19:36:26.350 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-12T19:36:26.415 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-12T19:36:26.455 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-12T19:36:26.486 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-12T19:36:26.599 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-12T19:36:26.665 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-12T19:36:26.697 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-12T19:36:26.698 INFO:teuthology.orchestra.run.smithi171.stdout:(91/174): python3-pyasn1-modules-0.4.8-6.el9.no 209 kB/s | 279 kB 00:01 2024-04-12T19:36:26.754 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-12T19:36:26.862 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-12T19:36:26.900 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:19.0.0-2879.g324baf8d.el9. 39/198 2024-04-12T19:36:26.953 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:19.0.0-2879.g324baf8d.el 40/198 2024-04-12T19:36:26.982 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:19.0.0-2879.g324baf8d.el9.x86_6 41/198 2024-04-12T19:36:27.071 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-12T19:36:27.115 INFO:teuthology.orchestra.run.smithi171.stdout:(92/174): python3-requests-oauthlib-1.3.0-12.el 70 kB/s | 54 kB 00:00 2024-04-12T19:36:27.134 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-12T19:36:27.226 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-12T19:36:27.386 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-12T19:36:27.454 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-12T19:36:27.799 INFO:teuthology.orchestra.run.smithi171.stdout:(93/174): python3-toml-0.10.2-6.el9.noarch.rpm 61 kB/s | 42 kB 00:00 2024-04-12T19:36:28.128 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-12T19:36:28.229 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-12T19:36:28.341 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-12T19:36:28.396 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-12T19:36:28.423 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-12T19:36:28.476 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-12T19:36:28.544 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-12T19:36:28.550 INFO:teuthology.orchestra.run.smithi171.stdout:(94/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 629 kB/s | 5.1 MB 00:08 2024-04-12T19:36:28.591 INFO:teuthology.orchestra.run.smithi171.stdout:(95/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 56 kB/s | 44 kB 00:00 2024-04-12T19:36:28.597 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:19.0.0-2879.g324baf8d.el9.x86_6 53/198 2024-04-12T19:36:28.637 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-12T19:36:29.039 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-12T19:36:29.211 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-12T19:36:29.274 INFO:teuthology.orchestra.run.smithi171.stdout:(96/174): qatlib-service-24.02.0-1.el9.x86_64.r 53 kB/s | 36 kB 00:00 2024-04-12T19:36:29.292 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-12T19:36:29.331 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-12T19:36:29.516 INFO:teuthology.orchestra.run.smithi171.stdout:(97/174): qatlib-24.02.0-1.el9.x86_64.rpm 229 kB/s | 221 kB 00:00 2024-04-12T19:36:29.526 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-12T19:36:29.598 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-12T19:36:29.674 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-12T19:36:29.767 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-12T19:36:29.806 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-12T19:36:29.845 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-12T19:36:29.911 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-12T19:36:29.953 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-12T19:36:30.008 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-12T19:36:30.016 INFO:teuthology.orchestra.run.smithi171.stdout:(98/174): qatzip-libs-1.2.0-1.el9.x86_64.rpm 64 kB/s | 47 kB 00:00 2024-04-12T19:36:30.087 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-12T19:36:30.287 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-12T19:36:30.344 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-12T19:36:30.382 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-12T19:36:30.449 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-12T19:36:30.592 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-12T19:36:30.630 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-12T19:36:30.658 INFO:teuthology.orchestra.run.smithi171.stdout:(99/174): socat-1.7.4.1-5.el9.x86_64.rpm 285 kB/s | 305 kB 00:01 2024-04-12T19:36:30.687 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-12T19:36:30.730 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-12T19:36:30.742 INFO:teuthology.orchestra.run.smithi171.stdout:(100/174): uuid-1.6.2-55.el9.x86_64.rpm 80 kB/s | 58 kB 00:00 2024-04-12T19:36:30.759 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-12T19:36:30.922 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-12T19:36:31.101 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-12T19:36:31.157 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-12T19:36:31.195 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-12T19:36:31.233 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-12T19:36:31.289 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-12T19:36:31.368 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-12T19:36:31.420 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-12T19:36:31.466 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-12T19:36:31.515 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-12T19:36:31.534 INFO:teuthology.orchestra.run.smithi171.stdout:(101/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 107 kB/s | 94 kB 00:00 2024-04-12T19:36:31.559 INFO:teuthology.orchestra.run.smithi171.stdout:(102/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 78 kB/s | 64 kB 00:00 2024-04-12T19:36:31.593 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-12T19:36:31.639 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-12T19:36:31.652 INFO:teuthology.orchestra.run.smithi171.stdout:(103/174): lua-devel-5.4.4-4.el9.x86_64.rpm 243 kB/s | 22 kB 00:00 2024-04-12T19:36:31.785 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-12T19:36:31.802 INFO:teuthology.orchestra.run.smithi171.stdout:(104/174): protobuf-compiler-3.14.0-13.el9.x86_ 5.7 MB/s | 863 kB 00:00 2024-04-12T19:36:31.844 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-12T19:36:31.887 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-12T19:36:31.952 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-12T19:36:32.117 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-12T19:36:32.127 INFO:teuthology.orchestra.run.smithi171.stdout:(105/174): abseil-cpp-20211102.0-3.el9.x86_64.r 2.1 MB/s | 548 kB 00:00 2024-04-12T19:36:32.185 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-12T19:36:32.286 INFO:teuthology.orchestra.run.smithi171.stdout:(106/174): gperftools-libs-2.9.1-2.el9.x86_64.r 1.9 MB/s | 309 kB 00:00 2024-04-12T19:36:32.311 INFO:teuthology.orchestra.run.smithi171.stdout:(107/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 58 kB/s | 45 kB 00:00 2024-04-12T19:36:32.337 INFO:teuthology.orchestra.run.smithi171.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 409 kB/s | 19 kB 00:00 2024-04-12T19:36:32.387 INFO:teuthology.orchestra.run.smithi171.stdout:(109/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 529 kB/s | 26 kB 00:00 2024-04-12T19:36:32.438 INFO:teuthology.orchestra.run.smithi171.stdout:(110/174): liboath-2.6.7-2.el9.x86_64.rpm 987 kB/s | 49 kB 00:00 2024-04-12T19:36:32.496 INFO:teuthology.orchestra.run.smithi171.stdout:(111/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-04-12T19:36:32.588 INFO:teuthology.orchestra.run.smithi171.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-04-12T19:36:32.822 INFO:teuthology.orchestra.run.smithi171.stdout:(113/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.5 MB/s | 838 kB 00:00 2024-04-12T19:36:33.171 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-12T19:36:33.225 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-12T19:36:33.276 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-12T19:36:33.409 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-12T19:36:33.470 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-12T19:36:33.566 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-12T19:36:33.602 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-12T19:36:33.829 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-12T19:36:33.857 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-12T19:36:33.972 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-12T19:36:34.214 INFO:teuthology.orchestra.run.smithi171.stdout:(114/174): python3-asyncssh-2.13.2-5.el9.noarch 394 kB/s | 548 kB 00:01 2024-04-12T19:36:34.264 INFO:teuthology.orchestra.run.smithi171.stdout:(115/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 882 kB/s | 43 kB 00:00 2024-04-12T19:36:34.306 INFO:teuthology.orchestra.run.smithi171.stdout:(116/174): python3-cachetools-4.2.4-1.el9.noarc 785 kB/s | 32 kB 00:00 2024-04-12T19:36:34.348 INFO:teuthology.orchestra.run.smithi171.stdout:(117/174): python3-certifi-2021.10.8-2.el9.noar 366 kB/s | 15 kB 00:00 2024-04-12T19:36:34.415 INFO:teuthology.orchestra.run.smithi171.stdout:(118/174): python3-cheroot-8.6.0-4.el9.noarch.r 2.5 MB/s | 172 kB 00:00 2024-04-12T19:36:34.531 INFO:teuthology.orchestra.run.smithi171.stdout:(119/174): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-04-12T19:36:34.624 INFO:teuthology.orchestra.run.smithi171.stdout:(120/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 3.2 MB/s | 303 kB 00:00 2024-04-12T19:36:34.666 INFO:teuthology.orchestra.run.smithi171.stdout:(121/174): python3-colorama-0.4.4-12.el9.noarch 864 kB/s | 35 kB 00:00 2024-04-12T19:36:34.741 INFO:teuthology.orchestra.run.smithi171.stdout:(122/174): python3-google-auth-2.28.2-1.el9.noa 2.7 MB/s | 203 kB 00:00 2024-04-12T19:36:34.781 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-12T19:36:34.913 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-12T19:36:35.141 INFO:teuthology.orchestra.run.smithi171.stdout:(123/174): python3-grpcio-1.46.7-10.el9.x86_64. 5.1 MB/s | 2.0 MB 00:00 2024-04-12T19:36:35.200 INFO:teuthology.orchestra.run.smithi171.stdout:(124/174): python3-grpcio-tools-1.46.7-10.el9.x 2.5 MB/s | 144 kB 00:00 2024-04-12T19:36:35.292 INFO:teuthology.orchestra.run.smithi171.stdout:(125/174): python3-jaraco-8.2.1-3.el9.noarch.rp 117 kB/s | 11 kB 00:00 2024-04-12T19:36:35.334 INFO:teuthology.orchestra.run.smithi171.stdout:(126/174): python3-jaraco-classes-3.2.1-5.el9.n 434 kB/s | 18 kB 00:00 2024-04-12T19:36:35.367 INFO:teuthology.orchestra.run.smithi171.stdout:(127/174): python3-jaraco-collections-3.0.0-8.e 718 kB/s | 23 kB 00:00 2024-04-12T19:36:35.401 INFO:teuthology.orchestra.run.smithi171.stdout:(128/174): python3-jaraco-functools-3.5.0-2.el9 597 kB/s | 19 kB 00:00 2024-04-12T19:36:35.434 INFO:teuthology.orchestra.run.smithi171.stdout:(129/174): python3-jaraco-text-3.2.0-6.el9.noar 605 kB/s | 20 kB 00:00 2024-04-12T19:36:35.635 INFO:teuthology.orchestra.run.smithi171.stdout:(130/174): libarrow-9.0.0-10.el9.x86_64.rpm 1.3 MB/s | 4.4 MB 00:03 2024-04-12T19:36:35.685 INFO:teuthology.orchestra.run.smithi171.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 945 kB/s | 46 kB 00:00 2024-04-12T19:36:35.744 INFO:teuthology.orchestra.run.smithi171.stdout:(132/174): python3-more-itertools-8.12.0-2.el9. 1.3 MB/s | 79 kB 00:00 2024-04-12T19:36:35.794 INFO:teuthology.orchestra.run.smithi171.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-04-12T19:36:35.827 INFO:teuthology.orchestra.run.smithi171.stdout:(134/174): python3-natsort-7.1.1-5.el9.noarch.r 698 kB/s | 58 kB 00:00 2024-04-12T19:36:35.878 INFO:teuthology.orchestra.run.smithi171.stdout:(135/174): python3-portend-3.1.0-2.el9.noarch.r 335 kB/s | 16 kB 00:00 2024-04-12T19:36:35.911 INFO:teuthology.orchestra.run.smithi171.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-04-12T19:36:35.953 INFO:teuthology.orchestra.run.smithi171.stdout:(137/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-04-12T19:36:35.979 INFO:teuthology.orchestra.run.smithi171.stdout:(138/174): python3-pyperclip-1.8.2-2.el9.noarch 425 kB/s | 28 kB 00:00 2024-04-12T19:36:36.054 INFO:teuthology.orchestra.run.smithi171.stdout:(139/174): python3-routes-2.5.1-5.el9.noarch.rp 2.5 MB/s | 188 kB 00:00 2024-04-12T19:36:36.132 INFO:teuthology.orchestra.run.smithi171.stdout:(140/174): python3-rsa-4.9-2.el9.noarch.rpm 763 kB/s | 59 kB 00:00 2024-04-12T19:36:36.205 INFO:teuthology.orchestra.run.smithi171.stdout:(141/174): python3-tempora-5.0.0-2.el9.noarch.r 499 kB/s | 36 kB 00:00 2024-04-12T19:36:36.272 INFO:teuthology.orchestra.run.smithi171.stdout:(142/174): python3-typing-extensions-4.4.0-2.el 773 kB/s | 51 kB 00:00 2024-04-12T19:36:36.355 INFO:teuthology.orchestra.run.smithi171.stdout:(143/174): python3-repoze-lru-0.7-16.el9.noarch 77 kB/s | 31 kB 00:00 2024-04-12T19:36:36.389 INFO:teuthology.orchestra.run.smithi171.stdout:(144/174): python3-webob-1.8.7-6.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-04-12T19:36:36.431 INFO:teuthology.orchestra.run.smithi171.stdout:(145/174): python3-websocket-client-1.2.3-2.el9 1.2 MB/s | 90 kB 00:00 2024-04-12T19:36:36.487 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-12T19:36:36.591 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-12T19:36:36.625 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-12T19:36:36.723 INFO:teuthology.orchestra.run.smithi171.stdout:(146/174): python3-werkzeug-2.0.3-3.el9.1.noarc 1.3 MB/s | 427 kB 00:00 2024-04-12T19:36:36.748 INFO:teuthology.orchestra.run.smithi171.stdout:(147/174): python3-zc-lockfile-2.0-10.el9.noarc 63 kB/s | 20 kB 00:00 2024-04-12T19:36:36.807 INFO:teuthology.orchestra.run.smithi171.stdout:(148/174): re2-20211101-3.el9.x86_64.rpm 2.3 MB/s | 192 kB 00:00 2024-04-12T19:36:36.995 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-12T19:36:37.027 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 112/198 2024-04-12T19:36:37.107 INFO:teuthology.orchestra.run.smithi171.stdout:(149/174): librados2-19.0.0-2879.g324baf8d.el9. 11 MB/s | 3.4 MB 00:00 2024-04-12T19:36:37.174 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 112/198 2024-04-12T19:36:37.200 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:19.0.0-2879.g324baf8d.el9.x86_64 113/198 2024-04-12T19:36:37.250 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-12T19:36:37.307 INFO:teuthology.orchestra.run.smithi171.stdout:(150/174): librbd1-19.0.0-2879.g324baf8d.el9.x8 16 MB/s | 3.1 MB 00:00 2024-04-12T19:36:37.599 INFO:teuthology.orchestra.run.smithi171.stdout:(151/174): NetworkManager-1.47.4-1.el9.x86_64.r 7.9 MB/s | 2.3 MB 00:00 2024-04-12T19:36:37.749 INFO:teuthology.orchestra.run.smithi171.stdout:(152/174): NetworkManager-libnm-1.47.4-1.el9.x8 12 MB/s | 1.8 MB 00:00 2024-04-12T19:36:37.776 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-12T19:36:37.799 INFO:teuthology.orchestra.run.smithi171.stdout:(153/174): NetworkManager-team-1.47.4-1.el9.x86 850 kB/s | 42 kB 00:00 2024-04-12T19:36:37.813 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 116/198 2024-04-12T19:36:37.875 INFO:teuthology.orchestra.run.smithi171.stdout:(154/174): NetworkManager-tui-1.47.4-1.el9.x86_ 3.3 MB/s | 249 kB 00:00 2024-04-12T19:36:37.913 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 116/198 2024-04-12T19:36:37.940 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:19.0.0-2879.g324baf8d.el9.x86_64 117/198 2024-04-12T19:36:37.942 INFO:teuthology.orchestra.run.smithi171.stdout:(155/174): acl-2.3.1-4.el9.x86_64.rpm 1.1 MB/s | 71 kB 00:00 2024-04-12T19:36:38.025 INFO:teuthology.orchestra.run.smithi171.stdout:(156/174): elfutils-debuginfod-client-0.190-2.e 441 kB/s | 36 kB 00:00 2024-04-12T19:36:38.101 INFO:teuthology.orchestra.run.smithi171.stdout:(157/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.5 MB/s | 192 kB 00:00 2024-04-12T19:36:38.159 INFO:teuthology.orchestra.run.smithi171.stdout:(158/174): elfutils-libs-0.190-2.el9.x86_64.rpm 4.3 MB/s | 256 kB 00:00 2024-04-12T19:36:38.226 INFO:teuthology.orchestra.run.smithi171.stdout:(159/174): libacl-2.3.1-4.el9.x86_64.rpm 350 kB/s | 23 kB 00:00 2024-04-12T19:36:38.293 INFO:teuthology.orchestra.run.smithi171.stdout:(160/174): libblkid-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 108 kB 00:00 2024-04-12T19:36:38.360 INFO:teuthology.orchestra.run.smithi171.stdout:(161/174): libfdisk-2.37.4-18.el9.x86_64.rpm 2.3 MB/s | 155 kB 00:00 2024-04-12T19:36:38.444 INFO:teuthology.orchestra.run.smithi171.stdout:(162/174): libmount-2.37.4-18.el9.x86_64.rpm 1.6 MB/s | 136 kB 00:00 2024-04-12T19:36:38.486 INFO:teuthology.orchestra.run.smithi171.stdout:(163/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.5 MB/s | 64 kB 00:00 2024-04-12T19:36:38.528 INFO:teuthology.orchestra.run.smithi171.stdout:(164/174): libuuid-2.37.4-18.el9.x86_64.rpm 702 kB/s | 29 kB 00:00 2024-04-12T19:36:38.628 INFO:teuthology.orchestra.run.smithi171.stdout:(165/174): openssl-3.0.7-27.el9.x86_64.rpm 12 MB/s | 1.2 MB 00:00 2024-04-12T19:36:38.753 INFO:teuthology.orchestra.run.smithi171.stdout:(166/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 17 MB/s | 2.2 MB 00:00 2024-04-12T19:36:38.803 INFO:teuthology.orchestra.run.smithi171.stdout:(167/174): thrift-0.15.0-2.el9.x86_64.rpm 788 kB/s | 1.6 MB 00:02 2024-04-12T19:36:38.904 INFO:teuthology.orchestra.run.smithi171.stdout:(168/174): util-linux-2.37.4-18.el9.x86_64.rpm 15 MB/s | 2.3 MB 00:00 2024-04-12T19:36:38.954 INFO:teuthology.orchestra.run.smithi171.stdout:(169/174): util-linux-user-2.37.4-18.el9.x86_64 627 kB/s | 31 kB 00:00 2024-04-12T19:36:39.021 INFO:teuthology.orchestra.run.smithi171.stdout:(170/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.8 MB/s | 323 kB 00:00 2024-04-12T19:36:39.054 INFO:teuthology.orchestra.run.smithi171.stdout:(171/174): util-linux-core-2.37.4-18.el9.x86_64 1.8 MB/s | 465 kB 00:00 2024-04-12T19:36:39.113 INFO:teuthology.orchestra.run.smithi171.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 12 MB/s | 1.1 MB 00:00 2024-04-12T19:36:39.805 INFO:teuthology.orchestra.run.smithi171.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 99 kB/s | 74 kB 00:00 2024-04-12T19:36:40.615 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 118/198 2024-04-12T19:36:40.647 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 118/198 2024-04-12T19:36:41.269 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 118/198 2024-04-12T19:36:41.310 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 119/198 2024-04-12T19:36:41.456 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 119/198 2024-04-12T19:36:41.456 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-12T19:36:41.456 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-12T19:36:41.456 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:36:41.494 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 120/198 2024-04-12T19:36:48.829 INFO:teuthology.orchestra.run.smithi171.stdout:(174/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 752 kB/s | 16 MB 00:22 2024-04-12T19:36:48.840 INFO:teuthology.orchestra.run.smithi171.stdout:-------------------------------------------------------------------------------- 2024-04-12T19:36:48.840 INFO:teuthology.orchestra.run.smithi171.stdout:Total 3.8 MB/s | 229 MB 01:01 2024-04-12T19:36:52.509 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction check 2024-04-12T19:36:52.897 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction check succeeded. 2024-04-12T19:36:52.898 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction test 2024-04-12T19:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 120/198 2024-04-12T19:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2024-04-12T19:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2024-04-12T19:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2024-04-12T19:36:54.275 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2024-04-12T19:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2024-04-12T19:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /root 2024-04-12T19:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2024-04-12T19:36:54.276 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:36:54.516 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 121/198 2024-04-12T19:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 121/198 2024-04-12T19:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-12T19:36:54.561 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:36:55.445 INFO:teuthology.orchestra.run.smithi171.stdout:Transaction test succeeded. 2024-04-12T19:36:55.445 INFO:teuthology.orchestra.run.smithi171.stdout:Running transaction 2024-04-12T19:36:56.143 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 122/198 2024-04-12T19:36:56.219 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 122/198 2024-04-12T19:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-12T19:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-12T19:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-12T19:36:56.220 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:36:56.469 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 123/198 2024-04-12T19:36:56.536 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 123/198 2024-04-12T19:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-12T19:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-12T19:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-12T19:36:56.537 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:36:57.011 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 124/198 2024-04-12T19:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 124/198 2024-04-12T19:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-12T19:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-12T19:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-12T19:36:57.081 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:36:57.212 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-12T19:36:57.272 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-12T19:36:57.344 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-12T19:36:57.572 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-12T19:36:57.627 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-12T19:36:57.712 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-12T19:36:57.831 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-12T19:36:57.998 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-12T19:36:58.050 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-12T19:36:58.091 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-12T19:36:58.123 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-12T19:36:58.162 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-12T19:36:58.193 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-12T19:36:58.850 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 138/198 2024-04-12T19:36:58.892 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 138/198 2024-04-12T19:36:58.945 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2879.g324baf8d.e 139/198 2024-04-12T19:36:59.091 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2879.g324baf8d. 140/198 2024-04-12T19:36:59.123 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noa 141/198 2024-04-12T19:37:00.449 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noa 141/198 2024-04-12T19:37:00.492 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.n 142/198 2024-04-12T19:37:01.593 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.n 142/198 2024-04-12T19:37:01.625 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2879.g324 143/198 2024-04-12T19:37:01.767 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2879.g324 143/198 2024-04-12T19:37:01.942 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2879.g324baf8d.el 144/198 2024-04-12T19:37:01.969 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 145/198 2024-04-12T19:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 145/198 2024-04-12T19:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-12T19:37:02.042 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-12T19:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-12T19:37:02.043 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:37:02.103 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 146/198 2024-04-12T19:37:02.141 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 146/198 2024-04-12T19:37:02.299 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:19.0.0-2879.g324baf8d.el9.x86_64 147/198 2024-04-12T19:37:03.018 INFO:teuthology.orchestra.run.smithi171.stdout: Preparing : 1/1 2024-04-12T19:37:03.118 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-04-12T19:37:03.160 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-04-12T19:37:03.213 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-12T19:37:03.260 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-04-12T19:37:03.345 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-04-12T19:37:03.458 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-04-12T19:37:03.513 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-04-12T19:37:03.545 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-04-12T19:37:03.611 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-04-12T19:37:04.004 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-04-12T19:37:04.070 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 10/198 2024-04-12T19:37:04.223 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 10/198 2024-04-12T19:37:04.255 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 11/198 2024-04-12T19:37:04.400 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 11/198 2024-04-12T19:37:04.446 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rados-2:19.0.0-2879.g324baf8d.el9.x86_64 12/198 2024-04-12T19:37:04.505 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 13/198 2024-04-12T19:37:04.793 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-04-12T19:37:04.845 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-13.14-1.el9.x86_64 15/198 2024-04-12T19:37:04.870 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 16/198 2024-04-12T19:37:05.034 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 16/198 2024-04-12T19:37:05.063 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86 17/198 2024-04-12T19:37:05.153 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86 17/198 2024-04-12T19:37:05.199 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-04-12T19:37:05.224 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-12T19:37:05.298 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 19/198 2024-04-12T19:37:05.619 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-12T19:37:05.667 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 20/198 2024-04-12T19:37:05.717 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-04-12T19:37:06.031 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-04-12T19:37:06.225 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-12T19:37:06.314 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 23/198 2024-04-12T19:37:06.515 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-12T19:37:06.571 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-12T19:37:06.908 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 24/198 2024-04-12T19:37:07.095 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-04-12T19:37:07.209 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 148/198 2024-04-12T19:37:07.215 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-04-12T19:37:07.253 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-04-12T19:37:07.292 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:19.0.0-2879.g324baf8d.el9.x86_64 149/198 2024-04-12T19:37:07.300 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-04-12T19:37:07.390 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 29/198 2024-04-12T19:37:07.442 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 30/198 2024-04-12T19:37:07.494 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 31/198 2024-04-12T19:37:07.536 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 32/198 2024-04-12T19:37:07.569 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-5.4.4-4.el9.x86_64 33/198 2024-04-12T19:37:07.678 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 34/198 2024-04-12T19:37:07.749 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 35/198 2024-04-12T19:37:07.806 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 36/198 2024-04-12T19:37:07.878 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 37/198 2024-04-12T19:37:07.992 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 38/198 2024-04-12T19:37:08.044 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-common-2:19.0.0-2879.g324baf8d.el9. 39/198 2024-04-12T19:37:08.099 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ceph-argparse-2:19.0.0-2879.g324baf8d.el 40/198 2024-04-12T19:37:08.134 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cephfs-2:19.0.0-2879.g324baf8d.el9.x86_6 41/198 2024-04-12T19:37:08.249 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-04-12T19:37:08.267 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-12T19:37:08.294 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 151/198 2024-04-12T19:37:08.314 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-04-12T19:37:08.364 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 151/198 2024-04-12T19:37:08.365 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:08.365 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-12T19:37:08.365 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-12T19:37:08.365 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-12T19:37:08.365 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:37:08.411 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2879.g324ba 152/198 2024-04-12T19:37:08.412 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-04-12T19:37:08.479 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2879.g324ba 152/198 2024-04-12T19:37:08.480 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:08.480 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-12T19:37:08.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:37:08.537 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 153/198 2024-04-12T19:37:08.602 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-04-12T19:37:08.608 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 153/198 2024-04-12T19:37:08.608 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:08.608 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-12T19:37:08.608 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-12T19:37:08.608 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-12T19:37:08.608 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:37:08.667 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-04-12T19:37:08.954 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 154/198 2024-04-12T19:37:09.022 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 154/198 2024-04-12T19:37:09.022 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:09.023 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-12T19:37:09.023 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-12T19:37:09.023 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-12T19:37:09.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:37:09.093 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 155/198 2024-04-12T19:37:09.129 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:19.0.0-2879.g324baf8d.el9.x86_64 156/198 2024-04-12T19:37:09.168 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-12T19:37:09.315 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-04-12T19:37:09.406 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-04-12T19:37:09.486 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-shell-2:19.0.0-2879.g324baf8d.el9.x86_64 158/198 2024-04-12T19:37:09.543 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-04-12T19:37:09.558 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-12T19:37:09.600 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-12T19:37:09.619 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-12T19:37:09.628 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-04-12T19:37:09.687 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 51/198 2024-04-12T19:37:09.689 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-12T19:37:09.744 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-12T19:37:09.751 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-04-12T19:37:09.786 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:19.0.0-2879.g324baf8d.el9.x86_ 163/198 2024-04-12T19:37:09.794 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librados-devel-2:19.0.0-2879.g324baf8d.el9.x86_6 53/198 2024-04-12T19:37:09.832 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-04-12T19:37:09.839 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-12T19:37:09.917 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-12T19:37:10.038 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-12T19:37:10.148 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-12T19:37:10.190 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-12T19:37:10.519 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-04-12T19:37:10.903 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-04-12T19:37:11.031 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-04-12T19:37:11.091 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-04-12T19:37:11.144 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-12T19:37:11.195 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-12T19:37:11.259 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-12T19:37:11.302 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-04-12T19:37:11.356 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-04-12T19:37:11.448 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-04-12T19:37:11.544 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-04-12T19:37:11.590 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-04-12T19:37:11.627 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-04-12T19:37:11.698 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-04-12T19:37:11.738 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-04-12T19:37:11.800 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-04-12T19:37:11.860 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-04-12T19:37:12.040 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-04-12T19:37:12.087 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-04-12T19:37:12.124 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-04-12T19:37:12.169 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-04-12T19:37:12.299 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-04-12T19:37:12.332 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-google-auth-1:2.28.2-1.el9.noarch 74/198 2024-04-12T19:37:12.376 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-04-12T19:37:12.406 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-04-12T19:37:12.439 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-04-12T19:37:12.573 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephfs-top-2:19.0.0-2879.g324baf8d.el9.noarch 170/198 2024-04-12T19:37:12.598 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-04-12T19:37:12.697 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-12T19:37:12.772 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-04-12T19:37:12.804 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-12T19:37:12.810 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-04-12T19:37:12.844 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-12T19:37:12.847 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 81/198 2024-04-12T19:37:12.869 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-12T19:37:12.882 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 82/198 2024-04-12T19:37:12.903 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-12T19:37:12.924 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : uuid-1.6.2-55.el9.x86_64 83/198 2024-04-12T19:37:12.929 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-12T19:37:12.964 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 84/198 2024-04-12T19:37:12.967 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-12T19:37:12.967 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-12T19:37:13.003 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 85/198 2024-04-12T19:37:13.038 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 86/198 2024-04-12T19:37:13.068 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 87/198 2024-04-12T19:37:13.141 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-12T19:37:13.144 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 88/198 2024-04-12T19:37:13.189 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 89/198 2024-04-12T19:37:13.192 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-12T19:37:13.192 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-12T19:37:13.322 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 90/198 2024-04-12T19:37:13.330 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-12T19:37:13.375 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-12T19:37:13.391 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 91/198 2024-04-12T19:37:13.420 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-12T19:37:13.432 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 92/198 2024-04-12T19:37:13.454 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-12T19:37:13.484 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 93/198 2024-04-12T19:37:13.486 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-12T19:37:13.556 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-12T19:37:13.629 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-packaging-20.9-5.el9.noarch 94/198 2024-04-12T19:37:13.634 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-12T19:37:13.708 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-12T19:37:13.719 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 95/198 2024-04-12T19:37:13.749 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-12T19:37:13.783 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-12T19:37:13.816 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-12T19:37:13.849 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-12T19:37:13.886 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-12T19:37:13.886 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-12T19:37:14.234 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-12T19:37:14.234 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-12T19:37:14.398 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-12T19:37:14.426 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-12T19:37:14.474 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-12T19:37:14.506 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-12T19:37:14.546 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-12T19:37:14.657 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 96/198 2024-04-12T19:37:14.664 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-12T19:37:14.715 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 97/198 2024-04-12T19:37:14.749 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 98/198 2024-04-12T19:37:14.875 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 99/198 2024-04-12T19:37:14.913 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-12T19:37:14.913 INFO:teuthology.orchestra.run.smithi131.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-12T19:37:14.913 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:37:14.936 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 100/198 2024-04-12T19:37:15.035 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 101/198 2024-04-12T19:37:15.085 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 102/198 2024-04-12T19:37:15.320 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-0.3.21-2.el9.x86_64 103/198 2024-04-12T19:37:15.349 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 104/198 2024-04-12T19:37:15.451 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 105/198 2024-04-12T19:37:16.268 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 106/198 2024-04-12T19:37:16.423 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 107/198 2024-04-12T19:37:17.989 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 108/198 2024-04-12T19:37:18.095 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 109/198 2024-04-12T19:37:18.128 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 110/198 2024-04-12T19:37:18.502 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 111/198 2024-04-12T19:37:18.532 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 112/198 2024-04-12T19:37:18.653 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 112/198 2024-04-12T19:37:18.681 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rbd-2:19.0.0-2879.g324baf8d.el9.x86_64 113/198 2024-04-12T19:37:18.729 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 114/198 2024-04-12T19:37:19.259 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-12T19:37:19.286 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 116/198 2024-04-12T19:37:19.378 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 116/198 2024-04-12T19:37:19.405 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-rgw-2:19.0.0-2879.g324baf8d.el9.x86_64 117/198 2024-04-12T19:37:20.726 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:19.0.0-2879.g324baf8d.el9.x86_64 1/198 2024-04-12T19:37:20.726 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 2/198 2024-04-12T19:37:20.726 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 3/198 2024-04-12T19:37:20.726 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 4/198 2024-04-12T19:37:20.726 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2879.g324ba 5/198 2024-04-12T19:37:20.726 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 6/198 2024-04-12T19:37:20.726 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 7/198 2024-04-12T19:37:20.726 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 8/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 9/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 10/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 11/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:19.0.0-2879.g324baf8d.el9.x86_64 12/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 13/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-shell-2:19.0.0-2879.g324baf8d.el9.x86_64 14/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:19.0.0-2879.g324baf8d.el9.x86_ 15/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 16/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 17/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:19.0.0-2879.g324baf8d.el9.x86_6 18/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86 19/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 20/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2879.g324baf8d.el 21/198 2024-04-12T19:37:20.727 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:19.0.0-2879.g324baf8d.el9. 22/198 2024-04-12T19:37:20.728 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:19.0.0-2879.g324baf8d.el9.x86_6 23/198 2024-04-12T19:37:20.728 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:19.0.0-2879.g324baf8d.el9.x86_64 24/198 2024-04-12T19:37:20.728 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:19.0.0-2879.g324baf8d.el9.x86_64 25/198 2024-04-12T19:37:20.728 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:19.0.0-2879.g324baf8d.el9.x86_64 26/198 2024-04-12T19:37:20.728 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 27/198 2024-04-12T19:37:20.728 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 28/198 2024-04-12T19:37:20.728 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:19.0.0-2879.g324baf8d.el9.x86_64 29/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2879.g324baf8d. 30/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noa 31/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.n 32/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2879.g324 33/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2879.g324baf8d.el 34/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 35/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2879.g324baf8d.e 36/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 37/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 38/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephfs-top-2:19.0.0-2879.g324baf8d.el9.noarch 39/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-12T19:37:20.744 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-12T19:37:20.745 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-12T19:37:20.746 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-12T19:37:20.747 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-12T19:37:20.748 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-12T19:37:20.749 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-12T19:37:20.750 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-12T19:37:20.751 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 151/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 153/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-12T19:37:20.752 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-12T19:37:20.753 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-12T19:37:20.754 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-12T19:37:20.755 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-12T19:37:21.977 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 118/198 2024-04-12T19:37:22.020 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 118/198 2024-04-12T19:37:22.646 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 118/198 2024-04-12T19:37:22.700 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 119/198 2024-04-12T19:37:22.853 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 119/198 2024-04-12T19:37:22.853 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-04-12T19:37:22.854 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-04-12T19:37:22.854 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:37:22.926 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 120/198 2024-04-12T19:37:23.344 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-12T19:37:23.344 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:37:23.344 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2024-04-12T19:37:23.344 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-12T19:37:23.344 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-12T19:37:23.344 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-12T19:37:23.344 INFO:teuthology.orchestra.run.smithi131.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-12T19:37:23.344 INFO:teuthology.orchestra.run.smithi131.stdout: acl-2.3.1-4.el9.x86_64 2024-04-12T19:37:23.344 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-12T19:37:23.344 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-12T19:37:23.345 INFO:teuthology.orchestra.run.smithi131.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout: automake-1.16.2-8.el9.noarch 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout: bison-3.7.4-5.el9.x86_64 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:37:23.346 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.347 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-shell-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: cephfs-top-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: flex-2.6.4-9.el9.x86_64 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: jq-1.6-16.el9.x86_64 2024-04-12T19:37:23.348 INFO:teuthology.orchestra.run.smithi131.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-12T19:37:23.349 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-12T19:37:23.349 INFO:teuthology.orchestra.run.smithi131.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-12T19:37:23.349 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.349 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.349 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.349 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-12T19:37:23.349 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-12T19:37:23.349 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-12T19:37:23.349 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-12T19:37:23.349 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-12T19:37:23.349 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: lua-5.4.4-4.el9.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-12T19:37:23.350 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-13.14-1.el9.x86_64 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-12T19:37:23.351 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-12T19:37:23.352 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-12T19:37:23.353 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-12T19:37:23.353 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-12T19:37:23.353 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-12T19:37:23.353 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-12T19:37:23.353 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-12T19:37:23.353 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-12T19:37:23.353 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-12T19:37:23.353 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-12T19:37:23.353 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply-3.11-14.el9.noarch 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-12T19:37:23.354 INFO:teuthology.orchestra.run.smithi131.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-12T19:37:23.355 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.356 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:37:23.357 INFO:teuthology.orchestra.run.smithi131.stdout: re2-1:20211101-3.el9.x86_64 2024-04-12T19:37:23.357 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-12T19:37:23.357 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-12T19:37:23.357 INFO:teuthology.orchestra.run.smithi131.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-12T19:37:23.357 INFO:teuthology.orchestra.run.smithi131.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-12T19:37:23.357 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-12T19:37:23.357 INFO:teuthology.orchestra.run.smithi131.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-12T19:37:23.357 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:37:23.357 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-04-12T19:37:24.101 DEBUG:teuthology.parallel:result is None 2024-04-12T19:37:35.817 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 120/198 2024-04-12T19:37:35.817 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /sys 2024-04-12T19:37:35.818 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /proc 2024-04-12T19:37:35.818 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /mnt 2024-04-12T19:37:35.818 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /var/tmp 2024-04-12T19:37:35.818 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /home 2024-04-12T19:37:35.818 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /root 2024-04-12T19:37:35.818 INFO:teuthology.orchestra.run.smithi171.stdout:skipping the directory /tmp 2024-04-12T19:37:35.818 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:37:36.028 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 121/198 2024-04-12T19:37:36.074 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 121/198 2024-04-12T19:37:36.074 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:36.074 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-04-12T19:37:36.074 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:37:37.656 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 122/198 2024-04-12T19:37:37.752 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 122/198 2024-04-12T19:37:37.752 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:37.752 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-04-12T19:37:37.752 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-12T19:37:37.752 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-04-12T19:37:37.752 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:37:37.998 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 123/198 2024-04-12T19:37:38.071 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 123/198 2024-04-12T19:37:38.072 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:38.072 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-04-12T19:37:38.072 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-12T19:37:38.072 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-04-12T19:37:38.072 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:37:38.558 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 124/198 2024-04-12T19:37:38.634 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 124/198 2024-04-12T19:37:38.634 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:38.634 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-04-12T19:37:38.634 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-12T19:37:38.634 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-04-12T19:37:38.635 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:37:38.775 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : automake-1.16.2-8.el9.noarch 125/198 2024-04-12T19:37:38.839 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-ply-3.11-14.el9.noarch 126/198 2024-04-12T19:37:38.923 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 127/198 2024-04-12T19:37:39.154 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 128/198 2024-04-12T19:37:39.213 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 129/198 2024-04-12T19:37:39.298 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 130/198 2024-04-12T19:37:39.409 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 131/198 2024-04-12T19:37:39.584 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 132/198 2024-04-12T19:37:39.630 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 133/198 2024-04-12T19:37:39.671 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 134/198 2024-04-12T19:37:39.704 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 135/198 2024-04-12T19:37:39.742 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : jq-1.6-16.el9.x86_64 136/198 2024-04-12T19:37:39.774 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : fuse-2.9.9-15.el9.x86_64 137/198 2024-04-12T19:37:40.345 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 138/198 2024-04-12T19:37:40.387 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 138/198 2024-04-12T19:37:40.471 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2879.g324baf8d.e 139/198 2024-04-12T19:37:40.593 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2879.g324baf8d. 140/198 2024-04-12T19:37:40.622 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noa 141/198 2024-04-12T19:37:41.941 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noa 141/198 2024-04-12T19:37:41.983 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.n 142/198 2024-04-12T19:37:43.076 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.n 142/198 2024-04-12T19:37:43.100 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2879.g324 143/198 2024-04-12T19:37:43.243 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2879.g324 143/198 2024-04-12T19:37:43.415 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2879.g324baf8d.el 144/198 2024-04-12T19:37:43.461 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 145/198 2024-04-12T19:37:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 145/198 2024-04-12T19:37:43.542 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:43.542 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-04-12T19:37:43.542 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-12T19:37:43.542 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-04-12T19:37:43.542 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:37:43.603 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 146/198 2024-04-12T19:37:43.641 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 146/198 2024-04-12T19:37:43.774 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-2:19.0.0-2879.g324baf8d.el9.x86_64 147/198 2024-04-12T19:37:48.700 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 148/198 2024-04-12T19:37:48.790 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-test-2:19.0.0-2879.g324baf8d.el9.x86_64 149/198 2024-04-12T19:37:49.771 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libtool-2.4.6-45.el9.x86_64 150/198 2024-04-12T19:37:49.821 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 151/198 2024-04-12T19:37:49.891 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 151/198 2024-04-12T19:37:49.891 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:49.891 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-04-12T19:37:49.891 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-12T19:37:49.891 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-04-12T19:37:49.891 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:37:49.939 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2879.g324ba 152/198 2024-04-12T19:37:50.006 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2879.g324ba 152/198 2024-04-12T19:37:50.007 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:50.007 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-04-12T19:37:50.007 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:37:50.082 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 153/198 2024-04-12T19:37:50.160 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 153/198 2024-04-12T19:37:50.160 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:50.160 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-04-12T19:37:50.160 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-12T19:37:50.160 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-04-12T19:37:50.160 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:37:50.524 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 154/198 2024-04-12T19:37:50.604 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 154/198 2024-04-12T19:37:50.605 INFO:teuthology.orchestra.run.smithi171.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-04-12T19:37:50.605 INFO:teuthology.orchestra.run.smithi171.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-04-12T19:37:50.605 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-12T19:37:50.605 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-04-12T19:37:50.605 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:37:50.651 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 155/198 2024-04-12T19:37:50.683 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : rbd-nbd-2:19.0.0-2879.g324baf8d.el9.x86_64 156/198 2024-04-12T19:37:50.722 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 157/198 2024-04-12T19:37:50.986 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-shell-2:19.0.0-2879.g324baf8d.el9.x86_64 158/198 2024-04-12T19:37:51.297 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 159/198 2024-04-12T19:37:51.370 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-04-12T19:37:51.477 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-04-12T19:37:51.528 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-04-12T19:37:51.570 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libcephfs-devel-2:19.0.0-2879.g324baf8d.el9.x86_ 163/198 2024-04-12T19:37:51.620 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-04-12T19:37:51.670 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-team-1:1.47.4-1.el9.x86_64 165/198 2024-04-12T19:37:51.758 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : NetworkManager-tui-1:1.47.4-1.el9.x86_64 166/198 2024-04-12T19:37:51.876 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-04-12T19:37:51.914 INFO:teuthology.orchestra.run.smithi171.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-04-12T19:37:52.776 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-12T19:37:52.829 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-12T19:37:52.895 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 169/198 2024-04-12T19:37:54.280 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : cephfs-top-2:19.0.0-2879.g324baf8d.el9.noarch 170/198 2024-04-12T19:37:54.400 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-04-12T19:37:54.513 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : flex-2.6.4-9.el9.x86_64 172/198 2024-04-12T19:37:54.556 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : bison-3.7.4-5.el9.x86_64 173/198 2024-04-12T19:37:54.582 INFO:teuthology.orchestra.run.smithi171.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 174/198 2024-04-12T19:37:54.607 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-04-12T19:37:54.642 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-04-12T19:37:54.685 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-04-12T19:37:54.685 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-12T19:37:54.890 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-04-12T19:37:54.939 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-04-12T19:37:54.939 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-12T19:37:55.078 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-04-12T19:37:55.128 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-04-12T19:37:55.178 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-04-12T19:37:55.218 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-04-12T19:37:55.251 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-04-12T19:37:55.305 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-04-12T19:37:55.372 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-04-12T19:37:55.439 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-04-12T19:37:55.474 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-04-12T19:37:55.508 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-04-12T19:37:55.541 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-04-12T19:37:55.575 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-04-12T19:37:55.612 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-12T19:37:55.612 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-12T19:37:55.950 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-04-12T19:37:55.950 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-12T19:37:56.098 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-04-12T19:37:56.129 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-04-12T19:37:56.184 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-04-12T19:37:56.228 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-04-12T19:37:56.280 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-04-12T19:37:56.400 INFO:teuthology.orchestra.run.smithi171.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-12T19:37:56.648 INFO:teuthology.orchestra.run.smithi171.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-04-12T19:37:56.649 INFO:teuthology.orchestra.run.smithi171.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-04-12T19:37:56.649 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:02.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-2:19.0.0-2879.g324baf8d.el9.x86_64 1/198 2024-04-12T19:38:02.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 2/198 2024-04-12T19:38:02.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 3/198 2024-04-12T19:38:02.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 4/198 2024-04-12T19:38:02.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2879.g324ba 5/198 2024-04-12T19:38:02.312 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 6/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 7/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 8/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 9/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 10/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 11/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-test-2:19.0.0-2879.g324baf8d.el9.x86_64 12/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 13/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-shell-2:19.0.0-2879.g324baf8d.el9.x86_64 14/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs-devel-2:19.0.0-2879.g324baf8d.el9.x86_ 15/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 16/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 17/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados-devel-2:19.0.0-2879.g324baf8d.el9.x86_6 18/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86 19/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 20/198 2024-04-12T19:38:02.313 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2879.g324baf8d.el 21/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ceph-common-2:19.0.0-2879.g324baf8d.el9. 22/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cephfs-2:19.0.0-2879.g324baf8d.el9.x86_6 23/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rados-2:19.0.0-2879.g324baf8d.el9.x86_64 24/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rbd-2:19.0.0-2879.g324baf8d.el9.x86_64 25/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rgw-2:19.0.0-2879.g324baf8d.el9.x86_64 26/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 27/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 28/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : rbd-nbd-2:19.0.0-2879.g324baf8d.el9.x86_64 29/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2879.g324baf8d. 30/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noa 31/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.n 32/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2879.g324 33/198 2024-04-12T19:38:02.314 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2879.g324baf8d.el 34/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 35/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2879.g324baf8d.e 36/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 37/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 38/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : cephfs-top-2:19.0.0-2879.g324baf8d.el9.noarch 39/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 40/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 41/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : jq-1.6-16.el9.x86_64 42/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 43/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 44/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 45/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/198 2024-04-12T19:38:02.315 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 51/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : automake-1.16.2-8.el9.noarch 52/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : bison-3.7.4-5.el9.x86_64 53/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 54/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 55/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flex-2.6.4-9.el9.x86_64 56/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 57/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 58/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 59/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 60/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 61/198 2024-04-12T19:38:02.316 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 62/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 63/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 64/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 65/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 66/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-5.4.4-4.el9.x86_64 67/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 68/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 69/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 70/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-13.14-1.el9.x86_64 71/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 72/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 73/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 74/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 75/198 2024-04-12T19:38:02.317 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 76/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 77/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 78/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 79/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/198 2024-04-12T19:38:02.318 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 100/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 102/198 2024-04-12T19:38:02.319 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/198 2024-04-12T19:38:02.320 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 104/198 2024-04-12T19:38:02.320 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-04-12T19:38:02.320 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-04-12T19:38:02.320 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-04-12T19:38:02.320 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-04-12T19:38:02.320 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-04-12T19:38:02.320 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-04-12T19:38:02.320 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-04-12T19:38:02.320 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-04-12T19:38:02.320 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-04-12T19:38:02.320 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-google-auth-1:2.28.2-1.el9.noarch 124/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-04-12T19:38:02.321 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-04-12T19:38:02.322 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-04-12T19:38:02.322 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-04-12T19:38:02.322 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-04-12T19:38:02.322 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-04-12T19:38:02.322 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-04-12T19:38:02.322 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-04-12T19:38:02.322 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-04-12T19:38:02.322 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-04-12T19:38:02.322 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-04-12T19:38:02.322 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-04-12T19:38:02.322 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-04-12T19:38:02.322 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 151/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 153/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 155/198 2024-04-12T19:38:02.323 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 156/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 157/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 158/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 159/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 160/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 162/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : acl-2.3.1-4.el9.x86_64 163/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : acl-2.3.1-3.el9.x86_64 164/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 165/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 166/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 167/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 168/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 169/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 170/198 2024-04-12T19:38:02.324 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 171/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 172/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 173/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 174/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 175/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 176/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 177/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 178/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 179/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 180/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 181/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 182/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 183/198 2024-04-12T19:38:02.325 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 184/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 185/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 186/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 187/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 188/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 189/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 190/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 191/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 192/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 193/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 194/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-04-12T19:38:02.326 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-04-12T19:38:04.978 INFO:teuthology.orchestra.run.smithi171.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-04-12T19:38:04.978 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:04.978 INFO:teuthology.orchestra.run.smithi171.stdout:Upgraded: 2024-04-12T19:38:04.978 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-1:1.47.4-1.el9.x86_64 2024-04-12T19:38:04.978 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 2024-04-12T19:38:04.978 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-team-1:1.47.4-1.el9.x86_64 2024-04-12T19:38:04.978 INFO:teuthology.orchestra.run.smithi171.stdout: NetworkManager-tui-1:1.47.4-1.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: acl-2.3.1-4.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: libacl-2.3.1-4.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: libblkid-2.37.4-18.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: libmount-2.37.4-18.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: librados2-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: librbd1-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-04-12T19:38:04.979 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-2.37.4-18.el9.x86_64 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-2.37.4-18.el9.x86_64 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout:Installed: 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout: automake-1.16.2-8.el9.noarch 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout: bison-3.7.4-5.el9.x86_64 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-04-12T19:38:04.980 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-grafana-dashboards-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-immutable-object-cache-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mds-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-rook-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:38:04.981 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mon-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-osd-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-prometheus-alerts-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-radosgw-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-selinux-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-test-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-volume-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: cephadm-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-shell-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: cephfs-top-2:19.0.0-2879.g324baf8d.el9.noarch 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: flex-2.6.4-9.el9.x86_64 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-04-12T19:38:04.982 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-04-12T19:38:04.983 INFO:teuthology.orchestra.run.smithi171.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-04-12T19:38:04.983 INFO:teuthology.orchestra.run.smithi171.stdout: fuse-2.9.9-15.el9.x86_64 2024-04-12T19:38:04.983 INFO:teuthology.orchestra.run.smithi171.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-04-12T19:38:04.983 INFO:teuthology.orchestra.run.smithi171.stdout: grpc-data-1.46.7-10.el9.noarch 2024-04-12T19:38:04.983 INFO:teuthology.orchestra.run.smithi171.stdout: jq-1.6-16.el9.x86_64 2024-04-12T19:38:04.983 INFO:teuthology.orchestra.run.smithi171.stdout: libaio-devel-0.3.112-1.el8.x86_64 2024-04-12T19:38:04.983 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-9.0.0-10.el9.x86_64 2024-04-12T19:38:04.983 INFO:teuthology.orchestra.run.smithi171.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-04-12T19:38:04.983 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-devel-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.983 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs2-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.983 INFO:teuthology.orchestra.run.smithi171.stdout: libcephsqlite-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.983 INFO:teuthology.orchestra.run.smithi171.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: liboath-2.6.7-2.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: librados-devel-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: libradosstriper1-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: librgw2-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: libtool-2.4.6-45.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: libunwind-1.6.2-1.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-04-12T19:38:04.984 INFO:teuthology.orchestra.run.smithi171.stdout: lua-5.4.4-4.el9.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: luarocks-3.9.2-1.el9.noarch 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-0.3.21-2.el9.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-13.14-1.el9.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: postgresql-server-13.14-1.el9.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-3.14.0-13.el9.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-04-12T19:38:04.985 INFO:teuthology.orchestra.run.smithi171.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-04-12T19:38:04.986 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel-2.9.1-2.el9.noarch 2024-04-12T19:38:04.986 INFO:teuthology.orchestra.run.smithi171.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-04-12T19:38:04.986 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-04-12T19:38:04.986 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.986 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.986 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cephfs-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.986 INFO:teuthology.orchestra.run.smithi171.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-04-12T19:38:04.986 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-04-12T19:38:04.986 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-04-12T19:38:04.986 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-04-12T19:38:04.986 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-04-12T19:38:04.986 INFO:teuthology.orchestra.run.smithi171.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-google-auth-1:2.28.2-1.el9.noarch 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-04-12T19:38:04.987 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-mako-1.1.4-6.el9.noarch 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-packaging-20.9-5.el9.noarch 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ply-3.11-14.el9.noarch 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-portend-3.1.0-2.el9.noarch 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-04-12T19:38:04.988 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pycparser-2.20-6.el9.noarch 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pytz-2021.1-5.el9.noarch 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rados-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rbd-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-2.25.1-8.el9.noarch 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rgw-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes-2.5.1-5.el9.noarch 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-rsa-4.9-2.el9.noarch 2024-04-12T19:38:04.989 INFO:teuthology.orchestra.run.smithi171.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: python3-toml-0.10.2-6.el9.noarch 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webob-1.8.7-6.el9.noarch 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-24.02.0-1.el9.x86_64 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-fuse-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.990 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-mirror-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.991 INFO:teuthology.orchestra.run.smithi171.stdout: rbd-nbd-2:19.0.0-2879.g324baf8d.el9.x86_64 2024-04-12T19:38:04.991 INFO:teuthology.orchestra.run.smithi171.stdout: re2-1:20211101-3.el9.x86_64 2024-04-12T19:38:04.991 INFO:teuthology.orchestra.run.smithi171.stdout: socat-1.7.4.1-5.el9.x86_64 2024-04-12T19:38:04.991 INFO:teuthology.orchestra.run.smithi171.stdout: thrift-0.15.0-2.el9.x86_64 2024-04-12T19:38:04.991 INFO:teuthology.orchestra.run.smithi171.stdout: uuid-1.6.2-55.el9.x86_64 2024-04-12T19:38:04.991 INFO:teuthology.orchestra.run.smithi171.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-04-12T19:38:04.991 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-04-12T19:38:04.992 INFO:teuthology.orchestra.run.smithi171.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-04-12T19:38:04.992 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:04.992 INFO:teuthology.orchestra.run.smithi171.stdout:Complete! 2024-04-12T19:38:05.686 DEBUG:teuthology.parallel:result is None 2024-04-12T19:38:05.686 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=324baf8ddb91dea46cac50cb535c306115791355 2024-04-12T19:38:05.906 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-12T19:38:05.979 INFO:teuthology.orchestra.run.smithi131.stdout:19.0.0-2879.g324baf8d.el9 2024-04-12T19:38:05.980 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2879.g324baf8d.el9 2024-04-12T19:38:05.980 INFO:teuthology.task.install:The correct ceph version 19.0.0-2879.g324baf8d is installed. 2024-04-12T19:38:05.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=324baf8ddb91dea46cac50cb535c306115791355 2024-04-12T19:38:06.198 DEBUG:teuthology.orchestra.run.smithi171:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-12T19:38:06.256 INFO:teuthology.orchestra.run.smithi171.stdout:19.0.0-2879.g324baf8d.el9 2024-04-12T19:38:06.256 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2879.g324baf8d.el9 2024-04-12T19:38:06.256 INFO:teuthology.task.install:The correct ceph version 19.0.0-2879.g324baf8d is installed. 2024-04-12T19:38:06.258 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-12T19:38:06.259 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:06.259 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-12T19:38:06.363 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:06.364 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-12T19:38:06.445 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-12T19:38:06.445 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:06.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-04-12T19:38:06.540 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-12T19:38:06.622 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:06.622 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-04-12T19:38:06.697 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-12T19:38:06.822 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-12T19:38:06.822 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:06.822 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-12T19:38:06.909 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-12T19:38:07.029 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:07.029 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-12T19:38:07.117 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-12T19:38:07.184 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-12T19:38:07.184 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:07.185 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-04-12T19:38:07.273 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-12T19:38:07.401 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:07.401 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-04-12T19:38:07.472 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-12T19:38:07.579 INFO:teuthology.run_tasks:Running task ceph... 2024-04-12T19:38:07.671 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-12T19:38:07.671 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /var/log/ceph 2024-04-12T19:38:07.679 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2024-04-12T19:38:07.765 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-12T19:38:07.765 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-12T19:38:07.772 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-12T19:38:07.854 INFO:tasks.ceph:Creating extra log directories... 2024-04-12T19:38:07.854 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-12T19:38:07.861 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-12T19:38:07.950 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-12T19:38:07.950 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-12T19:38:07.950 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-12T19:38:07.950 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:07.950 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-12T19:38:07.994 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-12T19:38:08.229 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-12T19:38:08.323 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:08.324 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-12T19:38:08.370 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-12T19:38:08.581 DEBUG:teuthology.orchestra.run.smithi171:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-04-12T19:38:08.654 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-12T19:38:08.654 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-12T19:38:08.654 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524', 'branch': 'wip-vshankar-testing-20240411.061452', 'description': 'fs/snaps/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7653524', 'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing-20240411.061452'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '324baf8ddb91dea46cac50cb535c306115791355'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '324baf8ddb91dea46cac50cb535c306115791355'}}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing-20240411.061452', 'sha1': '324baf8ddb91dea46cac50cb535c306115791355'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 120, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 7105, 'sha1': '324baf8ddb91dea46cac50cb535c306115791355', 'sleep_before_teardown': 0, 'subset': '463/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing-20240411.061452', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '324baf8ddb91dea46cac50cb535c306115791355', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi131.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEunQAr+mGP/HJ4UiBcFPtfWszRJn0NkjvRCdiM2iZAhJ8qjKSWSXfPNO3BbSBEdxwNQWrNrgQb8ewHiwcJvvMU=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNE3b2hN+giYQQr4Tq4s/n48RFH667cMjgJRUH55dHBcTJrQ2wedifR1B7qlqhbjO8uDauGT5qGu5WeKZV+Pe5Y='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'flavor': 'default', 'kdb': True, 'sha1': '3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '324baf8ddb91dea46cac50cb535c306115791355'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability'], 'sha1': '324baf8ddb91dea46cac50cb535c306115791355', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['fs/snaps']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '6c637841c215537a4502385240412f1966e0faab', 'timestamp': '2024-04-12_03:11:38', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-12T19:38:08.655 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-12T19:38:08.662 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-12T19:38:08.710 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m0777 -- /var/run/ceph 2024-04-12T19:38:08.715 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-04-12T19:38:08.808 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:08.808 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-04-12T19:38:08.863 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-12T19:38:08.863 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-04-12T19:38:08.916 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-12T19:38:08.916 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T19:38:08.917 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-04-12T19:38:08.917 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T19:38:08.917 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T19:38:08.917 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-12 19:37:15.401283514 +0000 2024-04-12T19:38:08.917 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-12 19:34:32.437969777 +0000 2024-04-12T19:38:08.917 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-12 19:34:32.437969777 +0000 2024-04-12T19:38:08.917 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-04-12 19:34:32.437969777 +0000 2024-04-12T19:38:08.917 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-12T19:38:09.004 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-12T19:38:09.004 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-12T19:38:09.004 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000352597 s, 1.5 MB/s 2024-04-12T19:38:09.008 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-12T19:38:09.060 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-04-12T19:38:09.108 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-12T19:38:09.109 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T19:38:09.109 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-04-12T19:38:09.109 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T19:38:09.109 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T19:38:09.109 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-12 19:37:15.402283493 +0000 2024-04-12T19:38:09.109 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-12 19:34:33.069956584 +0000 2024-04-12T19:38:09.109 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-12 19:34:33.069956584 +0000 2024-04-12T19:38:09.109 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-04-12 19:34:33.069956584 +0000 2024-04-12T19:38:09.109 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-12T19:38:09.189 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-12T19:38:09.189 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-12T19:38:09.190 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000332912 s, 1.5 MB/s 2024-04-12T19:38:09.192 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-12T19:38:09.245 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-04-12T19:38:09.293 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-12T19:38:09.293 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T19:38:09.294 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 671 Links: 1 2024-04-12T19:38:09.294 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T19:38:09.294 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T19:38:09.294 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-12 19:37:15.402283493 +0000 2024-04-12T19:38:09.294 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-12 19:34:33.681943808 +0000 2024-04-12T19:38:09.295 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-12 19:34:33.681943808 +0000 2024-04-12T19:38:09.295 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-04-12 19:34:33.681943808 +0000 2024-04-12T19:38:09.295 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-12T19:38:09.378 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-12T19:38:09.378 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-12T19:38:09.378 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000312695 s, 1.6 MB/s 2024-04-12T19:38:09.382 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-12T19:38:09.440 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-04-12T19:38:09.491 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-12T19:38:09.491 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T19:38:09.491 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-04-12T19:38:09.491 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T19:38:09.491 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T19:38:09.492 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-04-12 19:37:15.403283472 +0000 2024-04-12T19:38:09.492 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-12 19:34:34.260931722 +0000 2024-04-12T19:38:09.492 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-12 19:34:34.260931722 +0000 2024-04-12T19:38:09.492 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-04-12 19:34:34.260931722 +0000 2024-04-12T19:38:09.492 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-12T19:38:09.581 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-04-12T19:38:09.582 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-04-12T19:38:09.582 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000352606 s, 1.5 MB/s 2024-04-12T19:38:09.586 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-12T19:38:09.642 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-12T19:38:09.642 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:09.643 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-04-12T19:38:09.701 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-12T19:38:09.701 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-04-12T19:38:09.752 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-12T19:38:09.753 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T19:38:09.753 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-04-12T19:38:09.753 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T19:38:09.753 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T19:38:09.753 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-12 19:37:57.075509868 +0000 2024-04-12T19:38:09.753 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-12 19:34:33.087989565 +0000 2024-04-12T19:38:09.754 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-12 19:34:33.087989565 +0000 2024-04-12T19:38:09.754 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-04-12 19:34:33.087989565 +0000 2024-04-12T19:38:09.754 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-12T19:38:09.840 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-12T19:38:09.840 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-12T19:38:09.840 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000412067 s, 1.2 MB/s 2024-04-12T19:38:09.844 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-12T19:38:09.899 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-04-12T19:38:09.944 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-12T19:38:09.944 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T19:38:09.944 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 650 Links: 1 2024-04-12T19:38:09.944 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T19:38:09.945 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T19:38:09.945 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-12 19:37:57.076509849 +0000 2024-04-12T19:38:09.945 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-12 19:34:33.679978369 +0000 2024-04-12T19:38:09.945 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-12 19:34:33.679978369 +0000 2024-04-12T19:38:09.945 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-04-12 19:34:33.679978369 +0000 2024-04-12T19:38:09.945 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-12T19:38:10.069 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-12T19:38:10.070 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-12T19:38:10.070 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000335906 s, 1.5 MB/s 2024-04-12T19:38:10.074 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-12T19:38:10.131 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-04-12T19:38:10.178 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-12T19:38:10.178 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T19:38:10.178 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-04-12T19:38:10.178 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T19:38:10.178 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T19:38:10.178 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-12 19:37:57.076509849 +0000 2024-04-12T19:38:10.178 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-12 19:34:34.275967096 +0000 2024-04-12T19:38:10.178 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-12 19:34:34.275967096 +0000 2024-04-12T19:38:10.178 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-04-12 19:34:34.275967096 +0000 2024-04-12T19:38:10.179 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-12T19:38:10.262 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-12T19:38:10.263 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-12T19:38:10.263 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000343007 s, 1.5 MB/s 2024-04-12T19:38:10.266 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-12T19:38:10.321 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-04-12T19:38:10.372 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-12T19:38:10.373 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-12T19:38:10.373 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 6h/6d Inode: 691 Links: 1 2024-04-12T19:38:10.373 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T19:38:10.373 INFO:teuthology.orchestra.run.smithi171.stdout:Context: system_u:object_r:device_t:s0 2024-04-12T19:38:10.373 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-12 19:37:57.077509830 +0000 2024-04-12T19:38:10.373 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-12 19:34:34.925954802 +0000 2024-04-12T19:38:10.373 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-12 19:34:34.925954802 +0000 2024-04-12T19:38:10.373 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: 2024-04-12 19:34:34.925954802 +0000 2024-04-12T19:38:10.373 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-12T19:38:10.461 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-12T19:38:10.462 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-12T19:38:10.462 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000360611 s, 1.4 MB/s 2024-04-12T19:38:10.466 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-12T19:38:10.518 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-12T19:38:10.518 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-12T19:38:10.518 INFO:tasks.ceph:Generating config... 2024-04-12T19:38:10.520 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-12T19:38:10.520 INFO:tasks.ceph:[client] debug client = 20 2024-04-12T19:38:10.520 INFO:tasks.ceph:[client] debug ms = 1 2024-04-12T19:38:10.520 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-12T19:38:10.520 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-12T19:38:10.520 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-12T19:38:10.520 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-12T19:38:10.520 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-12T19:38:10.520 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-12T19:38:10.520 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-12T19:38:10.521 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-12T19:38:10.521 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-12T19:38:10.521 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-12T19:38:10.521 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-12T19:38:10.522 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-12T19:38:10.522 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-12T19:38:10.522 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-12T19:38:10.522 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-12T19:38:10.522 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-12T19:38:10.522 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-12T19:38:10.522 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-12T19:38:10.522 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-12T19:38:10.522 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-12T19:38:10.522 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-12T19:38:10.522 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-12T19:38:10.522 INFO:tasks.ceph:Setting up mon.a... 2024-04-12T19:38:10.523 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-12T19:38:10.656 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.keyring 2024-04-12T19:38:10.665 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-12T19:38:10.798 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-12T19:38:10.891 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.131'), ('mon.b', '172.21.15.171'), ('mon.c', '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]')] 2024-04-12T19:38:10.892 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.131,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-12T19:38:10.893 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:10.893 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-12T19:38:10.946 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.131 --add b 172.21.15.171 --addv c '[v2:172.21.15.171:3301,v1:172.21.15.171:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:11.099 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:11.099 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: generated fsid 7d934d91-9372-4a63-bf09-7016009c45b3 2024-04-12T19:38:11.099 INFO:teuthology.orchestra.run.smithi131.stdout:setting min_mon_release = quincy 2024-04-12T19:38:11.099 INFO:teuthology.orchestra.run.smithi131.stdout:epoch 0 2024-04-12T19:38:11.100 INFO:teuthology.orchestra.run.smithi131.stdout:fsid 7d934d91-9372-4a63-bf09-7016009c45b3 2024-04-12T19:38:11.100 INFO:teuthology.orchestra.run.smithi131.stdout:last_changed 2024-04-12T19:38:11.100124+0000 2024-04-12T19:38:11.100 INFO:teuthology.orchestra.run.smithi131.stdout:created 2024-04-12T19:38:11.100124+0000 2024-04-12T19:38:11.100 INFO:teuthology.orchestra.run.smithi131.stdout:min_mon_release 17 (quincy) 2024-04-12T19:38:11.100 INFO:teuthology.orchestra.run.smithi131.stdout:election_strategy: 1 2024-04-12T19:38:11.100 INFO:teuthology.orchestra.run.smithi131.stdout:0: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.a 2024-04-12T19:38:11.100 INFO:teuthology.orchestra.run.smithi131.stdout:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-04-12T19:38:11.100 INFO:teuthology.orchestra.run.smithi131.stdout:2: [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] mon.c 2024-04-12T19:38:11.100 INFO:teuthology.orchestra.run.smithi131.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-12T19:38:11.102 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-12T19:38:11.153 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 7d934d91-9372-4a63-bf09-7016009c45b3... 2024-04-12T19:38:11.154 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-12T19:38:11.159 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-12T19:38:11.313 INFO:teuthology.orchestra.run.smithi131.stdout:[global] 2024-04-12T19:38:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: chdir = "" 2024-04-12T19:38:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-12T19:38:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: auth supported = cephx 2024-04-12T19:38:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: filestore xattr use omap = true 2024-04-12T19:38:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: mon clock drift allowed = 1.000 2024-04-12T19:38:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: osd crush chooseleaf type = 0 2024-04-12T19:38:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: auth debug = true 2024-04-12T19:38:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on old message = true 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: ms die on bug = true 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: mon pg warn max object skew = 0 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: # disable pg_autoscaler by default for new pools 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default size = 2 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow primary affinity = true 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd allow pg remap = true 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on legacy crush tunables = false 2024-04-12T19:38:11.315 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on crush straw calc version zero = false 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on no sortbitwise = false 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on osd down out interval zero = false 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: mon warn on too few osds = false 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: mon_allow_pool_size_one = true 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: osd default data pool replay window = 5 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: mon allow pool delete = true 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: mon cluster log file level = debug 2024-04-12T19:38:11.316 INFO:teuthology.orchestra.run.smithi131.stdout: debug asserts on shutdown = true 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: mon health detail to clog = false 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: mon host = "172.21.15.131,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: fsid = 7d934d91-9372-4a63-bf09-7016009c45b3 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout:[osd] 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: osd journal size = 100 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub load threshold = 5.0 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: osd scrub max interval = 600 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: osd mclock profile = high_recovery_ops 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: osd recover clone overlap = true 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: osd recovery max chunk = 1048576 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.317 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug shutdown = true 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug op order = true 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug verify stray on activate = true 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug trim objects = true 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: osd open classes on start = true 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug pg log writeout = true 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: osd deep scrub update digest min age = 30 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: osd map max advance = 10 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: journal zero on create = true 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: filestore ondisk finisher threads = 3 2024-04-12T19:38:11.318 INFO:teuthology.orchestra.run.smithi131.stdout: filestore apply finisher threads = 3 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: bdev debug aio = true 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: osd debug misdirected ops = true 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore block size = 96636764160 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore compression mode = aggressive 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: bluestore fsck on mount = True 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluefs = 20 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: debug bluestore = 20 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: debug osd = 20 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: debug rocksdb = 10 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd backfillfull_ratio = 0.85 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd full ratio = 0.9 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd nearfull ratio = 0.8 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: osd failsafe full ratio = 0.95 2024-04-12T19:38:11.319 INFO:teuthology.orchestra.run.smithi131.stdout: osd objectstore = bluestore 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr] 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: debug mgr = 20 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: mgr/telemetry/nag = false 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout:[mon] 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-12T19:38:11.320 INFO:teuthology.orchestra.run.smithi131.stdout: debug mon = 20 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: debug paxos = 20 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: debug auth = 20 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: mon data avail warn = 5 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: mon mgr mkfs grace = 240 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min pgs per osd = 4 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd reporter subtree level = osd 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: mon osd prime pg temp = true 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: mon reweight min bytes per osd = 10 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: auth mon ticket ttl = 660 # 11m 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: auth service ticket ttl = 240 # 4m 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: # don't complain about insecure global_id in the test suite 2024-04-12T19:38:11.321 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: # 1m isn't quite enough 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: mon_down_mkfs_grace = 2m 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: mon_warn_on_filestore_osds = false 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: mon down mkfs grace = 300 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: mon op complaint time = 120 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout:[client] 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: rgw cache enabled = true 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable ops log = true 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: rgw enable usage log = true 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-12T19:38:11.322 INFO:teuthology.orchestra.run.smithi131.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout: client mount timeout = 600 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout: debug client = 20 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.a] 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.b] 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout:[mon.c] 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout:[mds] 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds = 20 2024-04-12T19:38:11.323 INFO:teuthology.orchestra.run.smithi131.stdout: debug mds balancer = 20 2024-04-12T19:38:11.324 INFO:teuthology.orchestra.run.smithi131.stdout: debug ms = 1 2024-04-12T19:38:11.324 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug frag = True 2024-04-12T19:38:11.324 INFO:teuthology.orchestra.run.smithi131.stdout: mds debug scatterstat = True 2024-04-12T19:38:11.324 INFO:teuthology.orchestra.run.smithi131.stdout: mds op complaint time = 180 2024-04-12T19:38:11.324 INFO:teuthology.orchestra.run.smithi131.stdout: mds verify scatter = True 2024-04-12T19:38:11.324 INFO:teuthology.orchestra.run.smithi131.stdout: osd op complaint time = 180 2024-04-12T19:38:11.324 INFO:teuthology.orchestra.run.smithi131.stdout: rados mon op timeout = 900 2024-04-12T19:38:11.324 INFO:teuthology.orchestra.run.smithi131.stdout: rados osd op timeout = 900 2024-04-12T19:38:11.327 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-04-12T19:38:11.327 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-04-12T19:38:11.327 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-12T19:38:11.328 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-12T19:38:11.329 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.131,172.21.15.171,[v2:172.21.15.171:3301,v1:172.21.15.171:6790]" 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 7d934d91-9372-4a63-bf09-7016009c45b3 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.330 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.331 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-04-12T19:38:11.332 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore compression mode = aggressive 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 20 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 20 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 10 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-12T19:38:11.333 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-04-12T19:38:11.334 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-04-12T19:38:11.335 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: mon down mkfs grace = 300 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: mon op complaint time = 120 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: client mount timeout = 600 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: debug client = 20 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2024-04-12T19:38:11.336 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout:[mds] 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds = 20 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout: debug mds balancer = 20 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug frag = True 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout: mds debug scatterstat = True 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout: mds op complaint time = 180 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout: mds verify scatter = True 2024-04-12T19:38:11.337 INFO:teuthology.orchestra.run.smithi171.stdout: osd op complaint time = 180 2024-04-12T19:38:11.338 INFO:teuthology.orchestra.run.smithi171.stdout: rados mon op timeout = 900 2024-04-12T19:38:11.338 INFO:teuthology.orchestra.run.smithi171.stdout: rados osd op timeout = 900 2024-04-12T19:38:11.369 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-12T19:38:11.370 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-12T19:38:11.515 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-12T19:38:11.515 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:11.515 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-12T19:38:11.564 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:11.564 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-12T19:38:11.610 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T19:38:11.610 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:11.610 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-12T19:38:11.610 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-12T19:38:11.799 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:11.799 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:11.897 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2024-04-12T19:38:11.897 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:11.897 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-12T19:38:11.897 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-12T19:38:12.047 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:12.047 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:12.141 INFO:tasks.ceph:Setting up mon nodes... 2024-04-12T19:38:12.141 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-12T19:38:12.141 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-12T19:38:12.308 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-12T19:38:12.319 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-12T19:38:12.513 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-12T19:38:12.524 INFO:tasks.ceph:Setting up mds nodes... 2024-04-12T19:38:12.524 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-12T19:38:12.706 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-12T19:38:12.715 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-12T19:38:12.809 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-12T19:38:12.990 INFO:teuthology.orchestra.run.smithi131.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-12T19:38:13.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-12T19:38:13.095 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-12T19:38:13.266 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-12T19:38:13.275 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-12T19:38:13.373 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-12T19:38:13.553 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-12T19:38:13.563 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-12T19:38:13.656 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-12T19:38:13.656 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-12T19:38:13.779 INFO:teuthology.orchestra.run.smithi131.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-12T19:38:13.835 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-12T19:38:13.835 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi131.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-12T19:38:13.836 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-12T19:38:13.931 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-12T19:38:13.931 INFO:tasks.ceph:role: osd.0 2024-04-12T19:38:13.931 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T19:38:13.931 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-12T19:38:14.027 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-12T19:38:14.027 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-12T19:38:14.027 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-12T19:38:14.027 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-12T19:38:14.027 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-12T19:38:14.027 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-12T19:38:14.027 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-12T19:38:14.027 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-12T19:38:14.028 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-12T19:38:14.028 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-12T19:38:14.450 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-12T19:38:14.458 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-12T19:38:14.458 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-12T19:38:14.613 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-12T19:38:14.705 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-12T19:38:14.789 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-12T19:38:14.790 INFO:tasks.ceph:role: osd.1 2024-04-12T19:38:14.790 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T19:38:14.790 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-12T19:38:14.877 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-12T19:38:14.878 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-12T19:38:14.878 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-12T19:38:14.878 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-12T19:38:14.878 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-12T19:38:14.878 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-12T19:38:14.878 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-12T19:38:14.878 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-12T19:38:14.878 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-12T19:38:14.878 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-12T19:38:15.232 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-12T19:38:15.238 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-12T19:38:15.238 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-12T19:38:15.369 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-12T19:38:15.451 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-12T19:38:15.528 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-12T19:38:15.528 INFO:tasks.ceph:role: osd.2 2024-04-12T19:38:15.528 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T19:38:15.528 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-12T19:38:15.617 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-12T19:38:15.617 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-12T19:38:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-12T19:38:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-12T19:38:15.618 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-12T19:38:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-12T19:38:15.618 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-12T19:38:15.618 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-12T19:38:15.618 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-12T19:38:15.618 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-12T19:38:16.006 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-12T19:38:16.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-12T19:38:16.012 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-12T19:38:16.164 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-12T19:38:16.265 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-12T19:38:16.362 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-12T19:38:16.362 INFO:tasks.ceph:role: osd.3 2024-04-12T19:38:16.362 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T19:38:16.362 DEBUG:teuthology.orchestra.run.smithi131:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-12T19:38:16.474 INFO:teuthology.orchestra.run.smithi131.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-12T19:38:16.474 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-12T19:38:16.474 INFO:teuthology.orchestra.run.smithi131.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-12T19:38:16.474 INFO:teuthology.orchestra.run.smithi131.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-12T19:38:16.474 INFO:teuthology.orchestra.run.smithi131.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-12T19:38:16.474 INFO:teuthology.orchestra.run.smithi131.stdout: = sunit=0 swidth=0 blks 2024-04-12T19:38:16.474 INFO:teuthology.orchestra.run.smithi131.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-12T19:38:16.474 INFO:teuthology.orchestra.run.smithi131.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-12T19:38:16.474 INFO:teuthology.orchestra.run.smithi131.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-12T19:38:16.474 INFO:teuthology.orchestra.run.smithi131.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-12T19:38:16.887 INFO:teuthology.orchestra.run.smithi131.stdout:Discarding blocks...Done. 2024-04-12T19:38:16.892 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi131.front.sepia.ceph.com -o noatime 2024-04-12T19:38:16.892 DEBUG:teuthology.orchestra.run.smithi131:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-12T19:38:17.029 DEBUG:teuthology.orchestra.run.smithi131:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-12T19:38:17.118 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:17.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:17.262+0000 7f84b8d49640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-12T19:38:17.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:17.262+0000 7f84b8d49640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-12T19:38:17.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:17.262+0000 7f84b8d49640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-12T19:38:17.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:17.262+0000 7f84b8d49640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-12T19:38:17.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:17.262+0000 7f84b8d49640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-12T19:38:17.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:17.266+0000 7f84b8d49640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-12T19:38:20.250 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-12T19:38:20.347 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:20.485 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:20.484+0000 7fc6b8e23640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-12T19:38:20.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:20.485+0000 7fc6b8e23640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-12T19:38:20.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:20.485+0000 7fc6b8e23640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-12T19:38:20.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:20.485+0000 7fc6b8e23640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-12T19:38:20.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:20.485+0000 7fc6b8e23640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-12T19:38:20.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:20.487+0000 7fc6b8e23640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-12T19:38:23.455 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-12T19:38:23.551 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:23.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:23.682+0000 7f9ae5620640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-12T19:38:23.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:23.683+0000 7f9ae5620640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-12T19:38:23.684 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:23.683+0000 7f9ae5620640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-12T19:38:23.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:23.683+0000 7f9ae5620640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-12T19:38:23.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:23.683+0000 7f9ae5620640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-12T19:38:23.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:23.686+0000 7f9ae5620640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-12T19:38:26.900 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-12T19:38:26.998 DEBUG:teuthology.orchestra.run.smithi131:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:27.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:27.133+0000 7f92c320c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-12T19:38:27.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:27.133+0000 7f92c320c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-12T19:38:27.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:27.133+0000 7f92c320c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-12T19:38:27.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:27.133+0000 7f92c320c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-12T19:38:27.134 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:27.133+0000 7f92c320c640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-12T19:38:27.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:27.136+0000 7f92c320c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-12T19:38:30.361 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-12T19:38:30.457 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-12T19:38:30.558 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-12T19:38:30.558 INFO:tasks.ceph:role: osd.4 2024-04-12T19:38:30.558 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-12T19:38:30.558 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-12T19:38:30.656 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-12T19:38:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-12T19:38:30.656 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-12T19:38:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-12T19:38:30.657 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-12T19:38:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-12T19:38:30.657 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-12T19:38:30.657 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-12T19:38:30.657 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-12T19:38:30.657 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-12T19:38:31.074 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-12T19:38:31.080 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-12T19:38:31.080 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-12T19:38:31.224 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-12T19:38:31.323 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-12T19:38:31.413 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-12T19:38:31.413 INFO:tasks.ceph:role: osd.5 2024-04-12T19:38:31.414 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-12T19:38:31.414 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-12T19:38:31.501 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-12T19:38:31.501 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-12T19:38:31.501 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-12T19:38:31.501 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-12T19:38:31.501 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-12T19:38:31.501 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-12T19:38:31.501 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-12T19:38:31.501 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-12T19:38:31.502 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-12T19:38:31.502 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-12T19:38:31.855 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-12T19:38:31.860 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-12T19:38:31.860 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-12T19:38:31.969 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-12T19:38:32.054 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-12T19:38:32.130 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-12T19:38:32.130 INFO:tasks.ceph:role: osd.6 2024-04-12T19:38:32.130 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-12T19:38:32.130 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-12T19:38:32.213 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-12T19:38:32.214 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-12T19:38:32.214 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-12T19:38:32.214 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-12T19:38:32.214 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-12T19:38:32.214 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-12T19:38:32.214 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-12T19:38:32.214 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-12T19:38:32.214 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-12T19:38:32.214 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-12T19:38:32.595 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-12T19:38:32.600 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-12T19:38:32.600 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-12T19:38:32.733 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-12T19:38:32.819 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-12T19:38:32.904 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-12T19:38:32.904 INFO:tasks.ceph:role: osd.7 2024-04-12T19:38:32.904 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-12T19:38:32.904 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-12T19:38:32.994 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-12T19:38:32.994 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-12T19:38:32.995 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-12T19:38:32.995 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-04-12T19:38:32.995 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-12T19:38:32.995 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-12T19:38:32.995 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-12T19:38:32.995 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-04-12T19:38:32.995 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-12T19:38:32.995 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-12T19:38:33.396 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-12T19:38:33.402 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-12T19:38:33.402 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-12T19:38:33.551 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-12T19:38:33.645 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:33.787 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:33.787+0000 7efc4fc11640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-12T19:38:33.788 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:33.788+0000 7efc4fc11640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-12T19:38:33.788 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:33.788+0000 7efc4fc11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-12T19:38:33.788 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:33.788+0000 7efc4fc11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-12T19:38:33.788 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:33.788+0000 7efc4fc11640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-12T19:38:33.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:33.791+0000 7efc4fc11640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-12T19:38:36.757 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-12T19:38:36.856 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:36.992 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:36.992+0000 7f68d80f5640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-12T19:38:36.993 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:36.993+0000 7f68d80f5640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-12T19:38:36.994 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:36.993+0000 7f68d80f5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-12T19:38:36.994 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:36.993+0000 7f68d80f5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-12T19:38:36.994 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:36.993+0000 7f68d80f5640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-12T19:38:36.996 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:36.996+0000 7f68d80f5640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-12T19:38:38.656 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:38:38.664 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:38:39.951 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-12T19:38:40.050 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:40.188 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:40.188+0000 7f4b7380d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-12T19:38:40.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:40.189+0000 7f4b7380d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-12T19:38:40.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:40.189+0000 7f4b7380d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-12T19:38:40.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:40.189+0000 7f4b7380d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-12T19:38:40.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:40.189+0000 7f4b7380d640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-12T19:38:40.191 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:40.191+0000 7f4b7380d640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-12T19:38:43.179 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-12T19:38:43.277 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:43.414 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:43.414+0000 7fd89cf93640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-12T19:38:43.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:43.415+0000 7fd89cf93640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-12T19:38:43.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:43.415+0000 7fd89cf93640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-12T19:38:43.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:43.415+0000 7fd89cf93640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-12T19:38:43.415 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:43.415+0000 7fd89cf93640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-12T19:38:43.417 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:43.417+0000 7fd89cf93640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-12T19:38:46.392 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-12T19:38:46.487 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-12T19:38:46.487 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:46.487 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-12T19:38:46.587 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:46.587 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-12T19:38:46.675 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:46.675 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-12T19:38:46.815 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:46.815 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-12T19:38:46.912 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:46.913 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-12T19:38:47.009 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:47.010 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-12T19:38:47.104 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:47.105 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-12T19:38:47.200 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:47.200 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-12T19:38:47.301 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:47.301 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-12T19:38:47.396 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:47.396 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-12T19:38:47.527 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:47.527 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-12T19:38:47.617 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:47.617 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-12T19:38:47.755 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:47.755 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-12T19:38:47.850 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:47.850 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-12T19:38:47.943 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:47.943 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-12T19:38:47.999 INFO:tasks.ceph:Adding keys to all mons... 2024-04-12T19:38:48.000 DEBUG:teuthology.orchestra.run.smithi131:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-12T19:38:48.006 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-12T19:38:48.084 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.y] 2024-04-12T19:38:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCkjRlmL9dyEhAAQXPGSj0uOErn2UFZPJBOUg== 2024-04-12T19:38:48.084 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.a] 2024-04-12T19:38:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCkjRlmaMUjKhAAlRAlI9+Io5J0DYhsR33IPw== 2024-04-12T19:38:48.084 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.c] 2024-04-12T19:38:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCkjRlmZv4WOxAAYISULw4NyL3KG9qa8dtRng== 2024-04-12T19:38:48.084 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.0] 2024-04-12T19:38:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCpjRlmxHK4DxAA/PDdZ/jIpCIQjIDl2Xvipw== 2024-04-12T19:38:48.084 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.1] 2024-04-12T19:38:48.084 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCsjRlmaur4HBAAS2UausFQK+uidvDZ2d+KuA== 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.2] 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCvjRlmdsvOKBAAoe9YML1arCR4tLhkWKCtCw== 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.3] 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCzjRlmKLEICBAAuEkfotrcFvKKH2jXqP0cdw== 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout:[mgr.x] 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCkjRlmSnekHhAATjQNDaGUd/I37ZCR6qgs2Q== 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.b] 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCljRlm+jrpDxAAO4HBGw9PZP8OcaKF4IU9jw== 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout:[mds.d] 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCljRlmUfULIRAAnJN4oHuKk981t42p4CSgug== 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.4] 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQC5jRlmKF0BLxAAgHj8shkcnYr27bpxDIeEmQ== 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.5] 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQC8jRlmN804OxAAsXeOfkpF6rb403k1U6a2+A== 2024-04-12T19:38:48.085 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.6] 2024-04-12T19:38:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDAjRlmYD9NCxAApdTJs/JoRT3Zxdn6BTm8Gw== 2024-04-12T19:38:48.086 INFO:teuthology.orchestra.run.smithi131.stdout:[osd.7] 2024-04-12T19:38:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQDDjRlmr4bGGBAA33M64zbtUf3TDl55dIq7ug== 2024-04-12T19:38:48.086 INFO:teuthology.orchestra.run.smithi131.stdout:[client.0] 2024-04-12T19:38:48.086 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQCljRlm0FKILhAAJc9t52gsJAFzp5x4NQAg8g== 2024-04-12T19:38:48.097 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.y] 2024-04-12T19:38:48.097 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCkjRlmL9dyEhAAQXPGSj0uOErn2UFZPJBOUg== 2024-04-12T19:38:48.097 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.a] 2024-04-12T19:38:48.097 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCkjRlmaMUjKhAAlRAlI9+Io5J0DYhsR33IPw== 2024-04-12T19:38:48.097 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.c] 2024-04-12T19:38:48.097 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCkjRlmZv4WOxAAYISULw4NyL3KG9qa8dtRng== 2024-04-12T19:38:48.098 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0] 2024-04-12T19:38:48.098 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCpjRlmxHK4DxAA/PDdZ/jIpCIQjIDl2Xvipw== 2024-04-12T19:38:48.098 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1] 2024-04-12T19:38:48.098 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCsjRlmaur4HBAAS2UausFQK+uidvDZ2d+KuA== 2024-04-12T19:38:48.098 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2] 2024-04-12T19:38:48.098 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCvjRlmdsvOKBAAoe9YML1arCR4tLhkWKCtCw== 2024-04-12T19:38:48.098 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3] 2024-04-12T19:38:48.098 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCzjRlmKLEICBAAuEkfotrcFvKKH2jXqP0cdw== 2024-04-12T19:38:48.098 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x] 2024-04-12T19:38:48.098 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCkjRlmSnekHhAATjQNDaGUd/I37ZCR6qgs2Q== 2024-04-12T19:38:48.098 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.b] 2024-04-12T19:38:48.098 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCljRlm+jrpDxAAO4HBGw9PZP8OcaKF4IU9jw== 2024-04-12T19:38:48.099 INFO:teuthology.orchestra.run.smithi171.stdout:[mds.d] 2024-04-12T19:38:48.099 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCljRlmUfULIRAAnJN4oHuKk981t42p4CSgug== 2024-04-12T19:38:48.099 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.4] 2024-04-12T19:38:48.099 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQC5jRlmKF0BLxAAgHj8shkcnYr27bpxDIeEmQ== 2024-04-12T19:38:48.099 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.5] 2024-04-12T19:38:48.099 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQC8jRlmN804OxAAsXeOfkpF6rb403k1U6a2+A== 2024-04-12T19:38:48.099 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.6] 2024-04-12T19:38:48.099 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDAjRlmYD9NCxAApdTJs/JoRT3Zxdn6BTm8Gw== 2024-04-12T19:38:48.099 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.7] 2024-04-12T19:38:48.099 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQDDjRlmr4bGGBAA33M64zbtUf3TDl55dIq7ug== 2024-04-12T19:38:48.099 INFO:teuthology.orchestra.run.smithi171.stdout:[client.0] 2024-04-12T19:38:48.099 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCljRlm0FKILhAAJc9t52gsJAFzp5x4NQAg8g== 2024-04-12T19:38:48.102 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-12T19:38:48.137 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-12T19:38:48.287 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-12T19:38:48.292 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-12T19:38:48.435 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-12T19:38:48.440 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-12T19:38:48.581 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:48.586 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:48.721 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:48.726 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:48.864 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:48.869 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:49.007 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:49.012 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:49.153 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-12T19:38:49.158 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-12T19:38:49.291 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-12T19:38:49.296 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-12T19:38:49.440 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-12T19:38:49.446 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-12T19:38:49.587 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:49.591 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:49.725 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:49.731 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:49.872 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:49.878 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:50.019 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:50.024 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-12T19:38:50.164 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-12T19:38:50.169 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-12T19:38:50.315 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-12T19:38:50.315 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-12T19:38:50.411 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-12T19:38:50.569 DEBUG:teuthology.orchestra.run.smithi131:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-12T19:38:50.653 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-12T19:38:50.753 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-12T19:38:50.908 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-12T19:38:50.981 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-12T19:38:51.073 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-12T19:38:51.228 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-12T19:38:51.309 DEBUG:teuthology.orchestra.run.smithi131:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:51.317 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-12T19:38:51.366 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-12T19:38:51.366 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-12T19:38:51.366 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-12T19:38:51.373 INFO:tasks.ceph.mon.a:Started 2024-04-12T19:38:51.373 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-12T19:38:51.374 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-12T19:38:51.410 INFO:tasks.ceph.mon.b:Started 2024-04-12T19:38:51.410 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-12T19:38:51.411 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-12T19:38:51.417 INFO:tasks.ceph.mon.c:Started 2024-04-12T19:38:51.418 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-12T19:38:51.418 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-12T19:38:51.418 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-12T19:38:51.423 INFO:tasks.ceph.mgr.y:Started 2024-04-12T19:38:51.423 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-12T19:38:51.423 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-12T19:38:51.427 INFO:tasks.ceph.mgr.x:Started 2024-04-12T19:38:51.428 INFO:tasks.ceph:Setting crush tunables to default 2024-04-12T19:38:51.428 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --cluster ceph osd crush tunables default 2024-04-12T19:38:51.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.617+0000 7f1456200640 1 Processor -- start 2024-04-12T19:38:51.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.617+0000 7f1456200640 1 -- start start 2024-04-12T19:38:51.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f1456200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f145014b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:51.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f1456200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 0x7f145006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:51.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f1456200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1450151e40 con 0x7f145014b5e0 2024-04-12T19:38:51.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f1456200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f14500c05d0 con 0x7f14500c6060 2024-04-12T19:38:51.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f1456200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1450151bf0 con 0x7f14500c1500 2024-04-12T19:38:51.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f144fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 0x7f145006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:51.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f144f400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f145014b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:51.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f144f400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f145014b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:37550/0 (socket says 172.21.15.131:37550) 2024-04-12T19:38:51.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f144f400640 1 -- 172.21.15.131:0/2881762426 learned_addr learned my addr 172.21.15.131:0/2881762426 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:38:51.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f144f400640 1 -- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 msgr2=0x7f145014b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-12T19:38:51.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f144f400640 1 -- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 msgr2=0x7f145014b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-12T19:38:51.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f144f400640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f145014b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-12T19:38:51.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f144fe00640 1 -- 172.21.15.131:0/2881762426 >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 msgr2=0x7f145006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-12T19:38:51.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f144fe00640 1 -- 172.21.15.131:0/2881762426 >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 msgr2=0x7f145006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-12T19:38:51.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f144fe00640 1 --2- 172.21.15.131:0/2881762426 >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 0x7f145006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-12T19:38:51.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f144f400640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f145014b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T19:38:51.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.618+0000 7f144fe00640 1 --2- 172.21.15.131:0/2881762426 >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 0x7f145006dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T19:38:51.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.819+0000 7f144fe00640 1 --2- 172.21.15.131:0/2881762426 >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 0x7f145006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:51.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.819+0000 7f144f400640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f145014b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:51.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.820+0000 7f144fe00640 1 -- 172.21.15.131:0/2881762426 >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 msgr2=0x7f145006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-12T19:38:51.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.820+0000 7f144fe00640 1 -- 172.21.15.131:0/2881762426 >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 msgr2=0x7f145006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-12T19:38:51.820 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.820+0000 7f144fe00640 1 --2- 172.21.15.131:0/2881762426 >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 0x7f145006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-12T19:38:51.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.820+0000 7f144fe00640 1 --2- 172.21.15.131:0/2881762426 >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 0x7f145006dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T19:38:51.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.820+0000 7f144f400640 1 -- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 msgr2=0x7f145014b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-12T19:38:51.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.820+0000 7f144f400640 1 -- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 msgr2=0x7f145014b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-12T19:38:51.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.820+0000 7f144f400640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f145014b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-12T19:38:51.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.820+0000 7f144f400640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f145014b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T19:38:51.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.832+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1284535090 0 0) 0x7f1450151e40 con 0x7f145014b5e0 2024-04-12T19:38:51.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.833+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1434003520 con 0x7f145014b5e0 2024-04-12T19:38:51.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.833+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 662142727 0 0) 0x7f1434003520 con 0x7f145014b5e0 2024-04-12T19:38:51.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 msgr2=0x7f145014b0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T19:38:51.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f145014b0a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:51.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 msgr2=0x7f145006dde0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T19:38:51.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 --2- 172.21.15.131:0/2881762426 >> v2:172.21.15.131:3300/0 conn(0x7f14500c6060 0x7f145006dde0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:51.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14500c4e50 con 0x7f145014b5e0 2024-04-12T19:38:51.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f1438001670 con 0x7f145014b5e0 2024-04-12T19:38:51.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 >> v1:172.21.15.171:6789/0 conn(0x7f145014b5e0 legacy=0x7f14500c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:51.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14340039b0 0x7f1434003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:51.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f1434004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:51.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1434004d40 0x7f14340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:51.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f14500c05d0 con 0x7f1434004d40 2024-04-12T19:38:51.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1450151bf0 con 0x7f14340039b0 2024-04-12T19:38:51.835 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.834+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f143400baf0 con 0x7f14500c1500 2024-04-12T19:38:51.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.835+0000 7f1447e00640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f1434004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:51.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.835+0000 7f144f400640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14340039b0 0x7f1434003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:51.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.835+0000 7f144fe00640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1434004d40 0x7f14340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:51.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.836+0000 7f1447e00640 1 -- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14340039b0 msgr2=0x7f1434003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:51.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.836+0000 7f1447e00640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14340039b0 0x7f1434003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:51.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.836+0000 7f1447e00640 1 -- 172.21.15.131:0/2881762426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1434004d40 msgr2=0x7f14340051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:51.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.836+0000 7f1447e00640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1434004d40 0x7f14340051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:51.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.836+0000 7f1447e00640 1 -- 172.21.15.131:0/2881762426 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1434003520 con 0x7f14500c1500 2024-04-12T19:38:51.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.839+0000 7f1447e00640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f1434004800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1438007f80 tx=0x7f1434005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=475b590f5efbbb20 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:51.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.840+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438039070 con 0x7f14500c1500 2024-04-12T19:38:51.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.840+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f143802c990 con 0x7f14500c1500 2024-04-12T19:38:51.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.840+0000 7f144ea00640 1 -- 172.21.15.131:0/2881762426 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438007bb0 con 0x7f14500c1500 2024-04-12T19:38:51.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.842+0000 7f1456200640 1 -- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 msgr2=0x7f1434004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:51.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.842+0000 7f1456200640 1 --2- 172.21.15.131:0/2881762426 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14500c1500 0x7f1434004800 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1438007f80 tx=0x7f1434005830 comp rx=0 tx=0).stop 2024-04-12T19:38:51.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.842+0000 7f144fe00640 1 -- 172.21.15.131:0/2881762426 reap_dead start 2024-04-12T19:38:51.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.842+0000 7f1456200640 1 -- 172.21.15.131:0/2881762426 shutdown_connections 2024-04-12T19:38:51.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.842+0000 7f1456200640 1 -- 172.21.15.131:0/2881762426 >> 172.21.15.131:0/2881762426 conn(0x7f14500a8400 msgr2=0x7f14500a8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:51.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.843+0000 7f1456200640 1 -- 172.21.15.131:0/2881762426 shutdown_connections 2024-04-12T19:38:51.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.843+0000 7f1456200640 1 -- 172.21.15.131:0/2881762426 wait complete. 2024-04-12T19:38:51.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.845+0000 7f1456200640 1 Processor -- start 2024-04-12T19:38:51.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.846+0000 7f1456200640 1 -- start start 2024-04-12T19:38:51.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.847+0000 7f1456200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14500c1500 0x7f14500a97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.847+0000 7f1456200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14500aa1f0 0x7f14501e7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.847+0000 7f1456200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14501e7680 0x7f14500bc820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.847+0000 7f1456200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f14500c5410 con 0x7f14500aa1f0 2024-04-12T19:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.847+0000 7f1456200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1450152120 con 0x7f14500c1500 2024-04-12T19:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.847+0000 7f1456200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f14500c0c10 con 0x7f14501e7680 2024-04-12T19:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.847+0000 7f1447e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14500aa1f0 0x7f14501e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.848+0000 7f1447e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14500aa1f0 0x7f14501e7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52116/0 (socket says 172.21.15.131:52116) 2024-04-12T19:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.848+0000 7f1447e00640 1 -- 172.21.15.131:0/1736876381 learned_addr learned my addr 172.21.15.131:0/1736876381 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.848+0000 7f144fe00640 1 --2- 172.21.15.131:0/1736876381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14501e7680 0x7f14500bc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:51.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.848+0000 7f144f400640 1 --2- 172.21.15.131:0/1736876381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14500c1500 0x7f14500a97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.848+0000 7f1447e00640 1 -- 172.21.15.131:0/1736876381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14501e7680 msgr2=0x7f14500bc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.848+0000 7f1447e00640 1 --2- 172.21.15.131:0/1736876381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14501e7680 0x7f14500bc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.848+0000 7f1447e00640 1 -- 172.21.15.131:0/1736876381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14500c1500 msgr2=0x7f14500a97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.848+0000 7f1447e00640 1 --2- 172.21.15.131:0/1736876381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14500c1500 0x7f14500a97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.848+0000 7f1447e00640 1 -- 172.21.15.131:0/1736876381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14500a9ce0 con 0x7f14500aa1f0 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.848+0000 7f144f400640 1 --2- 172.21.15.131:0/1736876381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14500c1500 0x7f14500a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.849+0000 7f1447e00640 1 --2- 172.21.15.131:0/1736876381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14500aa1f0 0x7f14501e7140 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f143800c1d0 tx=0x7f1438000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.849+0000 7f1447400640 1 -- 172.21.15.131:0/1736876381 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438042020 con 0x7f14500aa1f0 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.849+0000 7f1447400640 1 -- 172.21.15.131:0/1736876381 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1438005270 con 0x7f14500aa1f0 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.849+0000 7f1456200640 1 -- 172.21.15.131:0/1736876381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14501e7ae0 con 0x7f14500aa1f0 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.849+0000 7f1447400640 1 -- 172.21.15.131:0/1736876381 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1438039040 con 0x7f14500aa1f0 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.849+0000 7f1456200640 1 -- 172.21.15.131:0/1736876381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14501ea690 con 0x7f14500aa1f0 2024-04-12T19:38:51.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.850+0000 7f1447400640 1 -- 172.21.15.131:0/1736876381 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1438045020 con 0x7f14500aa1f0 2024-04-12T19:38:51.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.850+0000 7f1447400640 1 -- 172.21.15.131:0/1736876381 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1438034800 con 0x7f14500aa1f0 2024-04-12T19:38:51.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.851+0000 7f1456200640 1 -- 172.21.15.131:0/1736876381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f145004fd50 con 0x7f14500aa1f0 2024-04-12T19:38:51.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.857+0000 7f1447400640 1 -- 172.21.15.131:0/1736876381 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f143804c030 con 0x7f14500aa1f0 2024-04-12T19:38:51.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.937+0000 7f1456200640 1 -- 172.21.15.131:0/1736876381 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f14501e6df0 con 0x7f14500aa1f0 2024-04-12T19:38:51.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.940+0000 7f1447400640 1 -- 172.21.15.131:0/1736876381 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f1438003b10 con 0x7f14500aa1f0 2024-04-12T19:38:51.941 INFO:teuthology.orchestra.run.smithi131.stderr:adjusted tunables profile to default 2024-04-12T19:38:51.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.942+0000 7f1456200640 1 -- 172.21.15.131:0/1736876381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14500aa1f0 msgr2=0x7f14501e7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:51.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.942+0000 7f1456200640 1 --2- 172.21.15.131:0/1736876381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14500aa1f0 0x7f14501e7140 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f143800c1d0 tx=0x7f1438000fe0 comp rx=0 tx=0).stop 2024-04-12T19:38:51.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.942+0000 7f1456200640 1 -- 172.21.15.131:0/1736876381 shutdown_connections 2024-04-12T19:38:51.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.942+0000 7f1456200640 1 --2- 172.21.15.131:0/1736876381 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f14501e7680 0x7f14500bc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:51.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.942+0000 7f1456200640 1 --2- 172.21.15.131:0/1736876381 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14500aa1f0 0x7f14501e7140 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:51.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.942+0000 7f1456200640 1 --2- 172.21.15.131:0/1736876381 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f14500c1500 0x7f14500a97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:51.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.942+0000 7f1456200640 1 -- 172.21.15.131:0/1736876381 >> 172.21.15.131:0/1736876381 conn(0x7f14500a8400 msgr2=0x7f14500a6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:51.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.942+0000 7f1456200640 1 -- 172.21.15.131:0/1736876381 shutdown_connections 2024-04-12T19:38:51.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:51.942+0000 7f1456200640 1 -- 172.21.15.131:0/1736876381 wait complete. 2024-04-12T19:38:51.960 INFO:tasks.ceph:check_enable_crimson: False 2024-04-12T19:38:51.960 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-12T19:38:51.960 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:51.960 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-12T19:38:52.038 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:52.038 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-12T19:38:52.169 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:52.170 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-12T19:38:52.296 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:38:52.296 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-12T19:38:52.374 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:52.374 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-12T19:38:52.428 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:52.428+0000 7fedb843f040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-12T19:38:52.462 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:52.462 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-12T19:38:52.495 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:52.495+0000 7fedb843f040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-12T19:38:52.586 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:52.586 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-12T19:38:52.716 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-12T19:38:52.716 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-12T19:38:52.777 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:52.777+0000 7fd2e1e11040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-12T19:38:52.843 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new a4363c22-a82d-46d3-9a01-3dde8d069198 0 2024-04-12T19:38:52.845 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:52.845+0000 7fd2e1e11040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-12T19:38:53.028 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.028+0000 7f777f600640 1 Processor -- start 2024-04-12T19:38:53.028 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.028+0000 7f777f600640 1 -- start start 2024-04-12T19:38:53.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.029+0000 7f777f600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f777814b380 0x7f7778155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.029+0000 7f777f600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77780c0a20 0x7f77780c1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.029+0000 7f777f600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777814b760 con 0x7f77780c1840 2024-04-12T19:38:53.030 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.029+0000 7f777f600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f77780c4760 con 0x7f777814b380 2024-04-12T19:38:53.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.029+0000 7f777f600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7778154600 con 0x7f77780c0a20 2024-04-12T19:38:53.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.030+0000 7f7777e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77780c0a20 0x7f77780c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.030+0000 7f777d600640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f77780c1840 0x7f777806d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:40072/0 (socket says 172.21.15.171:40072) 2024-04-12T19:38:53.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.030+0000 7f777d600640 1 -- 172.21.15.171:0/553381598 learned_addr learned my addr 172.21.15.171:0/553381598 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-12T19:38:53.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.030+0000 7f777cc00640 1 --2- 172.21.15.171:0/553381598 >> v2:172.21.15.131:3300/0 conn(0x7f777814b380 0x7f7778155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.030+0000 7f7777e00640 1 -- 172.21.15.171:0/553381598 >> v2:172.21.15.131:3300/0 conn(0x7f777814b380 msgr2=0x7f7778155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:53.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.030+0000 7f7777e00640 1 --2- 172.21.15.171:0/553381598 >> v2:172.21.15.131:3300/0 conn(0x7f777814b380 0x7f7778155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.030+0000 7f7777e00640 1 -- 172.21.15.171:0/553381598 >> v1:172.21.15.171:6789/0 conn(0x7f77780c1840 legacy=0x7f777806d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.030+0000 7f7777e00640 1 -- 172.21.15.171:0/553381598 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77780c3af0 con 0x7f77780c0a20 2024-04-12T19:38:53.031 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.030+0000 7f7777400640 1 -- 172.21.15.171:0/553381598 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3212492071 0 0) 0x7f7770001490 con 0x7f77780c1840 2024-04-12T19:38:53.032 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.031+0000 7f7777e00640 1 --2- 172.21.15.171:0/553381598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77780c0a20 0x7f77780c1300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f77640097a0 tx=0x7f776402b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ee41f0211cf41311 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:53.032 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.031+0000 7f7777400640 1 -- 172.21.15.171:0/553381598 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77640315a0 con 0x7f77780c0a20 2024-04-12T19:38:53.032 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.031+0000 7f7777400640 1 -- 172.21.15.171:0/553381598 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7764037070 con 0x7f77780c0a20 2024-04-12T19:38:53.032 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.031+0000 7f7777400640 1 -- 172.21.15.171:0/553381598 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7764031960 con 0x7f77780c0a20 2024-04-12T19:38:53.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.032+0000 7f777f600640 1 -- 172.21.15.171:0/553381598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77780c0a20 msgr2=0x7f77780c1300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.032+0000 7f777f600640 1 --2- 172.21.15.171:0/553381598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77780c0a20 0x7f77780c1300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f77640097a0 tx=0x7f776402b840 comp rx=0 tx=0).stop 2024-04-12T19:38:53.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.032+0000 7f777f600640 1 -- 172.21.15.171:0/553381598 shutdown_connections 2024-04-12T19:38:53.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.032+0000 7f777f600640 1 --2- 172.21.15.171:0/553381598 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77780c0a20 0x7f77780c1300 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.032+0000 7f777f600640 1 --2- 172.21.15.171:0/553381598 >> v2:172.21.15.131:3300/0 conn(0x7f777814b380 0x7f7778155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.032+0000 7f777f600640 1 -- 172.21.15.171:0/553381598 >> 172.21.15.171:0/553381598 conn(0x7f77780a8490 msgr2=0x7f77780a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:53.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.032+0000 7f777f600640 1 -- 172.21.15.171:0/553381598 shutdown_connections 2024-04-12T19:38:53.033 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.032+0000 7f777f600640 1 -- 172.21.15.171:0/553381598 wait complete. 2024-04-12T19:38:53.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.034+0000 7f777f600640 1 Processor -- start 2024-04-12T19:38:53.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.034+0000 7f777f600640 1 -- start start 2024-04-12T19:38:53.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.035+0000 7f777f600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77780c1840 0x7f77781ea4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.035+0000 7f777f600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777814b380 0x7f77781e5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.035+0000 7f777f600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f777814e690 0x7f77780abc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.035+0000 7f777f600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7778155590 con 0x7f77780c1840 2024-04-12T19:38:53.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.035+0000 7f777f600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7778152020 con 0x7f777814b380 2024-04-12T19:38:53.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.035+0000 7f777f600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7778154850 con 0x7f777814e690 2024-04-12T19:38:53.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.035+0000 7f7777e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777814b380 0x7f77781e5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.035+0000 7f777d600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f777814e690 0x7f77780abc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.035+0000 7f7777e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777814b380 0x7f77781e5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:34710/0 (socket says 172.21.15.171:34710) 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.035+0000 7f777d600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f777814e690 0x7f77780abc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:38088/0 (socket says 172.21.15.171:38088) 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.035+0000 7f7777e00640 1 -- 172.21.15.171:0/209463699 learned_addr learned my addr 172.21.15.171:0/209463699 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f777cc00640 1 --2- 172.21.15.171:0/209463699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77780c1840 0x7f77781ea4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f777d600640 1 -- 172.21.15.171:0/209463699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777814b380 msgr2=0x7f77781e5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f777d600640 1 --2- 172.21.15.171:0/209463699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777814b380 0x7f77781e5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f777d600640 1 -- 172.21.15.171:0/209463699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77780c1840 msgr2=0x7f77781ea4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f777d600640 1 --2- 172.21.15.171:0/209463699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77780c1840 0x7f77781ea4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f777d600640 1 -- 172.21.15.171:0/209463699 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77781e9410 con 0x7f777814e690 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f7777e00640 1 --2- 172.21.15.171:0/209463699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777814b380 0x7f77781e5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f777cc00640 1 --2- 172.21.15.171:0/209463699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77780c1840 0x7f77781ea4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f777d600640 1 --2- 172.21.15.171:0/209463699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f777814e690 0x7f77780abc80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7778075340 tx=0x7f777000cbe0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f7774c00640 1 -- 172.21.15.171:0/209463699 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7770018070 con 0x7f777814e690 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f7774c00640 1 -- 172.21.15.171:0/209463699 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7770004d60 con 0x7f777814e690 2024-04-12T19:38:53.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f7774c00640 1 -- 172.21.15.171:0/209463699 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f777000a850 con 0x7f777814e690 2024-04-12T19:38:53.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.036+0000 7f777f600640 1 -- 172.21.15.171:0/209463699 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77781e96f0 con 0x7f777814e690 2024-04-12T19:38:53.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.037+0000 7f777f600640 1 -- 172.21.15.171:0/209463699 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f77781e9cb0 con 0x7f777814e690 2024-04-12T19:38:53.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.037+0000 7f7774c00640 1 -- 172.21.15.171:0/209463699 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f777000a9f0 con 0x7f777814e690 2024-04-12T19:38:53.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.037+0000 7f7774c00640 1 -- 172.21.15.171:0/209463699 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f7770012400 con 0x7f777814e690 2024-04-12T19:38:53.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.038+0000 7f777f600640 1 -- 172.21.15.171:0/209463699 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f777804fd50 con 0x7f777814e690 2024-04-12T19:38:53.041 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.041+0000 7f7774c00640 1 -- 172.21.15.171:0/209463699 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f777814b760 con 0x7f777814e690 2024-04-12T19:38:53.090 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:53.090+0000 7fedb843f040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-12T19:38:53.119 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.119+0000 7f777f600640 1 -- 172.21.15.171:0/209463699 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a4363c22-a82d-46d3-9a01-3dde8d069198", "id": 0} v 0) -- 0x7f77781533a0 con 0x7f777814e690 2024-04-12T19:38:53.126 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.126+0000 7f7774c00640 1 -- 172.21.15.171:0/209463699 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a4363c22-a82d-46d3-9a01-3dde8d069198", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f7770007990 con 0x7f777814e690 2024-04-12T19:38:53.127 INFO:teuthology.orchestra.run.smithi171.stdout:0 2024-04-12T19:38:53.128 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.128+0000 7f777f600640 1 -- 172.21.15.171:0/209463699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f777814e690 msgr2=0x7f77780abc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.128+0000 7f777f600640 1 --2- 172.21.15.171:0/209463699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f777814e690 0x7f77780abc80 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f7778075340 tx=0x7f777000cbe0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.128+0000 7f777f600640 1 -- 172.21.15.171:0/209463699 shutdown_connections 2024-04-12T19:38:53.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.128+0000 7f777f600640 1 --2- 172.21.15.171:0/209463699 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f777814b380 0x7f77781e5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.128+0000 7f777f600640 1 --2- 172.21.15.171:0/209463699 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f777814e690 0x7f77780abc80 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.128+0000 7f777f600640 1 --2- 172.21.15.171:0/209463699 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77780c1840 0x7f77781ea4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.128+0000 7f777f600640 1 -- 172.21.15.171:0/209463699 >> 172.21.15.171:0/209463699 conn(0x7f77780a8490 msgr2=0x7f77780c61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:53.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.128+0000 7f777f600640 1 -- 172.21.15.171:0/209463699 shutdown_connections 2024-04-12T19:38:53.129 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.128+0000 7f777f600640 1 -- 172.21.15.171:0/209463699 wait complete. 2024-04-12T19:38:53.146 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 5eca569a-6a51-40af-92bf-9350b3d38127 1 2024-04-12T19:38:53.155 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:53.155+0000 7fedb843f040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-12T19:38:53.207 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:53.207+0000 7fedb843f040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-12T19:38:53.269 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:53.269+0000 7fedb843f040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-12T19:38:53.319 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:53.319+0000 7fedb843f040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-12T19:38:53.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.345+0000 7fa994c00640 1 Processor -- start 2024-04-12T19:38:53.346 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.346+0000 7fa994c00640 1 -- start start 2024-04-12T19:38:53.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.347+0000 7fa994c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa99014b300 0x7fa99006deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.347+0000 7fa994c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9900c55e0 0x7fa99006c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.347+0000 7fa994c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa990151120 con 0x7fa9900c5a60 2024-04-12T19:38:53.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.347+0000 7fa994c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa990152420 con 0x7fa9900c55e0 2024-04-12T19:38:53.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.347+0000 7fa994c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa99006c4a0 con 0x7fa99014b300 2024-04-12T19:38:53.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.347+0000 7fa98f400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa99014b300 0x7fa99006deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.347+0000 7fa98f400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa99014b300 0x7fa99006deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:34726/0 (socket says 172.21.15.171:34726) 2024-04-12T19:38:53.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.347+0000 7fa98f400640 1 -- 172.21.15.171:0/3098265299 learned_addr learned my addr 172.21.15.171:0/3098265299 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-12T19:38:53.348 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.348+0000 7fa987e00640 1 --2- 172.21.15.171:0/3098265299 >> v2:172.21.15.131:3300/0 conn(0x7fa9900c55e0 0x7fa99006c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.348+0000 7fa98f400640 1 -- 172.21.15.171:0/3098265299 >> v2:172.21.15.131:3300/0 conn(0x7fa9900c55e0 msgr2=0x7fa99006c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.348+0000 7fa98f400640 1 --2- 172.21.15.171:0/3098265299 >> v2:172.21.15.131:3300/0 conn(0x7fa9900c55e0 0x7fa99006c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.348+0000 7fa98f400640 1 -- 172.21.15.171:0/3098265299 >> v1:172.21.15.131:6789/0 conn(0x7fa9900c5a60 legacy=0x7fa9901535c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.348+0000 7fa98f400640 1 -- 172.21.15.171:0/3098265299 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa99006be50 con 0x7fa99014b300 2024-04-12T19:38:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.349+0000 7fa98f400640 1 --2- 172.21.15.171:0/3098265299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa99014b300 0x7fa99006deb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa9900757d0 tx=0x7fa98002b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3706731d34c61ac5 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:53.349 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.349+0000 7fa98ea00640 1 -- 172.21.15.171:0/3098265299 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa98002e070 con 0x7fa99014b300 2024-04-12T19:38:53.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.349+0000 7fa98ea00640 1 -- 172.21.15.171:0/3098265299 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa980037070 con 0x7fa99014b300 2024-04-12T19:38:53.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.349+0000 7fa98ea00640 1 -- 172.21.15.171:0/3098265299 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980031a00 con 0x7fa99014b300 2024-04-12T19:38:53.350 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.350+0000 7fa994c00640 1 -- 172.21.15.171:0/3098265299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa99014b300 msgr2=0x7fa99006deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.350+0000 7fa994c00640 1 --2- 172.21.15.171:0/3098265299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa99014b300 0x7fa99006deb0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa9900757d0 tx=0x7fa98002b880 comp rx=0 tx=0).stop 2024-04-12T19:38:53.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.350+0000 7fa994c00640 1 -- 172.21.15.171:0/3098265299 shutdown_connections 2024-04-12T19:38:53.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.350+0000 7fa994c00640 1 --2- 172.21.15.171:0/3098265299 >> v2:172.21.15.131:3300/0 conn(0x7fa9900c55e0 0x7fa99006c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.350+0000 7fa994c00640 1 --2- 172.21.15.171:0/3098265299 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa99014b300 0x7fa99006deb0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.350+0000 7fa994c00640 1 -- 172.21.15.171:0/3098265299 >> 172.21.15.171:0/3098265299 conn(0x7fa9900c3150 msgr2=0x7fa9900c3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:53.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.350+0000 7fa994c00640 1 -- 172.21.15.171:0/3098265299 shutdown_connections 2024-04-12T19:38:53.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.350+0000 7fa994c00640 1 -- 172.21.15.171:0/3098265299 wait complete. 2024-04-12T19:38:53.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.352+0000 7fa994c00640 1 Processor -- start 2024-04-12T19:38:53.352 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.352+0000 7fa994c00640 1 -- start start 2024-04-12T19:38:53.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.353+0000 7fa994c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9900c55e0 0x7fa9900c0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.353+0000 7fa994c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9900c5a60 0x7fa9901e7430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.353+0000 7fa994c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa99014b300 0x7fa99014dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.353+0000 7fa994c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa99006e770 con 0x7fa9900c5a60 2024-04-12T19:38:53.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.353+0000 7fa994c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa99014b6e0 con 0x7fa9900c55e0 2024-04-12T19:38:53.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.353+0000 7fa994c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9900ac4b0 con 0x7fa99014b300 2024-04-12T19:38:53.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.353+0000 7fa98f400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9900c55e0 0x7fa9900c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.353+0000 7fa98f400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9900c55e0 0x7fa9900c0030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:34732/0 (socket says 172.21.15.171:34732) 2024-04-12T19:38:53.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.353+0000 7fa98f400640 1 -- 172.21.15.171:0/2067928032 learned_addr learned my addr 172.21.15.171:0/2067928032 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-12T19:38:53.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.353+0000 7fa98fe00640 1 --2- 172.21.15.171:0/2067928032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa99014b300 0x7fa99014dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.354+0000 7fa987e00640 1 --2- 172.21.15.171:0/2067928032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9900c5a60 0x7fa9901e7430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.354+0000 7fa98f400640 1 -- 172.21.15.171:0/2067928032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa99014b300 msgr2=0x7fa99014dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.354+0000 7fa98f400640 1 --2- 172.21.15.171:0/2067928032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa99014b300 0x7fa99014dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.354+0000 7fa98f400640 1 -- 172.21.15.171:0/2067928032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9900c5a60 msgr2=0x7fa9901e7430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.354+0000 7fa98f400640 1 --2- 172.21.15.171:0/2067928032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9900c5a60 0x7fa9901e7430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.354+0000 7fa98f400640 1 -- 172.21.15.171:0/2067928032 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9901ea0a0 con 0x7fa9900c55e0 2024-04-12T19:38:53.355 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.354+0000 7fa98f400640 1 --2- 172.21.15.171:0/2067928032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9900c55e0 0x7fa9900c0030 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa9800090b0 tx=0x7fa9800046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:53.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.354+0000 7fa987400640 1 -- 172.21.15.171:0/2067928032 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980032880 con 0x7fa9900c55e0 2024-04-12T19:38:53.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.354+0000 7fa987400640 1 -- 172.21.15.171:0/2067928032 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa980032a40 con 0x7fa9900c55e0 2024-04-12T19:38:53.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.354+0000 7fa987400640 1 -- 172.21.15.171:0/2067928032 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa980032e30 con 0x7fa9900c55e0 2024-04-12T19:38:53.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.355+0000 7fa994c00640 1 -- 172.21.15.171:0/2067928032 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9901e6c30 con 0x7fa9900c55e0 2024-04-12T19:38:53.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.355+0000 7fa994c00640 1 -- 172.21.15.171:0/2067928032 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9900c0570 con 0x7fa9900c55e0 2024-04-12T19:38:53.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.355+0000 7fa987400640 1 -- 172.21.15.171:0/2067928032 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa98004c060 con 0x7fa9900c55e0 2024-04-12T19:38:53.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.355+0000 7fa987400640 1 -- 172.21.15.171:0/2067928032 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7fa9800453f0 con 0x7fa9900c55e0 2024-04-12T19:38:53.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.356+0000 7fa994c00640 1 -- 172.21.15.171:0/2067928032 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa99004fd50 con 0x7fa9900c55e0 2024-04-12T19:38:53.359 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.359+0000 7fa987400640 1 -- 172.21.15.171:0/2067928032 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa980040070 con 0x7fa9900c55e0 2024-04-12T19:38:53.440 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.439+0000 7fa994c00640 1 -- 172.21.15.171:0/2067928032 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5eca569a-6a51-40af-92bf-9350b3d38127", "id": 1} v 0) -- 0x7fa9900c62e0 con 0x7fa9900c55e0 2024-04-12T19:38:53.446 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.446+0000 7fa987400640 1 -- 172.21.15.171:0/2067928032 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5eca569a-6a51-40af-92bf-9350b3d38127", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7fa980006020 con 0x7fa9900c55e0 2024-04-12T19:38:53.446 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-04-12T19:38:53.448 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.448+0000 7fa994c00640 1 -- 172.21.15.171:0/2067928032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9900c55e0 msgr2=0x7fa9900c0030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.448 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.448+0000 7fa994c00640 1 --2- 172.21.15.171:0/2067928032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9900c55e0 0x7fa9900c0030 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fa9800090b0 tx=0x7fa9800046c0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.448 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.448+0000 7fa994c00640 1 -- 172.21.15.171:0/2067928032 shutdown_connections 2024-04-12T19:38:53.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.448+0000 7fa994c00640 1 --2- 172.21.15.171:0/2067928032 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa99014b300 0x7fa99014dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.448+0000 7fa994c00640 1 --2- 172.21.15.171:0/2067928032 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa9900c5a60 0x7fa9901e7430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.448+0000 7fa994c00640 1 --2- 172.21.15.171:0/2067928032 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa9900c55e0 0x7fa9900c0030 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.448+0000 7fa994c00640 1 -- 172.21.15.171:0/2067928032 >> 172.21.15.171:0/2067928032 conn(0x7fa9900c3150 msgr2=0x7fa99006c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:53.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.448+0000 7fa994c00640 1 -- 172.21.15.171:0/2067928032 shutdown_connections 2024-04-12T19:38:53.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.448+0000 7fa994c00640 1 -- 172.21.15.171:0/2067928032 wait complete. 2024-04-12T19:38:53.452 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:53.452+0000 7fedb843f040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-12T19:38:53.466 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 59a3d085-e2de-4ac1-9542-ccd13ade76bd 2 2024-04-12T19:38:53.532 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:53.532+0000 7fedb843f040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-12T19:38:53.580 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:53.580+0000 7fd2e1e11040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-12T19:38:53.586 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:53.586+0000 7fedb843f040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-12T19:38:53.646 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:53.646+0000 7fedb843f040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-12T19:38:53.648 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:53.648+0000 7fd2e1e11040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-12T19:38:53.653 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.653+0000 7fa591c00640 1 Processor -- start 2024-04-12T19:38:53.653 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.653+0000 7fa591c00640 1 -- start start 2024-04-12T19:38:53.655 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.654+0000 7fa591c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 0x7fa58c06df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.655 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.654+0000 7fa591c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa58c0ac400 0x7fa58c154b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.655 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.654+0000 7fa591c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa58c155080 0x7fa58c0c5580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.655 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.654+0000 7fa591c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa58c152380 con 0x7fa58c0ac400 2024-04-12T19:38:53.655 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.654+0000 7fa591c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa58c0ac030 con 0x7fa58c155080 2024-04-12T19:38:53.655 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.654+0000 7fa591c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c1518c0 con 0x7fa58c14b2a0 2024-04-12T19:38:53.655 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.654+0000 7fa58be00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 0x7fa58c06df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.655 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.654+0000 7fa58be00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 0x7fa58c06df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:38108/0 (socket says 172.21.15.171:38108) 2024-04-12T19:38:53.655 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.654+0000 7fa58be00640 1 -- 172.21.15.171:0/832932143 learned_addr learned my addr 172.21.15.171:0/832932143 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-12T19:38:53.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.654+0000 7fa591200640 1 --2- 172.21.15.171:0/832932143 >> v2:172.21.15.171:3300/0 conn(0x7fa58c155080 0x7fa58c0c5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.655+0000 7fa58b400640 1 --2- 172.21.15.171:0/832932143 >> v2:172.21.15.131:3300/0 conn(0x7fa58c0ac400 0x7fa58c154b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.655+0000 7fa58be00640 1 -- 172.21.15.171:0/832932143 >> v2:172.21.15.171:3300/0 conn(0x7fa58c155080 msgr2=0x7fa58c0c5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:53.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.655+0000 7fa58be00640 1 --2- 172.21.15.171:0/832932143 >> v2:172.21.15.171:3300/0 conn(0x7fa58c155080 0x7fa58c0c5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.655+0000 7fa58be00640 1 -- 172.21.15.171:0/832932143 >> v2:172.21.15.131:3300/0 conn(0x7fa58c0ac400 msgr2=0x7fa58c154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:53.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.655+0000 7fa58be00640 1 --2- 172.21.15.171:0/832932143 >> v2:172.21.15.131:3300/0 conn(0x7fa58c0ac400 0x7fa58c154b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.655+0000 7fa58be00640 1 -- 172.21.15.171:0/832932143 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c06ce90 con 0x7fa58c14b2a0 2024-04-12T19:38:53.656 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.656+0000 7fa58be00640 1 --2- 172.21.15.171:0/832932143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 0x7fa58c06df40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa58c14e9f0 tx=0x7fa57c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6486b3717cc4a2ab server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:53.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.656+0000 7fa58aa00640 1 -- 172.21.15.171:0/832932143 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c035020 con 0x7fa58c14b2a0 2024-04-12T19:38:53.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.656+0000 7fa58aa00640 1 -- 172.21.15.171:0/832932143 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa57c031640 con 0x7fa58c14b2a0 2024-04-12T19:38:53.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.656+0000 7fa58aa00640 1 -- 172.21.15.171:0/832932143 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa57c02d040 con 0x7fa58c14b2a0 2024-04-12T19:38:53.657 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.657+0000 7fa591c00640 1 -- 172.21.15.171:0/832932143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 msgr2=0x7fa58c06df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.657+0000 7fa591c00640 1 --2- 172.21.15.171:0/832932143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 0x7fa58c06df40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa58c14e9f0 tx=0x7fa57c02b8f0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.657+0000 7fa591c00640 1 -- 172.21.15.171:0/832932143 shutdown_connections 2024-04-12T19:38:53.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.657+0000 7fa591c00640 1 --2- 172.21.15.171:0/832932143 >> v2:172.21.15.171:3300/0 conn(0x7fa58c155080 0x7fa58c0c5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.657+0000 7fa591c00640 1 --2- 172.21.15.171:0/832932143 >> v2:172.21.15.131:3300/0 conn(0x7fa58c0ac400 0x7fa58c154b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.657+0000 7fa591c00640 1 --2- 172.21.15.171:0/832932143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 0x7fa58c06df40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.657+0000 7fa591c00640 1 -- 172.21.15.171:0/832932143 >> 172.21.15.171:0/832932143 conn(0x7fa58c0c30f0 msgr2=0x7fa58c0c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:53.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.657+0000 7fa591c00640 1 -- 172.21.15.171:0/832932143 shutdown_connections 2024-04-12T19:38:53.658 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.657+0000 7fa591c00640 1 -- 172.21.15.171:0/832932143 wait complete. 2024-04-12T19:38:53.659 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.659+0000 7fa591c00640 1 Processor -- start 2024-04-12T19:38:53.659 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.659+0000 7fa591c00640 1 -- start start 2024-04-12T19:38:53.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.659+0000 7fa591c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa58c0ac400 0x7fa58c1ddc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.661 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 0x7fa58c1ea5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58c155080 0x7fa58c150500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c151b20 con 0x7fa58c0ac400 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa58c151e00 con 0x7fa58c155080 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa58c154620 con 0x7fa58c14b2a0 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa58b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 0x7fa58c1ea5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58c155080 0x7fa58c150500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58c155080 0x7fa58c150500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:34752/0 (socket says 172.21.15.171:34752) 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa58b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 0x7fa58c1ea5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:38110/0 (socket says 172.21.15.171:38110) 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591200640 1 -- 172.21.15.171:0/1122079896 learned_addr learned my addr 172.21.15.171:0/1122079896 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa58be00640 1 --2- 172.21.15.171:0/1122079896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa58c0ac400 0x7fa58c1ddc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591200640 1 -- 172.21.15.171:0/1122079896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 msgr2=0x7fa58c1ea5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591200640 1 --2- 172.21.15.171:0/1122079896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 0x7fa58c1ea5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.662 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591200640 1 -- 172.21.15.171:0/1122079896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa58c0ac400 msgr2=0x7fa58c1ddc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591200640 1 --2- 172.21.15.171:0/1122079896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa58c0ac400 0x7fa58c1ddc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.660+0000 7fa591200640 1 -- 172.21.15.171:0/1122079896 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa58c1de170 con 0x7fa58c155080 2024-04-12T19:38:53.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.661+0000 7fa591200640 1 --2- 172.21.15.171:0/1122079896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58c155080 0x7fa58c150500 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa584009d30 tx=0x7fa58400c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:53.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.661+0000 7fa583e00640 1 -- 172.21.15.171:0/1122079896 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584018020 con 0x7fa58c155080 2024-04-12T19:38:53.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.661+0000 7fa583e00640 1 -- 172.21.15.171:0/1122079896 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa584014480 con 0x7fa58c155080 2024-04-12T19:38:53.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.661+0000 7fa591c00640 1 -- 172.21.15.171:0/1122079896 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa58c1e7080 con 0x7fa58c155080 2024-04-12T19:38:53.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.661+0000 7fa583e00640 1 -- 172.21.15.171:0/1122079896 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa584014870 con 0x7fa58c155080 2024-04-12T19:38:53.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.661+0000 7fa591c00640 1 -- 172.21.15.171:0/1122079896 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa58c1e7340 con 0x7fa58c155080 2024-04-12T19:38:53.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.661+0000 7fa583e00640 1 -- 172.21.15.171:0/1122079896 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa584005d10 con 0x7fa58c155080 2024-04-12T19:38:53.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.661+0000 7fa583e00640 1 -- 172.21.15.171:0/1122079896 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa584014da0 con 0x7fa58c155080 2024-04-12T19:38:53.663 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.662+0000 7fa591c00640 1 -- 172.21.15.171:0/1122079896 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa58c068c10 con 0x7fa58c155080 2024-04-12T19:38:53.665 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.665+0000 7fa583e00640 1 -- 172.21.15.171:0/1122079896 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa58c068c10 con 0x7fa58c155080 2024-04-12T19:38:53.702 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:53.703+0000 7fedb843f040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-12T19:38:53.703 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:53.703+0000 7fd2e1e11040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-12T19:38:53.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.745+0000 7fa591c00640 1 -- 172.21.15.171:0/1122079896 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "59a3d085-e2de-4ac1-9542-ccd13ade76bd", "id": 2} v 0) -- 0x7fa58c0b9ef0 con 0x7fa58c155080 2024-04-12T19:38:53.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.753+0000 7fa583e00640 1 -- 172.21.15.171:0/1122079896 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "59a3d085-e2de-4ac1-9542-ccd13ade76bd", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa58c0b9ef0 con 0x7fa58c155080 2024-04-12T19:38:53.753 INFO:teuthology.orchestra.run.smithi171.stdout:2 2024-04-12T19:38:53.755 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.754+0000 7fa591c00640 1 -- 172.21.15.171:0/1122079896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58c155080 msgr2=0x7fa58c150500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.755 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.754+0000 7fa591c00640 1 --2- 172.21.15.171:0/1122079896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58c155080 0x7fa58c150500 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa584009d30 tx=0x7fa58400c490 comp rx=0 tx=0).stop 2024-04-12T19:38:53.755 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.754+0000 7fa591c00640 1 -- 172.21.15.171:0/1122079896 shutdown_connections 2024-04-12T19:38:53.755 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.754+0000 7fa591c00640 1 --2- 172.21.15.171:0/1122079896 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa58c155080 0x7fa58c150500 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.755 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.754+0000 7fa591c00640 1 --2- 172.21.15.171:0/1122079896 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa58c14b2a0 0x7fa58c1ea5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.754+0000 7fa591c00640 1 --2- 172.21.15.171:0/1122079896 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa58c0ac400 0x7fa58c1ddc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.754+0000 7fa591c00640 1 -- 172.21.15.171:0/1122079896 >> 172.21.15.171:0/1122079896 conn(0x7fa58c0c30f0 msgr2=0x7fa58c0c55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:53.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.755+0000 7fa591c00640 1 -- 172.21.15.171:0/1122079896 shutdown_connections 2024-04-12T19:38:53.756 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.755+0000 7fa591c00640 1 -- 172.21.15.171:0/1122079896 wait complete. 2024-04-12T19:38:53.771 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:53.771+0000 7fd2e1e11040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-12T19:38:53.772 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 858f9338-1df7-427e-9636-7f5f839a81dc 3 2024-04-12T19:38:53.826 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:53.826+0000 7fd2e1e11040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-12T19:38:53.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.961+0000 7f92fae00640 1 Processor -- start 2024-04-12T19:38:53.962 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.961+0000 7f92fae00640 1 -- start start 2024-04-12T19:38:53.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.962+0000 7f92fae00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f92f41535c0 0x7f92f41539f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.963+0000 7f92fae00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f4151120 con 0x7f92f414b300 2024-04-12T19:38:53.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.963+0000 7f92fae00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92f406be50 con 0x7f92f406deb0 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.963+0000 7f92fae00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f92f406e330 con 0x7f92f41535c0 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.963+0000 7f92f9000640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f92f406deb0 0x7f92f406c930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:45022/0 (socket says 172.21.15.171:45022) 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.963+0000 7f92f9000640 1 -- 172.21.15.171:0/1987791545 learned_addr learned my addr 172.21.15.171:0/1987791545 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.963+0000 7f92fa400640 1 --2- 172.21.15.171:0/1987791545 >> v2:172.21.15.131:3300/0 conn(0x7f92f41535c0 0x7f92f41539f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.963+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814240898 0 0) 0x7f92f406be50 con 0x7f92f406deb0 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.963+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92dc003520 con 0x7f92f406deb0 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1239393366 0 0) 0x7f92dc003520 con 0x7f92f406deb0 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 >> v2:172.21.15.131:3300/0 conn(0x7f92f41535c0 msgr2=0x7f92f41539f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 --2- 172.21.15.171:0/1987791545 >> v2:172.21.15.131:3300/0 conn(0x7f92f41535c0 0x7f92f41539f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 >> v1:172.21.15.131:6789/0 conn(0x7f92f414b300 legacy=0x7f92f40c55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f406c130 con 0x7f92f406deb0 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f92e0001670 con 0x7f92f406deb0 2024-04-12T19:38:53.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 >> v1:172.21.15.171:6789/0 conn(0x7f92f406deb0 legacy=0x7f92f406c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 --2- 172.21.15.171:0/1987791545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc0039b0 0x7f92dc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 --2- 172.21.15.171:0/1987791545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92dc004800 0x7f92dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 --2- 172.21.15.171:0/1987791545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92dc0051c0 0x7f92dc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f92f406e330 con 0x7f92dc004800 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc00c160 con 0x7f92dc0039b0 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f92dc00c360 con 0x7f92dc0051c0 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92f9a00640 1 --2- 172.21.15.171:0/1987791545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc0039b0 0x7f92dc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.964+0000 7f92fa400640 1 --2- 172.21.15.171:0/1987791545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92dc0051c0 0x7f92dc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.965+0000 7f92f9000640 1 --2- 172.21.15.171:0/1987791545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92dc004800 0x7f92dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.965+0000 7f92f9a00640 1 -- 172.21.15.171:0/1987791545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92dc0051c0 msgr2=0x7f92dc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.965+0000 7f92f9a00640 1 --2- 172.21.15.171:0/1987791545 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92dc0051c0 0x7f92dc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.965+0000 7f92f9a00640 1 -- 172.21.15.171:0/1987791545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92dc004800 msgr2=0x7f92dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.965+0000 7f92f9a00640 1 --2- 172.21.15.171:0/1987791545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92dc004800 0x7f92dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.965+0000 7f92f9a00640 1 -- 172.21.15.171:0/1987791545 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc003520 con 0x7f92dc0039b0 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.965+0000 7f92f9000640 1 --2- 172.21.15.171:0/1987791545 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92dc004800 0x7f92dc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:38:53.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.965+0000 7f92fa400640 1 -- 172.21.15.171:0/1987791545 reap_dead start 2024-04-12T19:38:53.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.966+0000 7f92f9a00640 1 --2- 172.21.15.171:0/1987791545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc0039b0 0x7f92dc003dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f92e8001750 tx=0x7f92dc005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=970128c93e38d72 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:53.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.966+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8001370 con 0x7f92dc0039b0 2024-04-12T19:38:53.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.966+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e80052d0 con 0x7f92dc0039b0 2024-04-12T19:38:53.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.966+0000 7f92f3e00640 1 -- 172.21.15.171:0/1987791545 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8003830 con 0x7f92dc0039b0 2024-04-12T19:38:53.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.967+0000 7f92fae00640 1 -- 172.21.15.171:0/1987791545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc0039b0 msgr2=0x7f92dc003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.967+0000 7f92fae00640 1 --2- 172.21.15.171:0/1987791545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc0039b0 0x7f92dc003dd0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f92e8001750 tx=0x7f92dc005830 comp rx=0 tx=0).stop 2024-04-12T19:38:53.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.967+0000 7f92fae00640 1 -- 172.21.15.171:0/1987791545 shutdown_connections 2024-04-12T19:38:53.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.967+0000 7f92fae00640 1 --2- 172.21.15.171:0/1987791545 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92dc0039b0 0x7f92dc003dd0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.967+0000 7f92fae00640 1 -- 172.21.15.171:0/1987791545 >> 172.21.15.171:0/1987791545 conn(0x7f92f40c3150 msgr2=0x7f92f40c3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:53.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.967+0000 7f92fae00640 1 -- 172.21.15.171:0/1987791545 shutdown_connections 2024-04-12T19:38:53.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.967+0000 7f92fae00640 1 -- 172.21.15.171:0/1987791545 wait complete. 2024-04-12T19:38:53.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.968+0000 7f92fae00640 1 Processor -- start 2024-04-12T19:38:53.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.969+0000 7f92fae00640 1 -- start start 2024-04-12T19:38:53.970 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:53.969+0000 7fd2e1e11040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-12T19:38:53.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.969+0000 7f92fae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92dc0039b0 0x7f92f40aacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.972 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92fae00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92f40c0410 0x7f92f40b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92fae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92f40c0870 0x7f92f40b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92fae00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f92f406c4a0 con 0x7f92f40c0870 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92fae00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f92f414b6e0 con 0x7f92f40c0410 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92fae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f92f40ac4b0 con 0x7f92dc0039b0 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92f9a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92dc0039b0 0x7f92f40aacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92f9a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92dc0039b0 0x7f92f40aacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:38538/0 (socket says 172.21.15.171:38538) 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92f9a00640 1 -- 172.21.15.171:0/540193069 learned_addr learned my addr 172.21.15.171:0/540193069 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92f9000640 1 --2- 172.21.15.171:0/540193069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92f40c0410 0x7f92f40b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92fa400640 1 --2- 172.21.15.171:0/540193069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92f40c0870 0x7f92f40b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92f9a00640 1 -- 172.21.15.171:0/540193069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92f40c0410 msgr2=0x7f92f40b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92f9a00640 1 --2- 172.21.15.171:0/540193069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92f40c0410 0x7f92f40b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92f9a00640 1 -- 172.21.15.171:0/540193069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92f40c0870 msgr2=0x7f92f40b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92f9a00640 1 --2- 172.21.15.171:0/540193069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92f40c0870 0x7f92f40b8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.970+0000 7f92f9a00640 1 -- 172.21.15.171:0/540193069 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92f40ab200 con 0x7f92dc0039b0 2024-04-12T19:38:53.973 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.971+0000 7f92f9a00640 1 --2- 172.21.15.171:0/540193069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92dc0039b0 0x7f92f40aacc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f92e8005040 tx=0x7f92e8001120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:53.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.971+0000 7f92f1600640 1 -- 172.21.15.171:0/540193069 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8041020 con 0x7f92dc0039b0 2024-04-12T19:38:53.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.971+0000 7f92f1600640 1 -- 172.21.15.171:0/540193069 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f92e8005480 con 0x7f92dc0039b0 2024-04-12T19:38:53.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.971+0000 7f92fae00640 1 -- 172.21.15.171:0/540193069 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92f414e150 con 0x7f92dc0039b0 2024-04-12T19:38:53.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.971+0000 7f92f1600640 1 -- 172.21.15.171:0/540193069 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92e8007a30 con 0x7f92dc0039b0 2024-04-12T19:38:53.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.971+0000 7f92fae00640 1 -- 172.21.15.171:0/540193069 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f92f40b9010 con 0x7f92dc0039b0 2024-04-12T19:38:53.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.971+0000 7f92f1600640 1 -- 172.21.15.171:0/540193069 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f92e8044020 con 0x7f92dc0039b0 2024-04-12T19:38:53.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.971+0000 7f92f1600640 1 -- 172.21.15.171:0/540193069 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f92e803dc20 con 0x7f92dc0039b0 2024-04-12T19:38:53.974 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.972+0000 7f92fae00640 1 -- 172.21.15.171:0/540193069 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92f404fd50 con 0x7f92dc0039b0 2024-04-12T19:38:53.976 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:53.976+0000 7f92f1600640 1 -- 172.21.15.171:0/540193069 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f92e804b030 con 0x7f92dc0039b0 2024-04-12T19:38:54.055 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:54.055+0000 7fd2e1e11040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-12T19:38:54.055 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.055+0000 7f92fae00640 1 -- 172.21.15.171:0/540193069 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "858f9338-1df7-427e-9636-7f5f839a81dc", "id": 3} v 0) -- 0x7f92f40c62e0 con 0x7f92dc0039b0 2024-04-12T19:38:54.063 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.063+0000 7f92f1600640 1 -- 172.21.15.171:0/540193069 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "858f9338-1df7-427e-9636-7f5f839a81dc", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f92e803d790 con 0x7f92dc0039b0 2024-04-12T19:38:54.063 INFO:teuthology.orchestra.run.smithi171.stdout:3 2024-04-12T19:38:54.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.064+0000 7f92fae00640 1 -- 172.21.15.171:0/540193069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92dc0039b0 msgr2=0x7f92f40aacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.064+0000 7f92fae00640 1 --2- 172.21.15.171:0/540193069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92dc0039b0 0x7f92f40aacc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f92e8005040 tx=0x7f92e8001120 comp rx=0 tx=0).stop 2024-04-12T19:38:54.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.064+0000 7f92fae00640 1 -- 172.21.15.171:0/540193069 shutdown_connections 2024-04-12T19:38:54.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.064+0000 7f92fae00640 1 --2- 172.21.15.171:0/540193069 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92f40c0410 0x7f92f40b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.064+0000 7f92fae00640 1 --2- 172.21.15.171:0/540193069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92f40c0870 0x7f92f40b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.064+0000 7f92fae00640 1 --2- 172.21.15.171:0/540193069 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92dc0039b0 0x7f92f40aacc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.064+0000 7f92fae00640 1 -- 172.21.15.171:0/540193069 >> 172.21.15.171:0/540193069 conn(0x7f92f40c3150 msgr2=0x7f92f40c3530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:54.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.065+0000 7f92fae00640 1 -- 172.21.15.171:0/540193069 shutdown_connections 2024-04-12T19:38:54.065 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.065+0000 7f92fae00640 1 -- 172.21.15.171:0/540193069 wait complete. 2024-04-12T19:38:54.082 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 2635fc65-cc14-4d65-b397-b1c7a38770a0 4 2024-04-12T19:38:54.115 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:54.115+0000 7fd2e1e11040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-12T19:38:54.154 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:54.154+0000 7fedb843f040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-12T19:38:54.180 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:54.180+0000 7fd2e1e11040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-12T19:38:54.239 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:54.239+0000 7fd2e1e11040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-12T19:38:54.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.274+0000 7fcc8ae00640 1 Processor -- start 2024-04-12T19:38:54.274 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.274+0000 7fcc8ae00640 1 -- start start 2024-04-12T19:38:54.276 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.275+0000 7fcc8ae00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcc8414b380 0x7fcc84155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.276 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.275+0000 7fcc8ae00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcc840c0a20 0x7fcc840c1300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.276 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.275+0000 7fcc8ae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc840c1840 0x7fcc8406d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.276 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.275+0000 7fcc8ae00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fcc840c4760 con 0x7fcc840c0a20 2024-04-12T19:38:54.276 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.275+0000 7fcc8ae00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fcc84154600 con 0x7fcc8414b380 2024-04-12T19:38:54.276 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.275+0000 7fcc8ae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcc84155590 con 0x7fcc840c1840 2024-04-12T19:38:54.276 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.275+0000 7fcc88e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc840c1840 0x7fcc8406d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.276 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.275+0000 7fcc83e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcc8414b380 0x7fcc84155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.275+0000 7fcc88e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc840c1840 0x7fcc8406d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:38548/0 (socket says 172.21.15.171:38548) 2024-04-12T19:38:54.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.275+0000 7fcc88e00640 1 -- 172.21.15.171:0/3256660044 learned_addr learned my addr 172.21.15.171:0/3256660044 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-12T19:38:54.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.276+0000 7fcc83400640 1 --2- 172.21.15.171:0/3256660044 >> v2:172.21.15.131:3300/0 conn(0x7fcc840c0a20 0x7fcc840c1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.276+0000 7fcc83e00640 1 -- 172.21.15.171:0/3256660044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc840c1840 msgr2=0x7fcc8406d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:54.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.276+0000 7fcc83e00640 1 --2- 172.21.15.171:0/3256660044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc840c1840 0x7fcc8406d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.276+0000 7fcc83e00640 1 -- 172.21.15.171:0/3256660044 >> v2:172.21.15.131:3300/0 conn(0x7fcc840c0a20 msgr2=0x7fcc840c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:54.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.276+0000 7fcc83e00640 1 --2- 172.21.15.171:0/3256660044 >> v2:172.21.15.131:3300/0 conn(0x7fcc840c0a20 0x7fcc840c1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.276+0000 7fcc83e00640 1 -- 172.21.15.171:0/3256660044 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc8414b760 con 0x7fcc8414b380 2024-04-12T19:38:54.277 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.276+0000 7fcc88e00640 1 --2- 172.21.15.171:0/3256660044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc840c1840 0x7fcc8406d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:38:54.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.277+0000 7fcc83e00640 1 --2- 172.21.15.171:0/3256660044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc8414b380 0x7fcc84155050 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcc8406e490 tx=0x7fcc7402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81e839bfe2b000a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:54.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.277+0000 7fcc82a00640 1 -- 172.21.15.171:0/3256660044 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74038070 con 0x7fcc8414b380 2024-04-12T19:38:54.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.277+0000 7fcc82a00640 1 -- 172.21.15.171:0/3256660044 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc74031700 con 0x7fcc8414b380 2024-04-12T19:38:54.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.277+0000 7fcc82a00640 1 -- 172.21.15.171:0/3256660044 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc74031ad0 con 0x7fcc8414b380 2024-04-12T19:38:54.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.278+0000 7fcc8ae00640 1 -- 172.21.15.171:0/3256660044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc8414b380 msgr2=0x7fcc84155050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.279 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.278+0000 7fcc8ae00640 1 --2- 172.21.15.171:0/3256660044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc8414b380 0x7fcc84155050 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fcc8406e490 tx=0x7fcc7402b7a0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.278+0000 7fcc8ae00640 1 -- 172.21.15.171:0/3256660044 shutdown_connections 2024-04-12T19:38:54.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.278+0000 7fcc8ae00640 1 --2- 172.21.15.171:0/3256660044 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc840c1840 0x7fcc8406d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.278+0000 7fcc8ae00640 1 --2- 172.21.15.171:0/3256660044 >> v2:172.21.15.131:3300/0 conn(0x7fcc840c0a20 0x7fcc840c1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.278+0000 7fcc8ae00640 1 --2- 172.21.15.171:0/3256660044 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc8414b380 0x7fcc84155050 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.278+0000 7fcc8ae00640 1 -- 172.21.15.171:0/3256660044 >> 172.21.15.171:0/3256660044 conn(0x7fcc840a8490 msgr2=0x7fcc840a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:54.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.278+0000 7fcc8ae00640 1 -- 172.21.15.171:0/3256660044 shutdown_connections 2024-04-12T19:38:54.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.278+0000 7fcc8ae00640 1 -- 172.21.15.171:0/3256660044 wait complete. 2024-04-12T19:38:54.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.279+0000 7fcc8ae00640 1 Processor -- start 2024-04-12T19:38:54.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.280+0000 7fcc8ae00640 1 -- start start 2024-04-12T19:38:54.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.280+0000 7fcc8ae00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc840c1840 0x7fcc84148450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.280+0000 7fcc8ae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc8414b380 0x7fcc840abdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.280+0000 7fcc8ae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc840bd280 0x7fcc840b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.280+0000 7fcc8ae00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcc84154850 con 0x7fcc840bd280 2024-04-12T19:38:54.283 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.280+0000 7fcc8ae00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcc840c49b0 con 0x7fcc840c1840 2024-04-12T19:38:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.281+0000 7fcc8ae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcc84154b30 con 0x7fcc8414b380 2024-04-12T19:38:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.281+0000 7fcc83e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc840c1840 0x7fcc84148450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.281+0000 7fcc83400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc8414b380 0x7fcc840abdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.281+0000 7fcc83e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc840c1840 0x7fcc84148450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:52764/0 (socket says 172.21.15.171:52764) 2024-04-12T19:38:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.281+0000 7fcc83e00640 1 -- 172.21.15.171:0/1726340196 learned_addr learned my addr 172.21.15.171:0/1726340196 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-12T19:38:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.281+0000 7fcc88e00640 1 --2- 172.21.15.171:0/1726340196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc840bd280 0x7fcc840b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.281+0000 7fcc83400640 1 -- 172.21.15.171:0/1726340196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc840c1840 msgr2=0x7fcc84148450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.281+0000 7fcc83400640 1 --2- 172.21.15.171:0/1726340196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc840c1840 0x7fcc84148450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.281+0000 7fcc83400640 1 -- 172.21.15.171:0/1726340196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc840bd280 msgr2=0x7fcc840b90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.281+0000 7fcc83400640 1 --2- 172.21.15.171:0/1726340196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc840bd280 0x7fcc840b90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.281+0000 7fcc83400640 1 -- 172.21.15.171:0/1726340196 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc84148990 con 0x7fcc8414b380 2024-04-12T19:38:54.284 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.281+0000 7fcc83e00640 1 --2- 172.21.15.171:0/1726340196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc840c1840 0x7fcc84148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:38:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.282+0000 7fcc83400640 1 --2- 172.21.15.171:0/1726340196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc8414b380 0x7fcc840abdc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000d580 tx=0x7fcc7000da40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.282+0000 7fcc7be00640 1 -- 172.21.15.171:0/1726340196 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70018020 con 0x7fcc8414b380 2024-04-12T19:38:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.282+0000 7fcc7be00640 1 -- 172.21.15.171:0/1726340196 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc70014620 con 0x7fcc8414b380 2024-04-12T19:38:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.282+0000 7fcc7be00640 1 -- 172.21.15.171:0/1726340196 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc70014a10 con 0x7fcc8414b380 2024-04-12T19:38:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.282+0000 7fcc8ae00640 1 -- 172.21.15.171:0/1726340196 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc84153ab0 con 0x7fcc8414b380 2024-04-12T19:38:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.282+0000 7fcc8ae00640 1 -- 172.21.15.171:0/1726340196 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc840a9740 con 0x7fcc8414b380 2024-04-12T19:38:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.282+0000 7fcc7be00640 1 -- 172.21.15.171:0/1726340196 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcc7001b020 con 0x7fcc8414b380 2024-04-12T19:38:54.285 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.282+0000 7fcc7be00640 1 -- 172.21.15.171:0/1726340196 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fcc7001d910 con 0x7fcc8414b380 2024-04-12T19:38:54.286 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.283+0000 7fcc8ae00640 1 -- 172.21.15.171:0/1726340196 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc84153fd0 con 0x7fcc8414b380 2024-04-12T19:38:54.286 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.286+0000 7fcc7be00640 1 -- 172.21.15.171:0/1726340196 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fcc84153fd0 con 0x7fcc8414b380 2024-04-12T19:38:54.315 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:54.316+0000 7fedb843f040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-12T19:38:54.365 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.365+0000 7fcc8ae00640 1 -- 172.21.15.171:0/1726340196 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2635fc65-cc14-4d65-b397-b1c7a38770a0", "id": 4} v 0) -- 0x7fcc8404fd50 con 0x7fcc8414b380 2024-04-12T19:38:54.373 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.373+0000 7fcc7be00640 1 -- 172.21.15.171:0/1726340196 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2635fc65-cc14-4d65-b397-b1c7a38770a0", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fcc70022020 con 0x7fcc8414b380 2024-04-12T19:38:54.373 INFO:teuthology.orchestra.run.smithi171.stdout:4 2024-04-12T19:38:54.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.374+0000 7fcc8ae00640 1 -- 172.21.15.171:0/1726340196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc8414b380 msgr2=0x7fcc840abdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.374+0000 7fcc8ae00640 1 --2- 172.21.15.171:0/1726340196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc8414b380 0x7fcc840abdc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcc7000d580 tx=0x7fcc7000da40 comp rx=0 tx=0).stop 2024-04-12T19:38:54.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.374+0000 7fcc8ae00640 1 -- 172.21.15.171:0/1726340196 shutdown_connections 2024-04-12T19:38:54.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.374+0000 7fcc8ae00640 1 --2- 172.21.15.171:0/1726340196 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc840bd280 0x7fcc840b90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.374+0000 7fcc8ae00640 1 --2- 172.21.15.171:0/1726340196 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc8414b380 0x7fcc840abdc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.374+0000 7fcc8ae00640 1 --2- 172.21.15.171:0/1726340196 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc840c1840 0x7fcc84148450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.374+0000 7fcc8ae00640 1 -- 172.21.15.171:0/1726340196 >> 172.21.15.171:0/1726340196 conn(0x7fcc840a8490 msgr2=0x7fcc840c5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:54.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.374+0000 7fcc8ae00640 1 -- 172.21.15.171:0/1726340196 shutdown_connections 2024-04-12T19:38:54.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.374+0000 7fcc8ae00640 1 -- 172.21.15.171:0/1726340196 wait complete. 2024-04-12T19:38:54.391 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new d7b86793-91e8-4d4b-85d9-997e6f72051c 5 2024-04-12T19:38:54.461 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:54.461+0000 7fedb843f040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-12T19:38:54.515 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:54.515+0000 7fedb843f040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-12T19:38:54.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.629+0000 7fc412a00640 1 Processor -- start 2024-04-12T19:38:54.630 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.630+0000 7fc412a00640 1 -- start start 2024-04-12T19:38:54.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.631+0000 7fc412a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc40c0ac400 0x7fc40c06df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.631+0000 7fc412a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 0x7fc40c153520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.631+0000 7fc412a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc40c06ce90 con 0x7fc40c14b2a0 2024-04-12T19:38:54.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.631+0000 7fc412a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc40c152380 con 0x7fc40c0ac400 2024-04-12T19:38:54.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.631+0000 7fc412a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc40c0ac030 con 0x7fc40c0c5580 2024-04-12T19:38:54.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.631+0000 7fc411600640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fc40c14b2a0 0x7fc40c154b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:45030/0 (socket says 172.21.15.171:45030) 2024-04-12T19:38:54.632 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.631+0000 7fc412000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 0x7fc40c153520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.631+0000 7fc411600640 1 -- 172.21.15.171:0/2734173734 learned_addr learned my addr 172.21.15.171:0/2734173734 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-12T19:38:54.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.631+0000 7fc410c00640 1 --2- 172.21.15.171:0/2734173734 >> v2:172.21.15.131:3300/0 conn(0x7fc40c0ac400 0x7fc40c06df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.632+0000 7fc412000640 1 -- 172.21.15.171:0/2734173734 >> v2:172.21.15.131:3300/0 conn(0x7fc40c0ac400 msgr2=0x7fc40c06df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:54.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.632+0000 7fc412000640 1 --2- 172.21.15.171:0/2734173734 >> v2:172.21.15.131:3300/0 conn(0x7fc40c0ac400 0x7fc40c06df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.632+0000 7fc412000640 1 -- 172.21.15.171:0/2734173734 >> v1:172.21.15.171:6789/0 conn(0x7fc40c14b2a0 legacy=0x7fc40c154b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.632+0000 7fc412000640 1 -- 172.21.15.171:0/2734173734 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c0c6020 con 0x7fc40c0c5580 2024-04-12T19:38:54.633 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.632+0000 7fc40be00640 1 -- 172.21.15.171:0/2734173734 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 681541599 0 0) 0x7fc40c06ce90 con 0x7fc40c14b2a0 2024-04-12T19:38:54.634 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.633+0000 7fc412000640 1 --2- 172.21.15.171:0/2734173734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 0x7fc40c153520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc404009d90 tx=0x7fc40402bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5d50ed40e2ce3e1b server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:54.634 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.633+0000 7fc40be00640 1 -- 172.21.15.171:0/2734173734 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404039070 con 0x7fc40c0c5580 2024-04-12T19:38:54.635 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.633+0000 7fc40be00640 1 -- 172.21.15.171:0/2734173734 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc40402cc50 con 0x7fc40c0c5580 2024-04-12T19:38:54.635 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.633+0000 7fc40be00640 1 -- 172.21.15.171:0/2734173734 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404034440 con 0x7fc40c0c5580 2024-04-12T19:38:54.635 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.634+0000 7fc412a00640 1 -- 172.21.15.171:0/2734173734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 msgr2=0x7fc40c153520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.635 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.634+0000 7fc412a00640 1 --2- 172.21.15.171:0/2734173734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 0x7fc40c153520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc404009d90 tx=0x7fc40402bea0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.635 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.634+0000 7fc412a00640 1 -- 172.21.15.171:0/2734173734 shutdown_connections 2024-04-12T19:38:54.635 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.634+0000 7fc412a00640 1 --2- 172.21.15.171:0/2734173734 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 0x7fc40c153520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.635 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.634+0000 7fc412a00640 1 --2- 172.21.15.171:0/2734173734 >> v2:172.21.15.131:3300/0 conn(0x7fc40c0ac400 0x7fc40c06df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.635 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.634+0000 7fc412a00640 1 -- 172.21.15.171:0/2734173734 >> 172.21.15.171:0/2734173734 conn(0x7fc40c0c30f0 msgr2=0x7fc40c0c3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:54.635 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.634+0000 7fc412a00640 1 -- 172.21.15.171:0/2734173734 shutdown_connections 2024-04-12T19:38:54.635 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.634+0000 7fc412a00640 1 -- 172.21.15.171:0/2734173734 wait complete. 2024-04-12T19:38:54.636 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.635+0000 7fc412a00640 1 Processor -- start 2024-04-12T19:38:54.636 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.636+0000 7fc412a00640 1 -- start start 2024-04-12T19:38:54.638 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.636+0000 7fc412a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc40c0ac400 0x7fc40c0c02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.638 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.636+0000 7fc412a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 0x7fc40c0bf4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.638 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.636+0000 7fc412a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc40c14b2a0 0x7fc40c0b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.636+0000 7fc412a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c151e00 con 0x7fc40c14b2a0 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.636+0000 7fc412a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc40c1518c0 con 0x7fc40c0ac400 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.636+0000 7fc412a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc40c154620 con 0x7fc40c0c5580 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.637+0000 7fc410c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 0x7fc40c0bf4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.637+0000 7fc411600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc40c0ac400 0x7fc40c0c02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.637+0000 7fc410c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 0x7fc40c0bf4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:38572/0 (socket says 172.21.15.171:38572) 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.637+0000 7fc410c00640 1 -- 172.21.15.171:0/4186414387 learned_addr learned my addr 172.21.15.171:0/4186414387 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.637+0000 7fc412000640 1 --2- 172.21.15.171:0/4186414387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc40c14b2a0 0x7fc40c0b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.637+0000 7fc410c00640 1 -- 172.21.15.171:0/4186414387 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc40c0ac400 msgr2=0x7fc40c0c02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.637+0000 7fc410c00640 1 --2- 172.21.15.171:0/4186414387 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc40c0ac400 0x7fc40c0c02f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.637+0000 7fc410c00640 1 -- 172.21.15.171:0/4186414387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc40c14b2a0 msgr2=0x7fc40c0b8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.637+0000 7fc410c00640 1 --2- 172.21.15.171:0/4186414387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc40c14b2a0 0x7fc40c0b8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.637+0000 7fc410c00640 1 -- 172.21.15.171:0/4186414387 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc40c0c0830 con 0x7fc40c0c5580 2024-04-12T19:38:54.639 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.637+0000 7fc412000640 1 --2- 172.21.15.171:0/4186414387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc40c14b2a0 0x7fc40c0b8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:38:54.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.637+0000 7fc410c00640 1 --2- 172.21.15.171:0/4186414387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 0x7fc40c0bf4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800d7d0 tx=0x7fc3f800dc90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:54.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.638+0000 7fc409600640 1 -- 172.21.15.171:0/4186414387 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f800b6c0 con 0x7fc40c0c5580 2024-04-12T19:38:54.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.638+0000 7fc409600640 1 -- 172.21.15.171:0/4186414387 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f8019070 con 0x7fc40c0c5580 2024-04-12T19:38:54.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.638+0000 7fc409600640 1 -- 172.21.15.171:0/4186414387 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f800ba80 con 0x7fc40c0c5580 2024-04-12T19:38:54.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.638+0000 7fc412a00640 1 -- 172.21.15.171:0/4186414387 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc40c149f60 con 0x7fc40c0c5580 2024-04-12T19:38:54.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.638+0000 7fc412a00640 1 -- 172.21.15.171:0/4186414387 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fc40c0bdb30 con 0x7fc40c0c5580 2024-04-12T19:38:54.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.638+0000 7fc409600640 1 -- 172.21.15.171:0/4186414387 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc3f800bc20 con 0x7fc40c0c5580 2024-04-12T19:38:54.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.638+0000 7fc409600640 1 -- 172.21.15.171:0/4186414387 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fc3f801e9e0 con 0x7fc40c0c5580 2024-04-12T19:38:54.640 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.639+0000 7fc412a00640 1 -- 172.21.15.171:0/4186414387 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc40c0684d0 con 0x7fc40c0c5580 2024-04-12T19:38:54.641 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.641+0000 7fc409600640 1 -- 172.21.15.171:0/4186414387 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fc40c0684d0 con 0x7fc40c0c5580 2024-04-12T19:38:54.642 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:54.642+0000 7fedb843f040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-12T19:38:54.720 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.720+0000 7fc412a00640 1 -- 172.21.15.171:0/4186414387 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d7b86793-91e8-4d4b-85d9-997e6f72051c", "id": 5} v 0) -- 0x7fc40c069110 con 0x7fc40c0c5580 2024-04-12T19:38:54.724 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:54.724+0000 7fd2e1e11040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-04-12T19:38:54.728 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.728+0000 7fc409600640 1 -- 172.21.15.171:0/4186414387 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d7b86793-91e8-4d4b-85d9-997e6f72051c", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fc40c069110 con 0x7fc40c0c5580 2024-04-12T19:38:54.729 INFO:teuthology.orchestra.run.smithi171.stdout:5 2024-04-12T19:38:54.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.730+0000 7fc412a00640 1 -- 172.21.15.171:0/4186414387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 msgr2=0x7fc40c0bf4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.730+0000 7fc412a00640 1 --2- 172.21.15.171:0/4186414387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 0x7fc40c0bf4d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fc3f800d7d0 tx=0x7fc3f800dc90 comp rx=0 tx=0).stop 2024-04-12T19:38:54.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.730+0000 7fc412a00640 1 -- 172.21.15.171:0/4186414387 shutdown_connections 2024-04-12T19:38:54.731 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.730+0000 7fc412a00640 1 --2- 172.21.15.171:0/4186414387 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc40c14b2a0 0x7fc40c0b8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.731 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.730+0000 7fc412a00640 1 --2- 172.21.15.171:0/4186414387 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc40c0c5580 0x7fc40c0bf4d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.731 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.730+0000 7fc412a00640 1 --2- 172.21.15.171:0/4186414387 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc40c0ac400 0x7fc40c0c02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.731 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.730+0000 7fc412a00640 1 -- 172.21.15.171:0/4186414387 >> 172.21.15.171:0/4186414387 conn(0x7fc40c0c30f0 msgr2=0x7fc40c154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:54.731 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.730+0000 7fc412a00640 1 -- 172.21.15.171:0/4186414387 shutdown_connections 2024-04-12T19:38:54.731 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.730+0000 7fc412a00640 1 -- 172.21.15.171:0/4186414387 wait complete. 2024-04-12T19:38:54.748 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 9c4f69e8-27c9-4efe-8f6b-367246841c7c 6 2024-04-12T19:38:54.754 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:54.754+0000 7fedb843f040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-12T19:38:54.898 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:54.898+0000 7fd2e1e11040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-12T19:38:54.932 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:54.932+0000 7fedb843f040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-12T19:38:54.934 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.934+0000 7fbd9c600640 1 Processor -- start 2024-04-12T19:38:54.934 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.934+0000 7fbd9c600640 1 -- start start 2024-04-12T19:38:54.936 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.935+0000 7fbd9c600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbd9414b380 0x7fbd94155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.936 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.935+0000 7fbd9c600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd940c4e00 0x7fbd94151010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.936 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.935+0000 7fbd9c600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd9414b760 con 0x7fbd940c0a20 2024-04-12T19:38:54.936 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.935+0000 7fbd9c600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fbd940c4760 con 0x7fbd9414b380 2024-04-12T19:38:54.936 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.935+0000 7fbd9c600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbd94154600 con 0x7fbd940c4e00 2024-04-12T19:38:54.936 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.936+0000 7fbd99200640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fbd940c0a20 0x7fbd940c1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:45040/0 (socket says 172.21.15.171:45040) 2024-04-12T19:38:54.936 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.936+0000 7fbd99200640 1 -- 172.21.15.171:0/4096688226 learned_addr learned my addr 172.21.15.171:0/4096688226 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-12T19:38:54.936 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.936+0000 7fbd9a600640 1 --2- 172.21.15.171:0/4096688226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd940c4e00 0x7fbd94151010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.937 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.936+0000 7fbd99c00640 1 --2- 172.21.15.171:0/4096688226 >> v2:172.21.15.131:3300/0 conn(0x7fbd9414b380 0x7fbd94155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.937 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.936+0000 7fbd93e00640 1 -- 172.21.15.171:0/4096688226 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3539729584 0 0) 0x7fbd80001110 con 0x7fbd940c0a20 2024-04-12T19:38:54.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.936+0000 7fbd93e00640 1 -- 172.21.15.171:0/4096688226 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd7c003520 con 0x7fbd940c0a20 2024-04-12T19:38:54.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.936+0000 7fbd9a600640 1 -- 172.21.15.171:0/4096688226 >> v2:172.21.15.131:3300/0 conn(0x7fbd9414b380 msgr2=0x7fbd94155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:54.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.936+0000 7fbd9a600640 1 --2- 172.21.15.171:0/4096688226 >> v2:172.21.15.131:3300/0 conn(0x7fbd9414b380 0x7fbd94155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.936+0000 7fbd9a600640 1 -- 172.21.15.171:0/4096688226 >> v1:172.21.15.171:6789/0 conn(0x7fbd940c0a20 legacy=0x7fbd940c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.936+0000 7fbd9a600640 1 -- 172.21.15.171:0/4096688226 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd940c3af0 con 0x7fbd940c4e00 2024-04-12T19:38:54.938 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.937+0000 7fbd9a600640 1 --2- 172.21.15.171:0/4096688226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd940c4e00 0x7fbd94151010 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009d90 tx=0x7fbd8c02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0bf2671e7f13c09 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:54.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.938+0000 7fbd93e00640 1 -- 172.21.15.171:0/4096688226 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c039070 con 0x7fbd940c4e00 2024-04-12T19:38:54.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.938+0000 7fbd93e00640 1 -- 172.21.15.171:0/4096688226 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd8c02cbc0 con 0x7fbd940c4e00 2024-04-12T19:38:54.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.938+0000 7fbd93e00640 1 -- 172.21.15.171:0/4096688226 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd8c034440 con 0x7fbd940c4e00 2024-04-12T19:38:54.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.938+0000 7fbd9c600640 1 -- 172.21.15.171:0/4096688226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd940c4e00 msgr2=0x7fbd94151010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.938+0000 7fbd9c600640 1 --2- 172.21.15.171:0/4096688226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd940c4e00 0x7fbd94151010 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fbd8c009d90 tx=0x7fbd8c02be10 comp rx=0 tx=0).stop 2024-04-12T19:38:54.939 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.938+0000 7fbd9c600640 1 -- 172.21.15.171:0/4096688226 shutdown_connections 2024-04-12T19:38:54.940 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.938+0000 7fbd9c600640 1 --2- 172.21.15.171:0/4096688226 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd940c4e00 0x7fbd94151010 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.940 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.938+0000 7fbd9c600640 1 --2- 172.21.15.171:0/4096688226 >> v2:172.21.15.131:3300/0 conn(0x7fbd9414b380 0x7fbd94155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.940 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.938+0000 7fbd9c600640 1 -- 172.21.15.171:0/4096688226 >> 172.21.15.171:0/4096688226 conn(0x7fbd940a8490 msgr2=0x7fbd940a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:54.940 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.939+0000 7fbd9c600640 1 -- 172.21.15.171:0/4096688226 shutdown_connections 2024-04-12T19:38:54.940 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.939+0000 7fbd9c600640 1 -- 172.21.15.171:0/4096688226 wait complete. 2024-04-12T19:38:54.940 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.940+0000 7fbd9c600640 1 Processor -- start 2024-04-12T19:38:54.940 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.940+0000 7fbd9c600640 1 -- start start 2024-04-12T19:38:54.943 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.941+0000 7fbd9c600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd940c4e00 0x7fbd941ea480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.943 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.941+0000 7fbd9c600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd9414b380 0x7fbd940bc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.943 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.941+0000 7fbd9c600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd940bcba0 0x7fbd941dbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:54.943 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.941+0000 7fbd9c600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94154850 con 0x7fbd940c4e00 2024-04-12T19:38:54.943 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.941+0000 7fbd9c600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbd94155590 con 0x7fbd9414b380 2024-04-12T19:38:54.943 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.941+0000 7fbd9c600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbd94154b30 con 0x7fbd940bcba0 2024-04-12T19:38:54.943 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.941+0000 7fbd99200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd9414b380 0x7fbd940bc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.943 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.941+0000 7fbd9a600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd940bcba0 0x7fbd941dbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.941+0000 7fbd9a600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd940bcba0 0x7fbd941dbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:38598/0 (socket says 172.21.15.171:38598) 2024-04-12T19:38:54.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.941+0000 7fbd99200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd9414b380 0x7fbd940bc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:52768/0 (socket says 172.21.15.171:52768) 2024-04-12T19:38:54.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.941+0000 7fbd9a600640 1 -- 172.21.15.171:0/4116528184 learned_addr learned my addr 172.21.15.171:0/4116528184 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-12T19:38:54.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.941+0000 7fbd99c00640 1 --2- 172.21.15.171:0/4116528184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd940c4e00 0x7fbd941ea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:54.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.942+0000 7fbd99200640 1 -- 172.21.15.171:0/4116528184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd940bcba0 msgr2=0x7fbd941dbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.942+0000 7fbd99200640 1 --2- 172.21.15.171:0/4116528184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd940bcba0 0x7fbd941dbac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.942+0000 7fbd99200640 1 -- 172.21.15.171:0/4116528184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd940c4e00 msgr2=0x7fbd941ea480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:54.944 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.942+0000 7fbd99200640 1 --2- 172.21.15.171:0/4116528184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd940c4e00 0x7fbd941ea480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:54.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.942+0000 7fbd99200640 1 -- 172.21.15.171:0/4116528184 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd940bd570 con 0x7fbd9414b380 2024-04-12T19:38:54.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.942+0000 7fbd99200640 1 --2- 172.21.15.171:0/4116528184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd9414b380 0x7fbd940bc660 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c390 tx=0x7fbd8000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:54.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.942+0000 7fbd91600640 1 -- 172.21.15.171:0/4116528184 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd80017070 con 0x7fbd9414b380 2024-04-12T19:38:54.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.942+0000 7fbd91600640 1 -- 172.21.15.171:0/4116528184 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd80005ce0 con 0x7fbd9414b380 2024-04-12T19:38:54.945 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.942+0000 7fbd91600640 1 -- 172.21.15.171:0/4116528184 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd800072f0 con 0x7fbd9414b380 2024-04-12T19:38:54.946 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.942+0000 7fbd9c600640 1 -- 172.21.15.171:0/4116528184 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd941ead30 con 0x7fbd9414b380 2024-04-12T19:38:54.946 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.943+0000 7fbd9c600640 1 -- 172.21.15.171:0/4116528184 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd941db5a0 con 0x7fbd9414b380 2024-04-12T19:38:54.946 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.943+0000 7fbd91600640 1 -- 172.21.15.171:0/4116528184 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbd8001a070 con 0x7fbd9414b380 2024-04-12T19:38:54.946 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.943+0000 7fbd91600640 1 -- 172.21.15.171:0/4116528184 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fbd80007490 con 0x7fbd9414b380 2024-04-12T19:38:54.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.944+0000 7fbd9c600640 1 -- 172.21.15.171:0/4116528184 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd9404fd50 con 0x7fbd9414b380 2024-04-12T19:38:54.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:54.946+0000 7fbd91600640 1 -- 172.21.15.171:0/4116528184 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fbd80021020 con 0x7fbd9414b380 2024-04-12T19:38:54.983 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:54.983+0000 7fedb843f040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-12T19:38:55.026 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.025+0000 7fbd9c600640 1 -- 172.21.15.171:0/4116528184 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9c4f69e8-27c9-4efe-8f6b-367246841c7c", "id": 6} v 0) -- 0x7fbd940a6170 con 0x7fbd9414b380 2024-04-12T19:38:55.037 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.036+0000 7fbd91600640 1 -- 172.21.15.171:0/4116528184 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9c4f69e8-27c9-4efe-8f6b-367246841c7c", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fbd9414b760 con 0x7fbd9414b380 2024-04-12T19:38:55.037 INFO:teuthology.orchestra.run.smithi171.stdout:6 2024-04-12T19:38:55.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.037+0000 7fbd9c600640 1 -- 172.21.15.171:0/4116528184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd9414b380 msgr2=0x7fbd940bc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:55.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.037+0000 7fbd9c600640 1 --2- 172.21.15.171:0/4116528184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd9414b380 0x7fbd940bc660 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fbd8000c390 tx=0x7fbd8000c790 comp rx=0 tx=0).stop 2024-04-12T19:38:55.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.037+0000 7fbd9c600640 1 -- 172.21.15.171:0/4116528184 shutdown_connections 2024-04-12T19:38:55.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.037+0000 7fbd9c600640 1 --2- 172.21.15.171:0/4116528184 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbd9414b380 0x7fbd940bc660 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.037+0000 7fbd9c600640 1 --2- 172.21.15.171:0/4116528184 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbd940bcba0 0x7fbd941dbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.037+0000 7fbd9c600640 1 --2- 172.21.15.171:0/4116528184 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbd940c4e00 0x7fbd941ea480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.038 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.037+0000 7fbd9c600640 1 -- 172.21.15.171:0/4116528184 >> 172.21.15.171:0/4116528184 conn(0x7fbd940a8490 msgr2=0x7fbd940c5ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:55.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.038+0000 7fbd9c600640 1 -- 172.21.15.171:0/4116528184 shutdown_connections 2024-04-12T19:38:55.039 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.038+0000 7fbd9c600640 1 -- 172.21.15.171:0/4116528184 wait complete. 2024-04-12T19:38:55.050 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:55.049+0000 7fd2e1e11040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-12T19:38:55.054 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new edaa1a24-13f4-419f-ba8e-d633d9a2f7c3 7 2024-04-12T19:38:55.107 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:55.107+0000 7fd2e1e11040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-12T19:38:55.157 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:55.156+0000 7fedb843f040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-12T19:38:55.244 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:55.243+0000 7fd2e1e11040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-12T19:38:55.249 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.249+0000 7fb9c3200640 1 Processor -- start 2024-04-12T19:38:55.250 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.250+0000 7fb9c3200640 1 -- start start 2024-04-12T19:38:55.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c3200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9bc14b300 0x7fb9bc06deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:55.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c3200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb9bc0c55e0 0x7fb9bc06c930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:55.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c3200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb9bc0c5a60 0x7fb9bc06ce70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:55.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c3200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb9bc152420 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c3200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb9bc06c4a0 con 0x7fb9bc0c55e0 2024-04-12T19:38:55.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c3200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb9bc14b6e0 con 0x7fb9bc14b300 2024-04-12T19:38:55.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c1400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb9bc0c55e0 0x7fb9bc06c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:55.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9bc14b300 0x7fb9bc06deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:55.252 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c1e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9bc14b300 0x7fb9bc06deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.171:38608/0 (socket says 172.21.15.171:38608) 2024-04-12T19:38:55.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c1e00640 1 -- 172.21.15.171:0/1458675048 learned_addr learned my addr 172.21.15.171:0/1458675048 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-12T19:38:55.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c2800640 1 --2- 172.21.15.171:0/1458675048 >> v2:172.21.15.131:3300/0 conn(0x7fb9bc0c5a60 0x7fb9bc06ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:55.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c1400640 1 -- 172.21.15.171:0/1458675048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9bc14b300 msgr2=0x7fb9bc06deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:55.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c1400640 1 --2- 172.21.15.171:0/1458675048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9bc14b300 0x7fb9bc06deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c1400640 1 -- 172.21.15.171:0/1458675048 >> v2:172.21.15.131:3300/0 conn(0x7fb9bc0c5a60 msgr2=0x7fb9bc06ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:55.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c1400640 1 --2- 172.21.15.171:0/1458675048 >> v2:172.21.15.131:3300/0 conn(0x7fb9bc0c5a60 0x7fb9bc06ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c1400640 1 -- 172.21.15.171:0/1458675048 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc151120 con 0x7fb9bc0c55e0 2024-04-12T19:38:55.253 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.251+0000 7fb9c1e00640 1 --2- 172.21.15.171:0/1458675048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9bc14b300 0x7fb9bc06deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:38:55.254 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.253+0000 7fb9c1400640 1 --2- 172.21.15.171:0/1458675048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9bc0c55e0 0x7fb9bc06c930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc073e90 tx=0x7fb9ac02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=541973f6d5b44743 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:55.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.253+0000 7fb9c0a00640 1 -- 172.21.15.171:0/1458675048 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac039070 con 0x7fb9bc0c55e0 2024-04-12T19:38:55.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.253+0000 7fb9c0a00640 1 -- 172.21.15.171:0/1458675048 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0316f0 con 0x7fb9bc0c55e0 2024-04-12T19:38:55.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.253+0000 7fb9c0a00640 1 -- 172.21.15.171:0/1458675048 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac031ac0 con 0x7fb9bc0c55e0 2024-04-12T19:38:55.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.254+0000 7fb9c3200640 1 -- 172.21.15.171:0/1458675048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9bc0c55e0 msgr2=0x7fb9bc06c930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:55.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.254+0000 7fb9c3200640 1 --2- 172.21.15.171:0/1458675048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9bc0c55e0 0x7fb9bc06c930 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fb9bc073e90 tx=0x7fb9ac02b790 comp rx=0 tx=0).stop 2024-04-12T19:38:55.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.254+0000 7fb9c3200640 1 -- 172.21.15.171:0/1458675048 shutdown_connections 2024-04-12T19:38:55.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.254+0000 7fb9c3200640 1 --2- 172.21.15.171:0/1458675048 >> v2:172.21.15.131:3300/0 conn(0x7fb9bc0c5a60 0x7fb9bc06ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.254+0000 7fb9c3200640 1 --2- 172.21.15.171:0/1458675048 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9bc0c55e0 0x7fb9bc06c930 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.254+0000 7fb9c3200640 1 --2- 172.21.15.171:0/1458675048 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9bc14b300 0x7fb9bc06deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.254+0000 7fb9c3200640 1 -- 172.21.15.171:0/1458675048 >> 172.21.15.171:0/1458675048 conn(0x7fb9bc0c3150 msgr2=0x7fb9bc0c3560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:55.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.254+0000 7fb9c3200640 1 -- 172.21.15.171:0/1458675048 shutdown_connections 2024-04-12T19:38:55.255 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.254+0000 7fb9c3200640 1 -- 172.21.15.171:0/1458675048 wait complete. 2024-04-12T19:38:55.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.255+0000 7fb9c3200640 1 Processor -- start 2024-04-12T19:38:55.256 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.256+0000 7fb9c3200640 1 -- start start 2024-04-12T19:38:55.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.256+0000 7fb9c3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9bc0c55e0 0x7fb9bc0bc880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:55.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.256+0000 7fb9c3200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9bc0c5a60 0x7fb9bc0bb4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:55.258 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.256+0000 7fb9c3200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9bc14b300 0x7fb9bc0c0030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.256+0000 7fb9c3200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc06e770 con 0x7fb9bc0c55e0 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.256+0000 7fb9c3200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb9bc06c130 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.256+0000 7fb9c3200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb9bc0ac4b0 con 0x7fb9bc14b300 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.257+0000 7fb9c1400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9bc0c5a60 0x7fb9bc0bb4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.257+0000 7fb9c1400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9bc0c5a60 0x7fb9bc0bb4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.171:52782/0 (socket says 172.21.15.171:52782) 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.257+0000 7fb9c2800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9bc14b300 0x7fb9bc0c0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.257+0000 7fb9c1400640 1 -- 172.21.15.171:0/2813712568 learned_addr learned my addr 172.21.15.171:0/2813712568 (peer_addr_for_me v2:172.21.15.171:0/0) 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.257+0000 7fb9c1e00640 1 --2- 172.21.15.171:0/2813712568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9bc0c55e0 0x7fb9bc0bc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.257+0000 7fb9c1400640 1 -- 172.21.15.171:0/2813712568 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9bc14b300 msgr2=0x7fb9bc0c0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.257+0000 7fb9c1400640 1 --2- 172.21.15.171:0/2813712568 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9bc14b300 0x7fb9bc0c0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.257+0000 7fb9c1400640 1 -- 172.21.15.171:0/2813712568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9bc0c55e0 msgr2=0x7fb9bc0bc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.257+0000 7fb9c1400640 1 --2- 172.21.15.171:0/2813712568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9bc0c55e0 0x7fb9bc0bc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.257+0000 7fb9c1400640 1 -- 172.21.15.171:0/2813712568 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9bc0bd1f0 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.259 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.257+0000 7fb9c1e00640 1 --2- 172.21.15.171:0/2813712568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9bc0c55e0 0x7fb9bc0bc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T19:38:55.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.258+0000 7fb9c1400640 1 --2- 172.21.15.171:0/2813712568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9bc0c5a60 0x7fb9bc0bb4f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009720 tx=0x7fb9ac0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:55.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.258+0000 7fb9b6000640 1 -- 172.21.15.171:0/2813712568 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac044070 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.258+0000 7fb9b6000640 1 -- 172.21.15.171:0/2813712568 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9ac0346a0 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.258+0000 7fb9c3200640 1 -- 172.21.15.171:0/2813712568 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9bc1e7250 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.258+0000 7fb9b6000640 1 -- 172.21.15.171:0/2813712568 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ac039040 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.258+0000 7fb9c3200640 1 -- 172.21.15.171:0/2813712568 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9bc1e74f0 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.258+0000 7fb9b6000640 1 -- 172.21.15.171:0/2813712568 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb9ac047070 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.260 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.258+0000 7fb9b6000640 1 -- 172.21.15.171:0/2813712568 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fb9ac040c00 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.261 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.259+0000 7fb9c3200640 1 -- 172.21.15.171:0/2813712568 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9bc1e7730 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.263 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.263+0000 7fb9b6000640 1 -- 172.21.15.171:0/2813712568 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fb9ac0315d0 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.342 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.342+0000 7fb9c3200640 1 -- 172.21.15.171:0/2813712568 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd new", "uuid": "edaa1a24-13f4-419f-ba8e-d633d9a2f7c3", "id": 7} v 0) -- 0x7fb9bc04fd50 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.351 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.351+0000 7fb9b6000640 1 -- 172.21.15.171:0/2813712568 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "edaa1a24-13f4-419f-ba8e-d633d9a2f7c3", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fb9ac034a90 con 0x7fb9bc0c5a60 2024-04-12T19:38:55.352 INFO:teuthology.orchestra.run.smithi171.stdout:7 2024-04-12T19:38:55.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.353+0000 7fb9c3200640 1 -- 172.21.15.171:0/2813712568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9bc0c5a60 msgr2=0x7fb9bc0bb4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:55.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.353+0000 7fb9c3200640 1 --2- 172.21.15.171:0/2813712568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9bc0c5a60 0x7fb9bc0bb4f0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb9ac009720 tx=0x7fb9ac0046c0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.353 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.353+0000 7fb9c3200640 1 -- 172.21.15.171:0/2813712568 shutdown_connections 2024-04-12T19:38:55.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.353+0000 7fb9c3200640 1 --2- 172.21.15.171:0/2813712568 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb9bc0c5a60 0x7fb9bc0bb4f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.353+0000 7fb9c3200640 1 --2- 172.21.15.171:0/2813712568 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb9bc14b300 0x7fb9bc0c0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.353+0000 7fb9c3200640 1 --2- 172.21.15.171:0/2813712568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9bc0c55e0 0x7fb9bc0bc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.353+0000 7fb9c3200640 1 -- 172.21.15.171:0/2813712568 >> 172.21.15.171:0/2813712568 conn(0x7fb9bc0c3150 msgr2=0x7fb9bc0c0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:55.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.353+0000 7fb9c3200640 1 -- 172.21.15.171:0/2813712568 shutdown_connections 2024-04-12T19:38:55.354 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-12T19:38:55.353+0000 7fb9c3200640 1 -- 172.21.15.171:0/2813712568 wait complete. 2024-04-12T19:38:55.366 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:55.366+0000 7fd2e1e11040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-12T19:38:55.369 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-12T19:38:55.370 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-12T19:38:55.377 INFO:tasks.ceph.osd.0:Started 2024-04-12T19:38:55.377 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-12T19:38:55.377 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-12T19:38:55.384 INFO:tasks.ceph.osd.1:Started 2024-04-12T19:38:55.385 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-12T19:38:55.385 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-12T19:38:55.392 INFO:tasks.ceph.osd.2:Started 2024-04-12T19:38:55.392 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-12T19:38:55.392 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-12T19:38:55.398 INFO:tasks.ceph.osd.3:Started 2024-04-12T19:38:55.398 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-12T19:38:55.398 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-12T19:38:55.403 INFO:tasks.ceph.osd.4:Started 2024-04-12T19:38:55.403 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-12T19:38:55.403 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-12T19:38:55.407 INFO:tasks.ceph.osd.5:Started 2024-04-12T19:38:55.408 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-12T19:38:55.408 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-12T19:38:55.413 INFO:tasks.ceph.osd.6:Started 2024-04-12T19:38:55.413 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-12T19:38:55.413 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-12T19:38:55.420 INFO:tasks.ceph.osd.7:Started 2024-04-12T19:38:55.421 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:38:55.599 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:55.599+0000 7fd2e1e11040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-12T19:38:55.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.650+0000 7f9b73000640 1 Processor -- start 2024-04-12T19:38:55.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.650+0000 7f9b73000640 1 -- start start 2024-04-12T19:38:55.651 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:55.651+0000 7fd2e1e11040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-12T19:38:55.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.651+0000 7f9b73000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b6c0b75b0 0x7f9b6c150d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:55.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.651+0000 7f9b73000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9b6c151280 0x7f9b6c1580d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:55.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.651+0000 7f9b73000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b6c073f00 con 0x7f9b6c147ad0 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.651+0000 7f9b73000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9b6c0b81d0 con 0x7f9b6c151280 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.651+0000 7f9b73000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9b6c071500 con 0x7f9b6c0b75b0 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.652+0000 7f9b6be00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f9b6c147ad0 0x7f9b6c0737f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:49296/0 (socket says 172.21.15.131:49296) 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.652+0000 7f9b6be00640 1 -- 172.21.15.131:0/4203895837 learned_addr learned my addr 172.21.15.131:0/4203895837 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.652+0000 7f9b71000640 1 --2- 172.21.15.131:0/4203895837 >> v2:172.21.15.131:3300/0 conn(0x7f9b6c151280 0x7f9b6c1580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.652+0000 7f9b6b400640 1 --2- 172.21.15.131:0/4203895837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b6c0b75b0 0x7f9b6c150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.652+0000 7f9b6aa00640 1 -- 172.21.15.131:0/4203895837 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3519732248 0 0) 0x7f9b6c073f00 con 0x7f9b6c147ad0 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.652+0000 7f9b6aa00640 1 -- 172.21.15.131:0/4203895837 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b50003520 con 0x7f9b6c147ad0 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.652+0000 7f9b6b400640 1 -- 172.21.15.131:0/4203895837 >> v2:172.21.15.131:3300/0 conn(0x7f9b6c151280 msgr2=0x7f9b6c1580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.652+0000 7f9b6b400640 1 --2- 172.21.15.131:0/4203895837 >> v2:172.21.15.131:3300/0 conn(0x7f9b6c151280 0x7f9b6c1580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.652+0000 7f9b6aa00640 1 -- 172.21.15.131:0/4203895837 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 59426388 0 0) 0x7f9b50003520 con 0x7f9b6c147ad0 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.653+0000 7f9b6b400640 1 -- 172.21.15.131:0/4203895837 >> v1:172.21.15.131:6789/0 conn(0x7f9b6c147ad0 legacy=0x7f9b6c0737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:55.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.653+0000 7f9b6b400640 1 -- 172.21.15.131:0/4203895837 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6c147eb0 con 0x7f9b6c0b75b0 2024-04-12T19:38:55.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.654+0000 7f9b6b400640 1 --2- 172.21.15.131:0/4203895837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b6c0b75b0 0x7f9b6c150d40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b580097a0 tx=0x7f9b5802b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72c6f89dfebe75a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:55.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.654+0000 7f9b6aa00640 1 -- 172.21.15.131:0/4203895837 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b58037070 con 0x7f9b6c0b75b0 2024-04-12T19:38:55.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.654+0000 7f9b6aa00640 1 -- 172.21.15.131:0/4203895837 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b58030510 con 0x7f9b6c0b75b0 2024-04-12T19:38:55.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.654+0000 7f9b6aa00640 1 -- 172.21.15.131:0/4203895837 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b5c001670 con 0x7f9b6c0b75b0 2024-04-12T19:38:55.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.655+0000 7f9b73000640 1 -- 172.21.15.131:0/4203895837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b6c0b75b0 msgr2=0x7f9b6c150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:55.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.655+0000 7f9b73000640 1 --2- 172.21.15.131:0/4203895837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b6c0b75b0 0x7f9b6c150d40 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9b580097a0 tx=0x7f9b5802b710 comp rx=0 tx=0).stop 2024-04-12T19:38:55.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.655+0000 7f9b73000640 1 -- 172.21.15.131:0/4203895837 shutdown_connections 2024-04-12T19:38:55.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.655+0000 7f9b73000640 1 --2- 172.21.15.131:0/4203895837 >> v2:172.21.15.131:3300/0 conn(0x7f9b6c151280 0x7f9b6c1580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.655+0000 7f9b73000640 1 --2- 172.21.15.131:0/4203895837 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b6c0b75b0 0x7f9b6c150d40 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.655+0000 7f9b73000640 1 -- 172.21.15.131:0/4203895837 >> 172.21.15.131:0/4203895837 conn(0x7f9b6c0c2590 msgr2=0x7f9b6c0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:55.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.655+0000 7f9b73000640 1 -- 172.21.15.131:0/4203895837 shutdown_connections 2024-04-12T19:38:55.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.655+0000 7f9b73000640 1 -- 172.21.15.131:0/4203895837 wait complete. 2024-04-12T19:38:55.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.656+0000 7f9b73000640 1 Processor -- start 2024-04-12T19:38:55.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.656+0000 7f9b73000640 1 -- start start 2024-04-12T19:38:55.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.657+0000 7f9b73000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b6c0b75b0 0x7f9b6c1e6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:55.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.657+0000 7f9b73000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b6c147ad0 0x7f9b6c1eaf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:55.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.657+0000 7f9b73000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c151280 0x7f9b6c14ba40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:55.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.657+0000 7f9b73000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6c0a4f90 con 0x7f9b6c151280 2024-04-12T19:38:55.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.657+0000 7f9b73000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9b6c0becb0 con 0x7f9b6c0b75b0 2024-04-12T19:38:55.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.657+0000 7f9b73000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9b6c151860 con 0x7f9b6c147ad0 2024-04-12T19:38:55.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.657+0000 7f9b71000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c151280 0x7f9b6c14ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:55.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.658+0000 7f9b71000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c151280 0x7f9b6c14ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52148/0 (socket says 172.21.15.131:52148) 2024-04-12T19:38:55.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.658+0000 7f9b6b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b6c147ad0 0x7f9b6c1eaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:55.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.658+0000 7f9b71000640 1 -- 172.21.15.131:0/742817413 learned_addr learned my addr 172.21.15.131:0/742817413 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:38:55.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.658+0000 7f9b6be00640 1 --2- 172.21.15.131:0/742817413 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b6c0b75b0 0x7f9b6c1e6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.658+0000 7f9b71000640 1 -- 172.21.15.131:0/742817413 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b6c147ad0 msgr2=0x7f9b6c1eaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.658+0000 7f9b71000640 1 --2- 172.21.15.131:0/742817413 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b6c147ad0 0x7f9b6c1eaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.658+0000 7f9b71000640 1 -- 172.21.15.131:0/742817413 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b6c0b75b0 msgr2=0x7f9b6c1e6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.658+0000 7f9b71000640 1 --2- 172.21.15.131:0/742817413 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b6c0b75b0 0x7f9b6c1e6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.658+0000 7f9b71000640 1 -- 172.21.15.131:0/742817413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b6c14a740 con 0x7f9b6c151280 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.658+0000 7f9b71000640 1 --2- 172.21.15.131:0/742817413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c151280 0x7f9b6c14ba40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400ec40 tx=0x7f9b6400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.658+0000 7f9b63e00640 1 -- 172.21.15.131:0/742817413 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b64018020 con 0x7f9b6c151280 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.659+0000 7f9b63e00640 1 -- 172.21.15.131:0/742817413 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b6400ee50 con 0x7f9b6c151280 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.659+0000 7f9b73000640 1 -- 172.21.15.131:0/742817413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b6c14aa20 con 0x7f9b6c151280 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.659+0000 7f9b63e00640 1 -- 172.21.15.131:0/742817413 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b640146c0 con 0x7f9b6c151280 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.659+0000 7f9b73000640 1 -- 172.21.15.131:0/742817413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b6c1eaa00 con 0x7f9b6c151280 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.659+0000 7f9b63e00640 1 -- 172.21.15.131:0/742817413 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9b6401b020 con 0x7f9b6c151280 2024-04-12T19:38:55.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.659+0000 7f9b63e00640 1 -- 172.21.15.131:0/742817413 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9b6401dd90 con 0x7f9b6c151280 2024-04-12T19:38:55.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.660+0000 7f9b73000640 1 -- 172.21.15.131:0/742817413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b6c0bffa0 con 0x7f9b6c151280 2024-04-12T19:38:55.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.662+0000 7f9b63e00640 1 -- 172.21.15.131:0/742817413 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9b6c0bffa0 con 0x7f9b6c151280 2024-04-12T19:38:55.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.727+0000 7f9b73000640 1 -- 172.21.15.131:0/742817413 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b6c0be130 con 0x7f9b6c151280 2024-04-12T19:38:55.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.728+0000 7f9b63e00640 1 -- 172.21.15.131:0/742817413 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9b64022030 con 0x7f9b6c151280 2024-04-12T19:38:55.728 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:38:55.728 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":10,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:38:55.344572+0000","last_up_change":"0.000000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:38:55.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.728+0000 7f9b73000640 1 -- 172.21.15.131:0/742817413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c151280 msgr2=0x7f9b6c14ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:55.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.728+0000 7f9b73000640 1 --2- 172.21.15.131:0/742817413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c151280 0x7f9b6c14ba40 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9b6400ec40 tx=0x7f9b6400c490 comp rx=0 tx=0).stop 2024-04-12T19:38:55.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.729+0000 7f9b73000640 1 -- 172.21.15.131:0/742817413 shutdown_connections 2024-04-12T19:38:55.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.729+0000 7f9b73000640 1 --2- 172.21.15.131:0/742817413 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9b6c151280 0x7f9b6c14ba40 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.729+0000 7f9b73000640 1 --2- 172.21.15.131:0/742817413 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9b6c147ad0 0x7f9b6c1eaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.729+0000 7f9b73000640 1 --2- 172.21.15.131:0/742817413 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9b6c0b75b0 0x7f9b6c1e6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:55.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.729+0000 7f9b73000640 1 -- 172.21.15.131:0/742817413 >> 172.21.15.131:0/742817413 conn(0x7f9b6c0c2590 msgr2=0x7f9b6c1457b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:55.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.729+0000 7f9b73000640 1 -- 172.21.15.131:0/742817413 shutdown_connections 2024-04-12T19:38:55.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:38:55.729+0000 7f9b73000640 1 -- 172.21.15.131:0/742817413 wait complete. 2024-04-12T19:38:55.744 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-12T19:38:55.744 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-12T19:38:55.829 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:55.828+0000 7fd2e1e11040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-12T19:38:56.080 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-04-12T19:38:56.080+0000 7ff5e5545640 -1 Falling back to public interface 2024-04-12T19:38:56.084 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-12T19:38:56.084+0000 7f1bc9f38640 -1 Falling back to public interface 2024-04-12T19:38:56.096 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-12T19:38:56.096+0000 7f1134593640 -1 Falling back to public interface 2024-04-12T19:38:56.103 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-04-12T19:38:56.103+0000 7f0179dbb640 -1 Falling back to public interface 2024-04-12T19:38:56.119 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-12T19:38:56.120+0000 7fa3c15bb640 -1 Falling back to public interface 2024-04-12T19:38:56.123 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-12T19:38:56.123+0000 7f9c39e1f640 -1 Falling back to public interface 2024-04-12T19:38:56.127 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-12T19:38:56.127+0000 7f72b4811640 -1 Falling back to public interface 2024-04-12T19:38:56.128 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-12T19:38:56.128+0000 7f1658a13640 -1 Falling back to public interface 2024-04-12T19:38:56.279 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:56.279+0000 7fedb843f040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-12T19:38:56.550 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-12T19:38:56.596 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:56.596+0000 7fedb843f040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-12T19:38:56.659 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:56.659+0000 7fedb843f040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-12T19:38:56.718 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.718+0000 7f7bfe600640 1 Processor -- start 2024-04-12T19:38:56.719 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.719+0000 7f7bfe600640 1 -- start start 2024-04-12T19:38:56.720 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bfe600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7bf80c3610 0x7f7bf80c1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:56.720 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bfe600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bf80c4790 0x7f7bf80c5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:56.721 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bfe600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7bf806e650 0x7f7bf80c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:56.721 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bfe600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf8151f00 con 0x7f7bf80c3610 2024-04-12T19:38:56.721 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bfe600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7bf80c0ae0 con 0x7f7bf806e650 2024-04-12T19:38:56.721 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bfe600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf81515d0 con 0x7f7bf80c4790 2024-04-12T19:38:56.721 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bf7400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7bf80c3610 0x7f7bf80c1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:56.721 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bf7400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7bf80c3610 0x7f7bf80c1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52164/0 (socket says 172.21.15.131:52164) 2024-04-12T19:38:56.721 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bf7400640 1 -- 172.21.15.131:0/3837250740 learned_addr learned my addr 172.21.15.131:0/3837250740 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:38:56.721 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bf7e00640 1 --2- 172.21.15.131:0/3837250740 >> v2:172.21.15.171:3300/0 conn(0x7f7bf806e650 0x7f7bf80c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:56.721 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bf6a00640 1 --2- 172.21.15.131:0/3837250740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bf80c4790 0x7f7bf80c5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:56.721 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bf7400640 1 -- 172.21.15.131:0/3837250740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bf80c4790 msgr2=0x7f7bf80c5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:56.721 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bf7400640 1 --2- 172.21.15.131:0/3837250740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bf80c4790 0x7f7bf80c5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:56.721 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bf7400640 1 -- 172.21.15.131:0/3837250740 >> v2:172.21.15.171:3300/0 conn(0x7f7bf806e650 msgr2=0x7f7bf80c5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:38:56.722 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bf7400640 1 --2- 172.21.15.131:0/3837250740 >> v2:172.21.15.171:3300/0 conn(0x7f7bf806e650 0x7f7bf80c5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:56.722 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.720+0000 7f7bf7400640 1 -- 172.21.15.131:0/3837250740 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf81518b0 con 0x7f7bf80c3610 2024-04-12T19:38:56.723 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.721+0000 7f7bf7400640 1 --2- 172.21.15.131:0/3837250740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80c3610 0x7f7bf80c1540 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80bd9f0 tx=0x7f7be802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=575843ea6a46017a server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:56.723 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.722+0000 7f7bf6000640 1 -- 172.21.15.131:0/3837250740 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8035020 con 0x7f7bf80c3610 2024-04-12T19:38:56.723 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.722+0000 7f7bf6000640 1 -- 172.21.15.131:0/3837250740 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be8031870 con 0x7f7bf80c3610 2024-04-12T19:38:56.723 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.722+0000 7f7bf6000640 1 -- 172.21.15.131:0/3837250740 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be8031c40 con 0x7f7bf80c3610 2024-04-12T19:38:56.723 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.722+0000 7f7bfe600640 1 -- 172.21.15.131:0/3837250740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80c3610 msgr2=0x7f7bf80c1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:56.723 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.722+0000 7f7bfe600640 1 --2- 172.21.15.131:0/3837250740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80c3610 0x7f7bf80c1540 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7bf80bd9f0 tx=0x7f7be802b910 comp rx=0 tx=0).stop 2024-04-12T19:38:56.723 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.722+0000 7f7bfe600640 1 -- 172.21.15.131:0/3837250740 shutdown_connections 2024-04-12T19:38:56.723 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.722+0000 7f7bfe600640 1 --2- 172.21.15.131:0/3837250740 >> v2:172.21.15.171:3300/0 conn(0x7f7bf806e650 0x7f7bf80c5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:56.723 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.722+0000 7f7bfe600640 1 --2- 172.21.15.131:0/3837250740 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bf80c4790 0x7f7bf80c5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:56.723 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.722+0000 7f7bfe600640 1 --2- 172.21.15.131:0/3837250740 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80c3610 0x7f7bf80c1540 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:56.724 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.723+0000 7f7bfe600640 1 -- 172.21.15.131:0/3837250740 >> 172.21.15.131:0/3837250740 conn(0x7f7bf80a84c0 msgr2=0x7f7bf80a88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:56.724 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.723+0000 7f7bfe600640 1 -- 172.21.15.131:0/3837250740 shutdown_connections 2024-04-12T19:38:56.724 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.723+0000 7f7bfe600640 1 -- 172.21.15.131:0/3837250740 wait complete. 2024-04-12T19:38:56.724 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.724+0000 7f7bfe600640 1 Processor -- start 2024-04-12T19:38:56.724 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.724+0000 7f7bfe600640 1 -- start start 2024-04-12T19:38:56.727 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.725+0000 7f7bfe600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bf806e650 0x7f7bf814fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:56.727 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.725+0000 7f7bfe600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80c3610 0x7f7bf80bca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:56.727 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.725+0000 7f7bfe600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7bf80c4790 0x7f7bf80bcfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:38:56.727 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.725+0000 7f7bfe600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf8151280 con 0x7f7bf80c3610 2024-04-12T19:38:56.727 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.725+0000 7f7bfe600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7bf80c4da0 con 0x7f7bf80c4790 2024-04-12T19:38:56.727 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.725+0000 7f7bfe600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7bf80c39f0 con 0x7f7bf806e650 2024-04-12T19:38:56.727 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.725+0000 7f7bf6a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80c3610 0x7f7bf80bca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:56.727 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.725+0000 7f7bf6a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80c3610 0x7f7bf80bca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:52168/0 (socket says 172.21.15.131:52168) 2024-04-12T19:38:56.727 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.725+0000 7f7bf6a00640 1 -- 172.21.15.131:0/2463512537 learned_addr learned my addr 172.21.15.131:0/2463512537 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:38:56.727 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.725+0000 7f7bf7400640 1 --2- 172.21.15.131:0/2463512537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bf806e650 0x7f7bf814fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:56.727 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.725+0000 7f7bf7e00640 1 --2- 172.21.15.131:0/2463512537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7bf80c4790 0x7f7bf80bcfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:38:56.727 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.726+0000 7f7bf6a00640 1 -- 172.21.15.131:0/2463512537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bf806e650 msgr2=0x7f7bf814fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.726+0000 7f7bf6a00640 1 --2- 172.21.15.131:0/2463512537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bf806e650 0x7f7bf814fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.726+0000 7f7bf6a00640 1 -- 172.21.15.131:0/2463512537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7bf80c4790 msgr2=0x7f7bf80bcfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.726+0000 7f7bf6a00640 1 --2- 172.21.15.131:0/2463512537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7bf80c4790 0x7f7bf80bcfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.726+0000 7f7bf6a00640 1 -- 172.21.15.131:0/2463512537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bf8150340 con 0x7f7bf80c3610 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.726+0000 7f7bf7400640 1 --2- 172.21.15.131:0/2463512537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bf806e650 0x7f7bf814fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.726+0000 7f7bf6a00640 1 --2- 172.21.15.131:0/2463512537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80c3610 0x7f7bf80bca60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7be400e8a0 tx=0x7f7be400ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.726+0000 7f7bef400640 1 -- 172.21.15.131:0/2463512537 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be4017070 con 0x7f7bf80c3610 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.726+0000 7f7bef400640 1 -- 172.21.15.131:0/2463512537 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7be400c940 con 0x7f7bf80c3610 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.726+0000 7f7bef400640 1 -- 172.21.15.131:0/2463512537 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7be400cd30 con 0x7f7bf80c3610 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.726+0000 7f7bfe600640 1 -- 172.21.15.131:0/2463512537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bf81eb150 con 0x7f7bf80c3610 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.726+0000 7f7bfe600640 1 -- 172.21.15.131:0/2463512537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bf81eb3d0 con 0x7f7bf80c3610 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.727+0000 7f7bef400640 1 -- 172.21.15.131:0/2463512537 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7be401a070 con 0x7f7bf80c3610 2024-04-12T19:38:56.728 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.727+0000 7f7bef400640 1 -- 172.21.15.131:0/2463512537 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7be4006020 con 0x7f7bf80c3610 2024-04-12T19:38:56.729 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.727+0000 7f7bfe600640 1 -- 172.21.15.131:0/2463512537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7bf8075c80 con 0x7f7bf80c3610 2024-04-12T19:38:56.730 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.730+0000 7f7bef400640 1 -- 172.21.15.131:0/2463512537 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7bf81eb150 con 0x7f7bf80c3610 2024-04-12T19:38:56.797 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.797+0000 7f7bfe600640 1 -- 172.21.15.131:0/2463512537 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7bf80ac910 con 0x7f7bf80c3610 2024-04-12T19:38:56.798 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:56.798+0000 7fedb843f040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-12T19:38:56.798 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.798+0000 7f7bef400640 1 -- 172.21.15.131:0/2463512537 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7be4006480 con 0x7f7bf80c3610 2024-04-12T19:38:56.798 INFO:teuthology.misc.health.smithi131.stdout: 2024-04-12T19:38:56.799 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":10,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:38:55.344572+0000","last_up_change":"0.000000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:38:56.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.800+0000 7f7bfe600640 1 -- 172.21.15.131:0/2463512537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80c3610 msgr2=0x7f7bf80bca60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:38:56.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.800+0000 7f7bfe600640 1 --2- 172.21.15.131:0/2463512537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80c3610 0x7f7bf80bca60 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f7be400e8a0 tx=0x7f7be400ed60 comp rx=0 tx=0).stop 2024-04-12T19:38:56.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.800+0000 7f7bfe600640 1 -- 172.21.15.131:0/2463512537 shutdown_connections 2024-04-12T19:38:56.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.800+0000 7f7bfe600640 1 --2- 172.21.15.131:0/2463512537 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7bf80c4790 0x7f7bf80bcfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:56.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.800+0000 7f7bfe600640 1 --2- 172.21.15.131:0/2463512537 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7bf80c3610 0x7f7bf80bca60 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:56.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.800+0000 7f7bfe600640 1 --2- 172.21.15.131:0/2463512537 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7bf806e650 0x7f7bf814fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:38:56.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.800+0000 7f7bfe600640 1 -- 172.21.15.131:0/2463512537 >> 172.21.15.131:0/2463512537 conn(0x7f7bf80a84c0 msgr2=0x7f7bf806d240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:38:56.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.800+0000 7f7bfe600640 1 -- 172.21.15.131:0/2463512537 shutdown_connections 2024-04-12T19:38:56.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:38:56.800+0000 7f7bfe600640 1 -- 172.21.15.131:0/2463512537 wait complete. 2024-04-12T19:38:56.813 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-12T19:38:56.909 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:56.908+0000 7fd2e1e11040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-12T19:38:57.227 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:57.227+0000 7fd2e1e11040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-12T19:38:57.290 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:57.290+0000 7fd2e1e11040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-12T19:38:57.424 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-12T19:38:57.423+0000 7fd2e1e11040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-12T19:38:57.828 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:57.829+0000 7fed58a00640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-12T19:38:57.835 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T19:38:57.835+0000 7fed58a00640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-12T19:38:59.527 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-12T19:38:59.527+0000 7f72b4811640 -1 osd.4 0 log_to_monitors true 2024-04-12T19:38:59.556 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-12T19:38:59.555+0000 7f9c39e1f640 -1 osd.6 0 log_to_monitors true 2024-04-12T19:38:59.655 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-04-12T19:38:59.655+0000 7ff5e5545640 -1 osd.0 0 log_to_monitors true 2024-04-12T19:38:59.689 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-12T19:38:59.689+0000 7f1bc9f38640 -1 osd.1 0 log_to_monitors true 2024-04-12T19:38:59.722 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-12T19:38:59.722+0000 7f1134593640 -1 osd.5 0 log_to_monitors true 2024-04-12T19:38:59.778 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-04-12T19:38:59.777+0000 7f0179dbb640 -1 osd.7 0 log_to_monitors true 2024-04-12T19:38:59.797 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-12T19:38:59.797+0000 7fa3c15bb640 -1 osd.2 0 log_to_monitors true 2024-04-12T19:38:59.798 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-12T19:38:59.798+0000 7f1658a13640 -1 osd.3 0 log_to_monitors true 2024-04-12T19:39:02.299 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-12T19:39:02.299+0000 7f1653800640 -1 osd.3 0 waiting for initial osdmap 2024-04-12T19:39:02.306 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-12T19:39:02.307+0000 7f1648e00640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T19:39:02.319 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-04-12T19:39:02.320+0000 7ff5e0a00640 -1 osd.0 0 waiting for initial osdmap 2024-04-12T19:39:02.327 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-04-12T19:39:02.328+0000 7ff5d6000640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T19:39:02.362 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-12T19:39:02.362+0000 7f1bc5400640 -1 osd.1 0 waiting for initial osdmap 2024-04-12T19:39:02.369 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-12T19:39:02.369+0000 7f1bbaa00640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T19:39:02.381 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-04-12T19:39:02.381+0000 7f0174800640 -1 osd.7 0 waiting for initial osdmap 2024-04-12T19:39:02.381 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-12T19:39:02.382+0000 7f112f000640 -1 osd.5 0 waiting for initial osdmap 2024-04-12T19:39:02.384 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-12T19:39:02.384+0000 7f72aee00640 -1 osd.4 0 waiting for initial osdmap 2024-04-12T19:39:02.384 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-12T19:39:02.384+0000 7f9c34e00640 -1 osd.6 0 waiting for initial osdmap 2024-04-12T19:39:02.388 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-04-12T19:39:02.388+0000 7f016a800640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T19:39:02.389 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-12T19:39:02.389+0000 7f1125000640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T19:39:02.391 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-12T19:39:02.390+0000 7f72a4e00640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T19:39:02.392 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-12T19:39:02.392+0000 7f9c2a400640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T19:39:02.443 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-12T19:39:02.443+0000 7fa3bc000640 -1 osd.2 0 waiting for initial osdmap 2024-04-12T19:39:02.459 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-12T19:39:02.459+0000 7fa3b2000640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-12T19:39:03.621 DEBUG:teuthology.orchestra.run.smithi131:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:03.796 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.796+0000 7fbcb6e00640 1 Processor -- start 2024-04-12T19:39:03.796 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.796+0000 7fbcb6e00640 1 -- start start 2024-04-12T19:39:03.798 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.797+0000 7fbcb6e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fbcb0151ce0 0x7fbcb00bd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:03.798 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.797+0000 7fbcb6e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbcb00be2d0 0x7fbcb00c2b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:03.798 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.797+0000 7fbcb6e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb00c3090 0x7fbcb00b7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:03.798 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.797+0000 7fbcb6e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb00bce70 con 0x7fbcb00be2d0 2024-04-12T19:39:03.798 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.797+0000 7fbcb6e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fbcb00bd430 con 0x7fbcb0151ce0 2024-04-12T19:39:03.798 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.797+0000 7fbcb6e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb00b90e0 con 0x7fbcb00c3090 2024-04-12T19:39:03.798 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.798+0000 7fbcaf400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbcb00be2d0 0x7fbcb00c2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:03.798 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.798+0000 7fbcaf400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fbcb00be2d0 0x7fbcb00c2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49044/0 (socket says 172.21.15.131:49044) 2024-04-12T19:39:03.798 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.798+0000 7fbcaf400640 1 -- 172.21.15.131:0/2981044140 learned_addr learned my addr 172.21.15.131:0/2981044140 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:03.799 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.798+0000 7fbcaf400640 1 -- 172.21.15.131:0/2981044140 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb00c3090 msgr2=0x7fbcb00b7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:03.799 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.798+0000 7fbcb4e00640 1 --2- 172.21.15.131:0/2981044140 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb00c3090 0x7fbcb00b7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:03.799 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.798+0000 7fbcafe00640 1 --2- 172.21.15.131:0/2981044140 >> v2:172.21.15.171:3300/0 conn(0x7fbcb0151ce0 0x7fbcb00bd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:03.799 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.798+0000 7fbcaf400640 1 --2- 172.21.15.131:0/2981044140 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb00c3090 0x7fbcb00b7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:03.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.798+0000 7fbcaf400640 1 -- 172.21.15.131:0/2981044140 >> v2:172.21.15.171:3300/0 conn(0x7fbcb0151ce0 msgr2=0x7fbcb00bd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:03.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.798+0000 7fbcaf400640 1 --2- 172.21.15.131:0/2981044140 >> v2:172.21.15.171:3300/0 conn(0x7fbcb0151ce0 0x7fbcb00bd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:03.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.798+0000 7fbcaf400640 1 -- 172.21.15.131:0/2981044140 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb0155150 con 0x7fbcb00be2d0 2024-04-12T19:39:03.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.798+0000 7fbcafe00640 1 --2- 172.21.15.131:0/2981044140 >> v2:172.21.15.171:3300/0 conn(0x7fbcb0151ce0 0x7fbcb00bd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:03.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.799+0000 7fbcaf400640 1 --2- 172.21.15.131:0/2981044140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcb00be2d0 0x7fbcb00c2b50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbcb006d6a0 tx=0x7fbc9802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17485fc943f02648 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:03.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.800+0000 7fbcaea00640 1 -- 172.21.15.131:0/2981044140 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc98035020 con 0x7fbcb00be2d0 2024-04-12T19:39:03.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.800+0000 7fbcaea00640 1 -- 172.21.15.131:0/2981044140 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc98031870 con 0x7fbcb00be2d0 2024-04-12T19:39:03.800 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.800+0000 7fbcaea00640 1 -- 172.21.15.131:0/2981044140 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc98031c40 con 0x7fbcb00be2d0 2024-04-12T19:39:03.801 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.800+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2981044140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcb00be2d0 msgr2=0x7fbcb00c2b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:03.801 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.800+0000 7fbcb6e00640 1 --2- 172.21.15.131:0/2981044140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcb00be2d0 0x7fbcb00c2b50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbcb006d6a0 tx=0x7fbc9802b910 comp rx=0 tx=0).stop 2024-04-12T19:39:03.801 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.800+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2981044140 shutdown_connections 2024-04-12T19:39:03.801 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.800+0000 7fbcb6e00640 1 --2- 172.21.15.131:0/2981044140 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb00c3090 0x7fbcb00b7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:03.801 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.800+0000 7fbcb6e00640 1 --2- 172.21.15.131:0/2981044140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcb00be2d0 0x7fbcb00c2b50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:03.801 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.800+0000 7fbcb6e00640 1 --2- 172.21.15.131:0/2981044140 >> v2:172.21.15.171:3300/0 conn(0x7fbcb0151ce0 0x7fbcb00bd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:03.801 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.800+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2981044140 >> 172.21.15.131:0/2981044140 conn(0x7fbcb006bf90 msgr2=0x7fbcb00c2440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:03.801 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.800+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2981044140 shutdown_connections 2024-04-12T19:39:03.802 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.800+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2981044140 wait complete. 2024-04-12T19:39:03.802 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.802+0000 7fbcb6e00640 1 Processor -- start 2024-04-12T19:39:03.802 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.802+0000 7fbcb6e00640 1 -- start start 2024-04-12T19:39:03.804 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcb6e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcb00be2d0 0x7fbcb0153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:03.804 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcb6e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcb00c3090 0x7fbcb00c1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:03.804 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcb6e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb0151ce0 0x7fbcb00b9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:03.804 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcb6e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb00bd0c0 con 0x7fbcb00c3090 2024-04-12T19:39:03.804 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcb6e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fbcb0155410 con 0x7fbcb00be2d0 2024-04-12T19:39:03.804 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcb6e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fbcb006e150 con 0x7fbcb0151ce0 2024-04-12T19:39:03.804 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcaf400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcb00c3090 0x7fbcb00c1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcaf400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcb00c3090 0x7fbcb00c1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49050/0 (socket says 172.21.15.131:49050) 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcaf400640 1 -- 172.21.15.131:0/2944425784 learned_addr learned my addr 172.21.15.131:0/2944425784 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcafe00640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcb00be2d0 0x7fbcb0153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcaf400640 1 -- 172.21.15.131:0/2944425784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb0151ce0 msgr2=0x7fbcb00b9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcaf400640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb0151ce0 0x7fbcb00b9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcaf400640 1 -- 172.21.15.131:0/2944425784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcb00be2d0 msgr2=0x7fbcb0153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcaf400640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcb00be2d0 0x7fbcb0153e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.803+0000 7fbcaf400640 1 -- 172.21.15.131:0/2944425784 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcb01eae50 con 0x7fbcb00c3090 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.804+0000 7fbcaf400640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcb00c3090 0x7fbcb00c1940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbc9802b950 tx=0x7fbc980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.804+0000 7fbca7e00640 1 -- 172.21.15.131:0/2944425784 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc98040070 con 0x7fbcb00c3090 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.804+0000 7fbca7e00640 1 -- 172.21.15.131:0/2944425784 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc9803a420 con 0x7fbcb00c3090 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.804+0000 7fbca7e00640 1 -- 172.21.15.131:0/2944425784 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc98035040 con 0x7fbcb00c3090 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.804+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2944425784 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcb0072af0 con 0x7fbcb00c3090 2024-04-12T19:39:03.805 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.804+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2944425784 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcb00730b0 con 0x7fbcb00c3090 2024-04-12T19:39:03.806 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.805+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2944425784 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcb0075c80 con 0x7fbcb00c3090 2024-04-12T19:39:03.806 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.806+0000 7fbca7e00640 1 -- 172.21.15.131:0/2944425784 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fbc9804b060 con 0x7fbcb00c3090 2024-04-12T19:39:03.807 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.807+0000 7fbca7e00640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fbc8c06c890 0x7fbc8c06ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:03.807 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.807+0000 7fbca7e00640 1 -- 172.21.15.131:0/2944425784 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7fbc980ad500 con 0x7fbcb00c3090 2024-04-12T19:39:03.807 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.807+0000 7fbcafe00640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fbc8c06c890 0x7fbc8c06ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:03.807 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.808+0000 7fbcafe00640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fbc8c06c890 0x7fbc8c06ed50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbca0008850 tx=0x7fbca0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:03.812 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:03.812+0000 7fbca7e00640 1 -- 172.21.15.131:0/2944425784 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fbc9807bed0 con 0x7fbcb00c3090 2024-04-12T19:39:04.018 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.018+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2944425784 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbcb00b87d0 con 0x7fbcb00c3090 2024-04-12T19:39:04.019 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.019+0000 7fbca7e00640 1 -- 172.21.15.131:0/2944425784 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+10897 (secure 0 0 0) 0x7fbc9807b7d0 con 0x7fbcb00c3090 2024-04-12T19:39:04.020 INFO:teuthology.misc.health.smithi131.stdout: 2024-04-12T19:39:04.020 INFO:teuthology.misc.health.smithi131.stdout:{"epoch":13,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:03.295046+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:04.022 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.022+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2944425784 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fbc8c06c890 msgr2=0x7fbc8c06ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.022 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.022+0000 7fbcb6e00640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fbc8c06c890 0x7fbc8c06ed50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fbca0008850 tx=0x7fbca0008040 comp rx=0 tx=0).stop 2024-04-12T19:39:04.023 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.022+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2944425784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcb00c3090 msgr2=0x7fbcb00c1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.023 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.022+0000 7fbcb6e00640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcb00c3090 0x7fbcb00c1940 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fbc9802b950 tx=0x7fbc980046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.023 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.022+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2944425784 shutdown_connections 2024-04-12T19:39:04.023 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.022+0000 7fbcb6e00640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fbc8c06c890 0x7fbc8c06ed50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.023 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.022+0000 7fbcb6e00640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fbcb0151ce0 0x7fbcb00b9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.023 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.022+0000 7fbcb6e00640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcb00c3090 0x7fbcb00c1940 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.023 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.022+0000 7fbcb6e00640 1 --2- 172.21.15.131:0/2944425784 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fbcb00be2d0 0x7fbcb0153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.023 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.022+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2944425784 >> 172.21.15.131:0/2944425784 conn(0x7fbcb006bf90 msgr2=0x7fbcb00c2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:04.023 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.022+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2944425784 shutdown_connections 2024-04-12T19:39:04.023 INFO:teuthology.misc.health.smithi131.stderr:2024-04-12T19:39:04.022+0000 7fbcb6e00640 1 -- 172.21.15.131:0/2944425784 wait complete. 2024-04-12T19:39:04.036 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-12T19:39:04.036 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-12T19:39:04.036 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-12T19:39:04.037 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-12T19:39:04.043 INFO:tasks.ceph.mds.a:Started 2024-04-12T19:39:04.043 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-12T19:39:04.043 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-12T19:39:04.050 INFO:tasks.ceph.mds.c:Started 2024-04-12T19:39:04.050 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-12T19:39:04.051 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-12T19:39:04.058 INFO:tasks.ceph.mds.b:Started 2024-04-12T19:39:04.058 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-12T19:39:04.058 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-12T19:39:04.066 INFO:tasks.ceph.mds.d:Started 2024-04-12T19:39:04.066 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-12T19:39:04.066 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:04.195 INFO:tasks.ceph.mds.a.smithi131.stdout:starting mds.a at 2024-04-12T19:39:04.197 INFO:tasks.ceph.mds.c.smithi131.stdout:starting mds.c at 2024-04-12T19:39:04.226 INFO:tasks.ceph.mds.b.smithi171.stdout:starting mds.b at 2024-04-12T19:39:04.227 INFO:tasks.ceph.mds.d.smithi171.stdout:starting mds.d at 2024-04-12T19:39:04.249 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.249+0000 7f0d60c00640 1 Processor -- start 2024-04-12T19:39:04.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.250+0000 7f0d60c00640 1 -- start start 2024-04-12T19:39:04.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d60c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0d5c0c1320 0x7f0d5c151c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:04.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d60c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d5c0c4780 0x7f0d5c06d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:04.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d60c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d5c0c1820 con 0x7f0d5c14b5d0 2024-04-12T19:39:04.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d60c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f0d5c0c0860 con 0x7f0d5c0c1320 2024-04-12T19:39:04.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d60c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c1517b0 con 0x7f0d5c0c4780 2024-04-12T19:39:04.251 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d59e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f0d5c14b5d0 0x7f0d5c0c4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53564/0 (socket says 172.21.15.131:53564) 2024-04-12T19:39:04.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d59e00640 1 -- 172.21.15.131:0/1128540158 learned_addr learned my addr 172.21.15.131:0/1128540158 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:04.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d59400640 1 --2- 172.21.15.131:0/1128540158 >> v2:172.21.15.131:3300/0 conn(0x7f0d5c0c1320 0x7f0d5c151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:04.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d5a800640 1 --2- 172.21.15.131:0/1128540158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d5c0c4780 0x7f0d5c06d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:04.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d58a00640 1 -- 172.21.15.131:0/1128540158 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3478639531 0 0) 0x7f0d5c0c1820 con 0x7f0d5c14b5d0 2024-04-12T19:39:04.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d59400640 1 -- 172.21.15.131:0/1128540158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d5c0c4780 msgr2=0x7f0d5c06d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:04.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d59400640 1 --2- 172.21.15.131:0/1128540158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d5c0c4780 0x7f0d5c06d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d59400640 1 -- 172.21.15.131:0/1128540158 >> v1:172.21.15.131:6789/0 conn(0x7f0d5c14b5d0 legacy=0x7f0d5c0c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.251+0000 7f0d59400640 1 -- 172.21.15.131:0/1128540158 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c0c1b00 con 0x7f0d5c0c1320 2024-04-12T19:39:04.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.252+0000 7f0d59400640 1 --2- 172.21.15.131:0/1128540158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c0c1320 0x7f0d5c151c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d480097a0 tx=0x7f0d4802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3411527fea3a11b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:04.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.253+0000 7f0d58a00640 1 -- 172.21.15.131:0/1128540158 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d480315a0 con 0x7f0d5c0c1320 2024-04-12T19:39:04.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.253+0000 7f0d58a00640 1 -- 172.21.15.131:0/1128540158 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d48037070 con 0x7f0d5c0c1320 2024-04-12T19:39:04.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.253+0000 7f0d58a00640 1 -- 172.21.15.131:0/1128540158 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48031960 con 0x7f0d5c0c1320 2024-04-12T19:39:04.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.253+0000 7f0d60c00640 1 -- 172.21.15.131:0/1128540158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c0c1320 msgr2=0x7f0d5c151c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.253+0000 7f0d60c00640 1 --2- 172.21.15.131:0/1128540158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c0c1320 0x7f0d5c151c40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0d480097a0 tx=0x7f0d4802b840 comp rx=0 tx=0).stop 2024-04-12T19:39:04.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.253+0000 7f0d60c00640 1 -- 172.21.15.131:0/1128540158 shutdown_connections 2024-04-12T19:39:04.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.253+0000 7f0d60c00640 1 --2- 172.21.15.131:0/1128540158 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d5c0c4780 0x7f0d5c06d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.253+0000 7f0d60c00640 1 --2- 172.21.15.131:0/1128540158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c0c1320 0x7f0d5c151c40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.253+0000 7f0d60c00640 1 -- 172.21.15.131:0/1128540158 >> 172.21.15.131:0/1128540158 conn(0x7f0d5c0a84b0 msgr2=0x7f0d5c0a88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:04.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.254+0000 7f0d60c00640 1 -- 172.21.15.131:0/1128540158 shutdown_connections 2024-04-12T19:39:04.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.254+0000 7f0d60c00640 1 -- 172.21.15.131:0/1128540158 wait complete. 2024-04-12T19:39:04.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.255+0000 7f0d60c00640 1 Processor -- start 2024-04-12T19:39:04.255 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.255+0000 7f0d60c00640 1 -- start start 2024-04-12T19:39:04.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.256+0000 7f0d60c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d5c0c1320 0x7f0d5c1ea020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:04.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.256+0000 7f0d60c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d5c0c4780 0x7f0d5c14de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:04.257 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.256+0000 7f0d60c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c14b5d0 0x7f0d5c0ab790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.256+0000 7f0d60c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c1510f0 con 0x7f0d5c14b5d0 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.256+0000 7f0d60c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0d5c0c54c0 con 0x7f0d5c0c4780 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.256+0000 7f0d60c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0d5c0c0c80 con 0x7f0d5c0c1320 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.256+0000 7f0d5a800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c14b5d0 0x7f0d5c0ab790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.256+0000 7f0d59e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d5c0c1320 0x7f0d5c1ea020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.256+0000 7f0d5a800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c14b5d0 0x7f0d5c0ab790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49102/0 (socket says 172.21.15.131:49102) 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.256+0000 7f0d5a800640 1 -- 172.21.15.131:0/872708257 learned_addr learned my addr 172.21.15.131:0/872708257 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.257+0000 7f0d59400640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d5c0c4780 0x7f0d5c14de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.257+0000 7f0d59e00640 1 -- 172.21.15.131:0/872708257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d5c0c4780 msgr2=0x7f0d5c14de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.257+0000 7f0d59e00640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d5c0c4780 0x7f0d5c14de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.257+0000 7f0d59e00640 1 -- 172.21.15.131:0/872708257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c14b5d0 msgr2=0x7f0d5c0ab790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.257+0000 7f0d59e00640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c14b5d0 0x7f0d5c0ab790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.257+0000 7f0d59e00640 1 -- 172.21.15.131:0/872708257 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5c150650 con 0x7f0d5c0c1320 2024-04-12T19:39:04.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.257+0000 7f0d5a800640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c14b5d0 0x7f0d5c0ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:39:04.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.257+0000 7f0d59e00640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d5c0c1320 0x7f0d5c1ea020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c480 tx=0x7f0d4c00c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:04.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.257+0000 7f0d52000640 1 -- 172.21.15.131:0/872708257 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c018070 con 0x7f0d5c0c1320 2024-04-12T19:39:04.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.258+0000 7f0d52000640 1 -- 172.21.15.131:0/872708257 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d4c0074e0 con 0x7f0d5c0c1320 2024-04-12T19:39:04.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.258+0000 7f0d60c00640 1 -- 172.21.15.131:0/872708257 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d5c150370 con 0x7f0d5c0c1320 2024-04-12T19:39:04.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.258+0000 7f0d52000640 1 -- 172.21.15.131:0/872708257 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d4c004a20 con 0x7f0d5c0c1320 2024-04-12T19:39:04.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.258+0000 7f0d60c00640 1 -- 172.21.15.131:0/872708257 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d5c1ead20 con 0x7f0d5c0c1320 2024-04-12T19:39:04.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.259+0000 7f0d60c00640 1 -- 172.21.15.131:0/872708257 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d5c04fd50 con 0x7f0d5c0c1320 2024-04-12T19:39:04.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.260+0000 7f0d52000640 1 -- 172.21.15.131:0/872708257 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f0d4c01b070 con 0x7f0d5c0c1320 2024-04-12T19:39:04.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.260+0000 7f0d52000640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0d3c06c890 0x7f0d3c06ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:04.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.261+0000 7f0d52000640 1 -- 172.21.15.131:0/872708257 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(13..13 src has 1..13) ==== 4471+0+0 (secure 0 0 0) 0x7f0d4c08a780 con 0x7f0d5c0c1320 2024-04-12T19:39:04.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.261+0000 7f0d59400640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0d3c06c890 0x7f0d3c06ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:04.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.261+0000 7f0d59400640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0d3c06c890 0x7f0d3c06ed50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d48036000 tx=0x7f0d48008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:04.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.266+0000 7f0d52000640 1 -- 172.21.15.131:0/872708257 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0d4c058b00 con 0x7f0d5c0c1320 2024-04-12T19:39:04.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.468+0000 7f0d60c00640 1 -- 172.21.15.131:0/872708257 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0d5c0a7200 con 0x7f0d5c0c1320 2024-04-12T19:39:04.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.471+0000 7f0d52000640 1 -- 172.21.15.131:0/872708257 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+11081 (secure 0 0 0) 0x7f0d4c05ce00 con 0x7f0d5c0c1320 2024-04-12T19:39:04.471 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:04.471 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":14,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:04.319777+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:04.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.473+0000 7f0d60c00640 1 -- 172.21.15.131:0/872708257 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0d3c06c890 msgr2=0x7f0d3c06ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.473+0000 7f0d60c00640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0d3c06c890 0x7f0d3c06ed50 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f0d48036000 tx=0x7f0d48008030 comp rx=0 tx=0).stop 2024-04-12T19:39:04.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.473+0000 7f0d60c00640 1 -- 172.21.15.131:0/872708257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d5c0c1320 msgr2=0x7f0d5c1ea020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.473+0000 7f0d60c00640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d5c0c1320 0x7f0d5c1ea020 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0d4c00c480 tx=0x7f0d4c00c940 comp rx=0 tx=0).stop 2024-04-12T19:39:04.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.474+0000 7f0d60c00640 1 -- 172.21.15.131:0/872708257 shutdown_connections 2024-04-12T19:39:04.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.474+0000 7f0d60c00640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0d3c06c890 0x7f0d3c06ed50 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.474+0000 7f0d60c00640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0d5c0c4780 0x7f0d5c14de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.474+0000 7f0d60c00640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0d5c14b5d0 0x7f0d5c0ab790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.474+0000 7f0d60c00640 1 --2- 172.21.15.131:0/872708257 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0d5c0c1320 0x7f0d5c1ea020 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.474+0000 7f0d60c00640 1 -- 172.21.15.131:0/872708257 >> 172.21.15.131:0/872708257 conn(0x7f0d5c0a84b0 msgr2=0x7f0d5c06d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.474+0000 7f0d60c00640 1 -- 172.21.15.131:0/872708257 shutdown_connections 2024-04-12T19:39:04.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.474+0000 7f0d60c00640 1 -- 172.21.15.131:0/872708257 wait complete. 2024-04-12T19:39:04.492 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2024-04-12T19:39:04.492 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-12T19:39:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.697+0000 7f7c82400640 1 Processor -- start 2024-04-12T19:39:04.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.697+0000 7f7c82400640 1 -- start start 2024-04-12T19:39:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.698+0000 7f7c82400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7c154af0 0x7f7c7c06f470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.698+0000 7f7c82400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7c7c0be5e0 0x7f7c7c0b7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.698+0000 7f7c82400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c7c154fb0 con 0x7f7c7c14b190 2024-04-12T19:39:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.699+0000 7f7c82400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7c7c0bd950 con 0x7f7c7c0be5e0 2024-04-12T19:39:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.699+0000 7f7c82400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c7c06e990 con 0x7f7c7c154af0 2024-04-12T19:39:04.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.699+0000 7f7c81000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f7c7c14b190 0x7f7c7c1543e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53580/0 (socket says 172.21.15.131:53580) 2024-04-12T19:39:04.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.699+0000 7f7c81a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7c7c0be5e0 0x7f7c7c0b7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:04.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.699+0000 7f7c81000640 1 -- 172.21.15.131:0/3754920202 learned_addr learned my addr 172.21.15.131:0/3754920202 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:04.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.699+0000 7f7c7be00640 1 --2- 172.21.15.131:0/3754920202 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7c154af0 0x7f7c7c06f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:04.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.699+0000 7f7c81a00640 1 -- 172.21.15.131:0/3754920202 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7c154af0 msgr2=0x7f7c7c06f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:04.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.699+0000 7f7c81a00640 1 --2- 172.21.15.131:0/3754920202 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7c154af0 0x7f7c7c06f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.699+0000 7f7c81a00640 1 -- 172.21.15.131:0/3754920202 >> v1:172.21.15.131:6789/0 conn(0x7f7c7c14b190 legacy=0x7f7c7c1543e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.699+0000 7f7c81a00640 1 -- 172.21.15.131:0/3754920202 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7c06ec70 con 0x7f7c7c0be5e0 2024-04-12T19:39:04.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.700+0000 7f7c81a00640 1 --2- 172.21.15.131:0/3754920202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7c0be5e0 0x7f7c7c0b7250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009d90 tx=0x7f7c7402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d75de2d94e0fca server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:04.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.701+0000 7f7c7b400640 1 -- 172.21.15.131:0/3754920202 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c74039070 con 0x7f7c7c0be5e0 2024-04-12T19:39:04.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.701+0000 7f7c7b400640 1 -- 172.21.15.131:0/3754920202 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c7402cc60 con 0x7f7c7c0be5e0 2024-04-12T19:39:04.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.701+0000 7f7c7b400640 1 -- 172.21.15.131:0/3754920202 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c74034660 con 0x7f7c7c0be5e0 2024-04-12T19:39:04.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.701+0000 7f7c82400640 1 -- 172.21.15.131:0/3754920202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7c0be5e0 msgr2=0x7f7c7c0b7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.701+0000 7f7c82400640 1 --2- 172.21.15.131:0/3754920202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7c0be5e0 0x7f7c7c0b7250 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7c74009d90 tx=0x7f7c7402beb0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.701+0000 7f7c82400640 1 -- 172.21.15.131:0/3754920202 shutdown_connections 2024-04-12T19:39:04.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.701+0000 7f7c82400640 1 --2- 172.21.15.131:0/3754920202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7c0be5e0 0x7f7c7c0b7250 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.701+0000 7f7c82400640 1 --2- 172.21.15.131:0/3754920202 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7c154af0 0x7f7c7c06f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.701+0000 7f7c82400640 1 -- 172.21.15.131:0/3754920202 >> 172.21.15.131:0/3754920202 conn(0x7f7c7c0c24d0 msgr2=0x7f7c7c0c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:04.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.702+0000 7f7c82400640 1 -- 172.21.15.131:0/3754920202 shutdown_connections 2024-04-12T19:39:04.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.702+0000 7f7c82400640 1 -- 172.21.15.131:0/3754920202 wait complete. 2024-04-12T19:39:04.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.703+0000 7f7c82400640 1 Processor -- start 2024-04-12T19:39:04.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.703+0000 7f7c82400640 1 -- start start 2024-04-12T19:39:04.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.704+0000 7f7c82400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c7c0be5e0 0x7f7c7c1e74e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:04.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.704+0000 7f7c82400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7c14b190 0x7f7c7c146060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:04.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.704+0000 7f7c82400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7c154af0 0x7f7c7c1420b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:04.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.704+0000 7f7c82400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c0bdd60 con 0x7f7c7c14b190 2024-04-12T19:39:04.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.704+0000 7f7c82400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c155290 con 0x7f7c7c0be5e0 2024-04-12T19:39:04.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.704+0000 7f7c82400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c7c0bdee0 con 0x7f7c7c154af0 2024-04-12T19:39:04.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.704+0000 7f7c7be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7c14b190 0x7f7c7c146060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:04.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.704+0000 7f7c7be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7c14b190 0x7f7c7c146060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49132/0 (socket says 172.21.15.131:49132) 2024-04-12T19:39:04.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.704+0000 7f7c7be00640 1 -- 172.21.15.131:0/1583104986 learned_addr learned my addr 172.21.15.131:0/1583104986 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.705+0000 7f7c81a00640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7c154af0 0x7f7c7c1420b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.705+0000 7f7c81000640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c7c0be5e0 0x7f7c7c1e74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.705+0000 7f7c7be00640 1 -- 172.21.15.131:0/1583104986 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7c154af0 msgr2=0x7f7c7c1420b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.705+0000 7f7c7be00640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7c154af0 0x7f7c7c1420b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.705+0000 7f7c7be00640 1 -- 172.21.15.131:0/1583104986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c7c0be5e0 msgr2=0x7f7c7c1e74e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.705+0000 7f7c7be00640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c7c0be5e0 0x7f7c7c1e74e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.705+0000 7f7c7be00640 1 -- 172.21.15.131:0/1583104986 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7c14e0b0 con 0x7f7c7c14b190 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.705+0000 7f7c7be00640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7c14b190 0x7f7c7c146060 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800d5f0 tx=0x7f7c6800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.705+0000 7f7c78c00640 1 -- 172.21.15.131:0/1583104986 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c680125f0 con 0x7f7c7c14b190 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.705+0000 7f7c78c00640 1 -- 172.21.15.131:0/1583104986 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c68019070 con 0x7f7c7c14b190 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.705+0000 7f7c78c00640 1 -- 172.21.15.131:0/1583104986 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c680129d0 con 0x7f7c7c14b190 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.706+0000 7f7c82400640 1 -- 172.21.15.131:0/1583104986 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7c1ead10 con 0x7f7c7c14b190 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.706+0000 7f7c82400640 1 -- 172.21.15.131:0/1583104986 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7c1e6fc0 con 0x7f7c7c14b190 2024-04-12T19:39:04.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.707+0000 7f7c82400640 1 -- 172.21.15.131:0/1583104986 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c7c075c30 con 0x7f7c7c14b190 2024-04-12T19:39:04.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.708+0000 7f7c78c00640 1 -- 172.21.15.131:0/1583104986 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f7c68012b70 con 0x7f7c7c14b190 2024-04-12T19:39:04.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.708+0000 7f7c78c00640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c5c06c860 0x7f7c5c06ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:04.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.708+0000 7f7c78c00640 1 -- 172.21.15.131:0/1583104986 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 4471+0+0 (secure 0 0 0) 0x7f7c6808ba70 con 0x7f7c7c14b190 2024-04-12T19:39:04.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.709+0000 7f7c81000640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c5c06c860 0x7f7c5c06ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:04.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.709+0000 7f7c81000640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c5c06c860 0x7f7c5c06ed20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7c70000f60 tx=0x7f7c70009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:04.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.714+0000 7f7c78c00640 1 -- 172.21.15.131:0/1583104986 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c6805a3b0 con 0x7f7c7c14b190 2024-04-12T19:39:04.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.956+0000 7f7c82400640 1 -- 172.21.15.131:0/1583104986 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c7c14e810 con 0x7f7c7c14b190 2024-04-12T19:39:04.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.957+0000 7f7c78c00640 1 -- 172.21.15.131:0/1583104986 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f7c68059cb0 con 0x7f7c7c14b190 2024-04-12T19:39:04.958 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:04.958 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3941197710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3941197710},{"type":"v1","addr":"172.21.15.131:6836","nonce":3941197710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-12T19:39:04.959 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 2 2024-04-12T19:39:04.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.959+0000 7f7c82400640 1 -- 172.21.15.131:0/1583104986 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c5c06c860 msgr2=0x7f7c5c06ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.960+0000 7f7c82400640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c5c06c860 0x7f7c5c06ed20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7c70000f60 tx=0x7f7c70009040 comp rx=0 tx=0).stop 2024-04-12T19:39:04.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.960+0000 7f7c82400640 1 -- 172.21.15.131:0/1583104986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7c14b190 msgr2=0x7f7c7c146060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:04.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.960+0000 7f7c82400640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7c14b190 0x7f7c7c146060 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800d5f0 tx=0x7f7c6800dab0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.960+0000 7f7c82400640 1 -- 172.21.15.131:0/1583104986 shutdown_connections 2024-04-12T19:39:04.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.960+0000 7f7c82400640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c5c06c860 0x7f7c5c06ed20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.960+0000 7f7c82400640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7c154af0 0x7f7c7c1420b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.960+0000 7f7c82400640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7c14b190 0x7f7c7c146060 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.960+0000 7f7c82400640 1 --2- 172.21.15.131:0/1583104986 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c7c0be5e0 0x7f7c7c1e74e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:04.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.960+0000 7f7c82400640 1 -- 172.21.15.131:0/1583104986 >> 172.21.15.131:0/1583104986 conn(0x7f7c7c0c24d0 msgr2=0x7f7c7c1493e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:04.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.960+0000 7f7c82400640 1 -- 172.21.15.131:0/1583104986 shutdown_connections 2024-04-12T19:39:04.962 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:04.960+0000 7f7c82400640 1 -- 172.21.15.131:0/1583104986 wait complete. 2024-04-12T19:39:06.981 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-12T19:39:07.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.175+0000 7f8498e00640 1 Processor -- start 2024-04-12T19:39:07.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.175+0000 7f8498e00640 1 -- start start 2024-04-12T19:39:07.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.176+0000 7f8498e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f849406f520 0x7f84940b8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:07.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.176+0000 7f8498e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84940b8590 0x7f849415bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:07.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.176+0000 7f8498e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8494155210 con 0x7f8494073b90 2024-04-12T19:39:07.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.176+0000 7f8498e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f84940b91b0 con 0x7f849406f520 2024-04-12T19:39:07.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.176+0000 7f8498e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f84941554f0 con 0x7f84940b8590 2024-04-12T19:39:07.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.176+0000 7f8491400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f849406f520 0x7f84940b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:07.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.176+0000 7f8491400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f849406f520 0x7f84940b8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49158/0 (socket says 172.21.15.131:49158) 2024-04-12T19:39:07.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.176+0000 7f8491e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8494073b90 0x7f84941547f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53592/0 (socket says 172.21.15.131:53592) 2024-04-12T19:39:07.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.176+0000 7f8491400640 1 -- 172.21.15.131:0/3988739509 learned_addr learned my addr 172.21.15.131:0/3988739509 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:07.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.177+0000 7f8492800640 1 --2- 172.21.15.131:0/3988739509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84940b8590 0x7f849415bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:07.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.177+0000 7f8490a00640 1 -- 172.21.15.131:0/3988739509 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640862683 0 0) 0x7f8494155210 con 0x7f8494073b90 2024-04-12T19:39:07.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.177+0000 7f8490a00640 1 -- 172.21.15.131:0/3988739509 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8478003520 con 0x7f8494073b90 2024-04-12T19:39:07.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.177+0000 7f8491400640 1 -- 172.21.15.131:0/3988739509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84940b8590 msgr2=0x7f849415bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:07.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.177+0000 7f8491400640 1 --2- 172.21.15.131:0/3988739509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84940b8590 0x7f849415bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.177+0000 7f8491400640 1 -- 172.21.15.131:0/3988739509 >> v1:172.21.15.131:6789/0 conn(0x7f8494073b90 legacy=0x7f84941547f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:07.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.177+0000 7f8491400640 1 -- 172.21.15.131:0/3988739509 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84940b8e40 con 0x7f849406f520 2024-04-12T19:39:07.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.177+0000 7f8492800640 1 --2- 172.21.15.131:0/3988739509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84940b8590 0x7f849415bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T19:39:07.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.178+0000 7f8491400640 1 --2- 172.21.15.131:0/3988739509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849406f520 0x7f84940b8050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8480009870 tx=0x7f848002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c5771e89091977d server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:07.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.178+0000 7f8490a00640 1 -- 172.21.15.131:0/3988739509 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480034070 con 0x7f849406f520 2024-04-12T19:39:07.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.178+0000 7f8490a00640 1 -- 172.21.15.131:0/3988739509 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8480030840 con 0x7f849406f520 2024-04-12T19:39:07.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.178+0000 7f8490a00640 1 -- 172.21.15.131:0/3988739509 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480030c10 con 0x7f849406f520 2024-04-12T19:39:07.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.179+0000 7f8498e00640 1 -- 172.21.15.131:0/3988739509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849406f520 msgr2=0x7f84940b8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:07.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.179+0000 7f8498e00640 1 --2- 172.21.15.131:0/3988739509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849406f520 0x7f84940b8050 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8480009870 tx=0x7f848002b980 comp rx=0 tx=0).stop 2024-04-12T19:39:07.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.179+0000 7f8498e00640 1 -- 172.21.15.131:0/3988739509 shutdown_connections 2024-04-12T19:39:07.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.179+0000 7f8498e00640 1 --2- 172.21.15.131:0/3988739509 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f84940b8590 0x7f849415bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.179+0000 7f8498e00640 1 --2- 172.21.15.131:0/3988739509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f849406f520 0x7f84940b8050 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.179+0000 7f8498e00640 1 -- 172.21.15.131:0/3988739509 >> 172.21.15.131:0/3988739509 conn(0x7f84940c2590 msgr2=0x7f84940c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:07.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.179+0000 7f8498e00640 1 -- 172.21.15.131:0/3988739509 shutdown_connections 2024-04-12T19:39:07.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.179+0000 7f8498e00640 1 -- 172.21.15.131:0/3988739509 wait complete. 2024-04-12T19:39:07.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.181+0000 7f8498e00640 1 Processor -- start 2024-04-12T19:39:07.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.181+0000 7f8498e00640 1 -- start start 2024-04-12T19:39:07.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.182+0000 7f8498e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f849406f520 0x7f8494146390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.182+0000 7f8498e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494073b90 0x7f849414c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.182+0000 7f8498e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84940b8590 0x7f849414c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.182+0000 7f8498e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f84940becf0 con 0x7f8494073b90 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.182+0000 7f8498e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8494154f00 con 0x7f84940b8590 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.182+0000 7f8498e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f84940bee70 con 0x7f849406f520 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.182+0000 7f8491400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494073b90 0x7f849414c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.182+0000 7f8491400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494073b90 0x7f849414c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49166/0 (socket says 172.21.15.131:49166) 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.182+0000 7f8491400640 1 -- 172.21.15.131:0/1513040504 learned_addr learned my addr 172.21.15.131:0/1513040504 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.182+0000 7f8491e00640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f849406f520 0x7f8494146390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.183+0000 7f8492800640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84940b8590 0x7f849414c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.183+0000 7f8491400640 1 -- 172.21.15.131:0/1513040504 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f849406f520 msgr2=0x7f8494146390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.183+0000 7f8491400640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f849406f520 0x7f8494146390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.183+0000 7f8491400640 1 -- 172.21.15.131:0/1513040504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84940b8590 msgr2=0x7f849414c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:07.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.183+0000 7f8491400640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84940b8590 0x7f849414c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.183+0000 7f8491400640 1 -- 172.21.15.131:0/1513040504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84940bcb10 con 0x7f8494073b90 2024-04-12T19:39:07.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.183+0000 7f8492800640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84940b8590 0x7f849414c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:07.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.183+0000 7f8491400640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494073b90 0x7f849414c1b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f848002b9c0 tx=0x7f8480004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:07.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.183+0000 7f848a000640 1 -- 172.21.15.131:0/1513040504 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480048070 con 0x7f8494073b90 2024-04-12T19:39:07.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.184+0000 7f848a000640 1 -- 172.21.15.131:0/1513040504 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8480030640 con 0x7f8494073b90 2024-04-12T19:39:07.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.184+0000 7f848a000640 1 -- 172.21.15.131:0/1513040504 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8480034040 con 0x7f8494073b90 2024-04-12T19:39:07.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.184+0000 7f8498e00640 1 -- 172.21.15.131:0/1513040504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84941eae10 con 0x7f8494073b90 2024-04-12T19:39:07.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.184+0000 7f8498e00640 1 -- 172.21.15.131:0/1513040504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849414d820 con 0x7f8494073b90 2024-04-12T19:39:07.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.185+0000 7f8498e00640 1 -- 172.21.15.131:0/1513040504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84940bffa0 con 0x7f8494073b90 2024-04-12T19:39:07.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.187+0000 7f848a000640 1 -- 172.21.15.131:0/1513040504 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f8480037070 con 0x7f8494073b90 2024-04-12T19:39:07.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.188+0000 7f848a000640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f847406c860 0x7f847406ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:07.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.188+0000 7f848a000640 1 -- 172.21.15.131:0/1513040504 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f84800ad380 con 0x7f8494073b90 2024-04-12T19:39:07.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.194+0000 7f848a000640 1 -- 172.21.15.131:0/1513040504 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f84940bffa0 con 0x7f8494073b90 2024-04-12T19:39:07.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.199+0000 7f8491e00640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f847406c860 0x7f847406ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:07.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.199+0000 7f8491e00640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f847406c860 0x7f847406ed20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8484005fd0 tx=0x7f8484007e90 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:07.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.441+0000 7f8498e00640 1 -- 172.21.15.131:0/1513040504 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f849404fd50 con 0x7f8494073b90 2024-04-12T19:39:07.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.441+0000 7f848a000640 1 -- 172.21.15.131:0/1513040504 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3873 (secure 0 0 0) 0x7f848007bbd0 con 0x7f8494073b90 2024-04-12T19:39:07.442 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:07.443 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3941197710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3941197710},{"type":"v1","addr":"172.21.15.131:6836","nonce":3941197710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2898590457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2898590457},{"type":"v1","addr":"172.21.15.131:6837","nonce":2898590457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/373698102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":373698102},{"type":"v1","addr":"172.21.15.171:6835","nonce":373698102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4257,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6834/1013642393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1013642393},{"type":"v1","addr":"172.21.15.171:6834","nonce":1013642393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-12T19:39:07.443 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 3 2024-04-12T19:39:07.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.444+0000 7f8498e00640 1 -- 172.21.15.131:0/1513040504 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f847406c860 msgr2=0x7f847406ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:07.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.444+0000 7f8498e00640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f847406c860 0x7f847406ed20 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f8484005fd0 tx=0x7f8484007e90 comp rx=0 tx=0).stop 2024-04-12T19:39:07.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.444+0000 7f8498e00640 1 -- 172.21.15.131:0/1513040504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494073b90 msgr2=0x7f849414c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:07.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.444+0000 7f8498e00640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494073b90 0x7f849414c1b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f848002b9c0 tx=0x7f8480004730 comp rx=0 tx=0).stop 2024-04-12T19:39:07.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.444+0000 7f8498e00640 1 -- 172.21.15.131:0/1513040504 shutdown_connections 2024-04-12T19:39:07.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.444+0000 7f8498e00640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f847406c860 0x7f847406ed20 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.444+0000 7f8498e00640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f84940b8590 0x7f849414c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.444+0000 7f8498e00640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8494073b90 0x7f849414c1b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.444+0000 7f8498e00640 1 --2- 172.21.15.131:0/1513040504 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f849406f520 0x7f8494146390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.444+0000 7f8498e00640 1 -- 172.21.15.131:0/1513040504 >> 172.21.15.131:0/1513040504 conn(0x7f84940c2590 msgr2=0x7f84940bd9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:07.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.445+0000 7f8498e00640 1 -- 172.21.15.131:0/1513040504 shutdown_connections 2024-04-12T19:39:07.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.445+0000 7f8498e00640 1 -- 172.21.15.131:0/1513040504 wait complete. 2024-04-12T19:39:07.463 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:07.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.648+0000 7f4409c00640 1 Processor -- start 2024-04-12T19:39:07.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.648+0000 7f4409c00640 1 -- start start 2024-04-12T19:39:07.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.649+0000 7f4409c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f440414b5d0 0x7f4404151c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:07.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.649+0000 7f4409c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 0x7f440406d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:07.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.649+0000 7f4409c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44040c1820 con 0x7f44040c1320 2024-04-12T19:39:07.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.649+0000 7f4409c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f44040c0860 con 0x7f440414b5d0 2024-04-12T19:39:07.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.649+0000 7f4409c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f44041517b0 con 0x7f44040c4780 2024-04-12T19:39:07.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.650+0000 7f4403400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 0x7f440406d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:07.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.650+0000 7f4403400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 0x7f440406d2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:40652/0 (socket says 172.21.15.131:40652) 2024-04-12T19:39:07.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.650+0000 7f4403400640 1 -- 172.21.15.131:0/3511847263 learned_addr learned my addr 172.21.15.131:0/3511847263 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:07.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.650+0000 7f4402a00640 1 --2- 172.21.15.131:0/3511847263 >> v2:172.21.15.171:3300/0 conn(0x7f440414b5d0 0x7f4404151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:07.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.651+0000 7f4403400640 1 -- 172.21.15.131:0/3511847263 >> v2:172.21.15.171:3300/0 conn(0x7f440414b5d0 msgr2=0x7f4404151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:07.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.651+0000 7f4403400640 1 --2- 172.21.15.131:0/3511847263 >> v2:172.21.15.171:3300/0 conn(0x7f440414b5d0 0x7f4404151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.651+0000 7f4403400640 1 -- 172.21.15.131:0/3511847263 >> v1:172.21.15.171:6789/0 conn(0x7f44040c1320 legacy=0x7f44040c4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:07.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.651+0000 7f4403400640 1 -- 172.21.15.131:0/3511847263 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44040c1b00 con 0x7f44040c4780 2024-04-12T19:39:07.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.652+0000 7f4403400640 1 --2- 172.21.15.131:0/3511847263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 0x7f440406d2d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009e50 tx=0x7f43fc02bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca43e572b60d4a8f server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:07.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.652+0000 7f4402000640 1 -- 172.21.15.131:0/3511847263 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc02ca70 con 0x7f44040c4780 2024-04-12T19:39:07.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.653+0000 7f4402000640 1 -- 172.21.15.131:0/3511847263 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43fc02cc10 con 0x7f44040c4780 2024-04-12T19:39:07.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.653+0000 7f4402000640 1 -- 172.21.15.131:0/3511847263 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc0343f0 con 0x7f44040c4780 2024-04-12T19:39:07.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.653+0000 7f4409c00640 1 -- 172.21.15.131:0/3511847263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 msgr2=0x7f440406d2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:07.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.653+0000 7f4409c00640 1 --2- 172.21.15.131:0/3511847263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 0x7f440406d2d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f43fc009e50 tx=0x7f43fc02bed0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.653+0000 7f4409c00640 1 -- 172.21.15.131:0/3511847263 shutdown_connections 2024-04-12T19:39:07.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.653+0000 7f4409c00640 1 --2- 172.21.15.131:0/3511847263 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 0x7f440406d2d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.653+0000 7f4409c00640 1 --2- 172.21.15.131:0/3511847263 >> v2:172.21.15.171:3300/0 conn(0x7f440414b5d0 0x7f4404151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.653+0000 7f4409c00640 1 -- 172.21.15.131:0/3511847263 >> 172.21.15.131:0/3511847263 conn(0x7f44040a84b0 msgr2=0x7f44040a88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:07.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.653+0000 7f4409c00640 1 -- 172.21.15.131:0/3511847263 shutdown_connections 2024-04-12T19:39:07.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.653+0000 7f4409c00640 1 -- 172.21.15.131:0/3511847263 wait complete. 2024-04-12T19:39:07.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.655+0000 7f4409c00640 1 Processor -- start 2024-04-12T19:39:07.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.655+0000 7f4409c00640 1 -- start start 2024-04-12T19:39:07.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.656+0000 7f4409c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44040c1320 0x7f440414e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:07.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.656+0000 7f4409c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 0x7f44040c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:07.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.656+0000 7f4409c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f440414b5d0 0x7f44040b8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:07.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.656+0000 7f4409c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f44041510f0 con 0x7f440414b5d0 2024-04-12T19:39:07.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.656+0000 7f4409c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f44040c54c0 con 0x7f44040c1320 2024-04-12T19:39:07.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.656+0000 7f4409c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f44040c0c80 con 0x7f44040c4780 2024-04-12T19:39:07.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.656+0000 7f4403400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f440414b5d0 0x7f44040b8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:07.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.656+0000 7f4403400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f440414b5d0 0x7f44040b8c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49182/0 (socket says 172.21.15.131:49182) 2024-04-12T19:39:07.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.656+0000 7f4403400640 1 -- 172.21.15.131:0/2844945017 learned_addr learned my addr 172.21.15.131:0/2844945017 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:07.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.656+0000 7f43fa000640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 0x7f44040c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:07.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.656+0000 7f4402a00640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44040c1320 0x7f440414e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:07.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.657+0000 7f4403400640 1 -- 172.21.15.131:0/2844945017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 msgr2=0x7f44040c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:07.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.657+0000 7f4403400640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 0x7f44040c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.657+0000 7f4403400640 1 -- 172.21.15.131:0/2844945017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44040c1320 msgr2=0x7f440414e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:07.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.657+0000 7f4403400640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44040c1320 0x7f440414e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.657+0000 7f4403400640 1 -- 172.21.15.131:0/2844945017 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440414ea70 con 0x7f440414b5d0 2024-04-12T19:39:07.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.657+0000 7f43fa000640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 0x7f44040c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T19:39:07.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.657+0000 7f4403400640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f440414b5d0 0x7f44040b8c00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43fc036040 tx=0x7f43fc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:07.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.657+0000 7f43fb400640 1 -- 172.21.15.131:0/2844945017 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc043020 con 0x7f440414b5d0 2024-04-12T19:39:07.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.657+0000 7f43fb400640 1 -- 172.21.15.131:0/2844945017 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43fc03e450 con 0x7f440414b5d0 2024-04-12T19:39:07.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.657+0000 7f43fb400640 1 -- 172.21.15.131:0/2844945017 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43fc009510 con 0x7f440414b5d0 2024-04-12T19:39:07.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.657+0000 7f4409c00640 1 -- 172.21.15.131:0/2844945017 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44040bf3a0 con 0x7f440414b5d0 2024-04-12T19:39:07.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.658+0000 7f4409c00640 1 -- 172.21.15.131:0/2844945017 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44040bf960 con 0x7f440414b5d0 2024-04-12T19:39:07.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.659+0000 7f4409c00640 1 -- 172.21.15.131:0/2844945017 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f440404fd50 con 0x7f440414b5d0 2024-04-12T19:39:07.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.660+0000 7f43fb400640 1 -- 172.21.15.131:0/2844945017 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f43fc046020 con 0x7f440414b5d0 2024-04-12T19:39:07.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.662+0000 7f43fb400640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f43e006c890 0x7f43e006ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:07.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.662+0000 7f43fb400640 1 -- 172.21.15.131:0/2844945017 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f43fc0ade60 con 0x7f440414b5d0 2024-04-12T19:39:07.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.662+0000 7f4402a00640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f43e006c890 0x7f43e006ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:07.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.663+0000 7f4402a00640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f43e006c890 0x7f43e006ed50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f440414f150 tx=0x7f43f4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:07.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.666+0000 7f43fb400640 1 -- 172.21.15.131:0/2844945017 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f43fc04d030 con 0x7f440414b5d0 2024-04-12T19:39:07.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.870+0000 7f4409c00640 1 -- 172.21.15.131:0/2844945017 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f44040c4280 con 0x7f440414b5d0 2024-04-12T19:39:07.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.872+0000 7f43fb400640 1 -- 172.21.15.131:0/2844945017 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12872 (secure 0 0 0) 0x7f43fc07c6b0 con 0x7f440414b5d0 2024-04-12T19:39:07.873 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:07.873 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":17,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:07.360695+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:07.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.874+0000 7f4409c00640 1 -- 172.21.15.131:0/2844945017 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f43e006c890 msgr2=0x7f43e006ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:07.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.874+0000 7f4409c00640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f43e006c890 0x7f43e006ed50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f440414f150 tx=0x7f43f4008040 comp rx=0 tx=0).stop 2024-04-12T19:39:07.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.874+0000 7f4409c00640 1 -- 172.21.15.131:0/2844945017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f440414b5d0 msgr2=0x7f44040b8c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:07.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.874+0000 7f4409c00640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f440414b5d0 0x7f44040b8c00 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f43fc036040 tx=0x7f43fc004a40 comp rx=0 tx=0).stop 2024-04-12T19:39:07.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.874+0000 7f4409c00640 1 -- 172.21.15.131:0/2844945017 shutdown_connections 2024-04-12T19:39:07.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.875+0000 7f4409c00640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f43e006c890 0x7f43e006ed50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.875+0000 7f4409c00640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f440414b5d0 0x7f44040b8c00 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.875+0000 7f4409c00640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f44040c4780 0x7f44040c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.875+0000 7f4409c00640 1 --2- 172.21.15.131:0/2844945017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f44040c1320 0x7f440414e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:07.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.875+0000 7f4409c00640 1 -- 172.21.15.131:0/2844945017 >> 172.21.15.131:0/2844945017 conn(0x7f44040a84b0 msgr2=0x7f4404150460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:07.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.875+0000 7f4409c00640 1 -- 172.21.15.131:0/2844945017 shutdown_connections 2024-04-12T19:39:07.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:07.875+0000 7f4409c00640 1 -- 172.21.15.131:0/2844945017 wait complete. 2024-04-12T19:39:07.893 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T19:39:04.855067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-12T19:39:07.894 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T19:39:08.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.101+0000 7fe453e00640 1 Processor -- start 2024-04-12T19:39:08.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.101+0000 7fe453e00640 1 -- start start 2024-04-12T19:39:08.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.102+0000 7fe453e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4540ac400 0x7fe45406dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:08.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.102+0000 7fe453e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe45406c8c0 0x7fe45406cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:08.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.102+0000 7fe453e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe454150ef0 con 0x7fe45414b120 2024-04-12T19:39:08.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.102+0000 7fe453e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe45406c430 con 0x7fe45406c8c0 2024-04-12T19:39:08.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.102+0000 7fe453e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe45406bde0 con 0x7fe4540ac400 2024-04-12T19:39:08.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.103+0000 7fe452a00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fe45414b120 0x7fe4540c5630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53604/0 (socket says 172.21.15.131:53604) 2024-04-12T19:39:08.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.103+0000 7fe452a00640 1 -- 172.21.15.131:0/1718409559 learned_addr learned my addr 172.21.15.131:0/1718409559 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:08.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.103+0000 7fe453400640 1 --2- 172.21.15.131:0/1718409559 >> v2:172.21.15.131:3300/0 conn(0x7fe45406c8c0 0x7fe45406cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:08.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.103+0000 7fe452000640 1 --2- 172.21.15.131:0/1718409559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4540ac400 0x7fe45406dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:08.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.103+0000 7fe451600640 1 -- 172.21.15.131:0/1718409559 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1218898174 0 0) 0x7fe454150ef0 con 0x7fe45414b120 2024-04-12T19:39:08.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.103+0000 7fe451600640 1 -- 172.21.15.131:0/1718409559 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe434003520 con 0x7fe45414b120 2024-04-12T19:39:08.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.103+0000 7fe453400640 1 -- 172.21.15.131:0/1718409559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4540ac400 msgr2=0x7fe45406dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:08.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.103+0000 7fe453400640 1 --2- 172.21.15.131:0/1718409559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4540ac400 0x7fe45406dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.103+0000 7fe453400640 1 -- 172.21.15.131:0/1718409559 >> v1:172.21.15.131:6789/0 conn(0x7fe45414b120 legacy=0x7fe4540c5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:08.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.103+0000 7fe453400640 1 -- 172.21.15.131:0/1718409559 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe45406c0c0 con 0x7fe45406c8c0 2024-04-12T19:39:08.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.103+0000 7fe452000640 1 --2- 172.21.15.131:0/1718409559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4540ac400 0x7fe45406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T19:39:08.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.104+0000 7fe453400640 1 --2- 172.21.15.131:0/1718409559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe45406c8c0 0x7fe45406cd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0097a0 tx=0x7fe44c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3bf19481f30e28f server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:08.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.105+0000 7fe451600640 1 -- 172.21.15.131:0/1718409559 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c035020 con 0x7fe45406c8c0 2024-04-12T19:39:08.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.105+0000 7fe451600640 1 -- 172.21.15.131:0/1718409559 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe44c031830 con 0x7fe45406c8c0 2024-04-12T19:39:08.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.105+0000 7fe451600640 1 -- 172.21.15.131:0/1718409559 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe44c031c00 con 0x7fe45406c8c0 2024-04-12T19:39:08.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.105+0000 7fe453e00640 1 -- 172.21.15.131:0/1718409559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe45406c8c0 msgr2=0x7fe45406cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:08.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.105+0000 7fe453e00640 1 --2- 172.21.15.131:0/1718409559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe45406c8c0 0x7fe45406cd50 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fe44c0097a0 tx=0x7fe44c02b8d0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.105+0000 7fe453e00640 1 -- 172.21.15.131:0/1718409559 shutdown_connections 2024-04-12T19:39:08.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.105+0000 7fe453e00640 1 --2- 172.21.15.131:0/1718409559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe45406c8c0 0x7fe45406cd50 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.105+0000 7fe453e00640 1 --2- 172.21.15.131:0/1718409559 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe4540ac400 0x7fe45406dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.105+0000 7fe453e00640 1 -- 172.21.15.131:0/1718409559 >> 172.21.15.131:0/1718409559 conn(0x7fe4540c31a0 msgr2=0x7fe4540c35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:08.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.105+0000 7fe453e00640 1 -- 172.21.15.131:0/1718409559 shutdown_connections 2024-04-12T19:39:08.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.105+0000 7fe453e00640 1 -- 172.21.15.131:0/1718409559 wait complete. 2024-04-12T19:39:08.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.107+0000 7fe453e00640 1 Processor -- start 2024-04-12T19:39:08.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.107+0000 7fe453e00640 1 -- start start 2024-04-12T19:39:08.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.108+0000 7fe453e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe45406c8c0 0x7fe45414a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:08.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.108+0000 7fe453e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4540ac400 0x7fe454142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.108+0000 7fe453e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe45414b120 0x7fe454148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.108+0000 7fe453e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe45406e260 con 0x7fe4540ac400 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.108+0000 7fe453e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe4540c5d40 con 0x7fe45414b120 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.108+0000 7fe453e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe45415b6e0 con 0x7fe45406c8c0 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.108+0000 7fe452000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4540ac400 0x7fe454142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.108+0000 7fe452000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4540ac400 0x7fe454142ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49200/0 (socket says 172.21.15.131:49200) 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.108+0000 7fe452000640 1 -- 172.21.15.131:0/4155738932 learned_addr learned my addr 172.21.15.131:0/4155738932 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.108+0000 7fe452a00640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe45406c8c0 0x7fe45414a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.108+0000 7fe453400640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe45414b120 0x7fe454148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.109+0000 7fe452000640 1 -- 172.21.15.131:0/4155738932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe45406c8c0 msgr2=0x7fe45414a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.109+0000 7fe452000640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe45406c8c0 0x7fe45414a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.109+0000 7fe452000640 1 -- 172.21.15.131:0/4155738932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe45414b120 msgr2=0x7fe454148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.109+0000 7fe452000640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe45414b120 0x7fe454148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.109+0000 7fe452000640 1 -- 172.21.15.131:0/4155738932 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe454142ff0 con 0x7fe4540ac400 2024-04-12T19:39:08.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.109+0000 7fe452000640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4540ac400 0x7fe454142ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009fc0 tx=0x7fe43c00d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:08.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.109+0000 7fe44b400640 1 -- 172.21.15.131:0/4155738932 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c01a070 con 0x7fe4540ac400 2024-04-12T19:39:08.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.109+0000 7fe44b400640 1 -- 172.21.15.131:0/4155738932 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe43c003bb0 con 0x7fe4540ac400 2024-04-12T19:39:08.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.109+0000 7fe44b400640 1 -- 172.21.15.131:0/4155738932 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43c004030 con 0x7fe4540ac400 2024-04-12T19:39:08.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.109+0000 7fe453e00640 1 -- 172.21.15.131:0/4155738932 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4541e7470 con 0x7fe4540ac400 2024-04-12T19:39:08.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.110+0000 7fe453e00640 1 -- 172.21.15.131:0/4155738932 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe454143d10 con 0x7fe4540ac400 2024-04-12T19:39:08.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.111+0000 7fe453e00640 1 -- 172.21.15.131:0/4155738932 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe45404fd50 con 0x7fe4540ac400 2024-04-12T19:39:08.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.112+0000 7fe44b400640 1 -- 172.21.15.131:0/4155738932 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7fe43c01d070 con 0x7fe4540ac400 2024-04-12T19:39:08.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.112+0000 7fe44b400640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe43006c860 0x7fe43006ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:08.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.113+0000 7fe44b400640 1 -- 172.21.15.131:0/4155738932 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7fe43c08b940 con 0x7fe4540ac400 2024-04-12T19:39:08.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.113+0000 7fe452a00640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe43006c860 0x7fe43006ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:08.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.113+0000 7fe452a00640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe43006c860 0x7fe43006ed20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe444005880 tx=0x7fe444009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:08.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.117+0000 7fe44b400640 1 -- 172.21.15.131:0/4155738932 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe43c010070 con 0x7fe4540ac400 2024-04-12T19:39:08.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.318+0000 7fe453e00640 1 -- 172.21.15.131:0/4155738932 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe45415b4c0 con 0x7fe4540ac400 2024-04-12T19:39:08.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.319+0000 7fe44b400640 1 -- 172.21.15.131:0/4155738932 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) ==== 93+0+10 (secure 0 0 0) 0x7fe43c059be0 con 0x7fe4540ac400 2024-04-12T19:39:08.320 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-12T19:39:08.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.322+0000 7fe453e00640 1 -- 172.21.15.131:0/4155738932 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe43006c860 msgr2=0x7fe43006ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:08.323 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.322+0000 7fe453e00640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe43006c860 0x7fe43006ed20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe444005880 tx=0x7fe444009040 comp rx=0 tx=0).stop 2024-04-12T19:39:08.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.322+0000 7fe453e00640 1 -- 172.21.15.131:0/4155738932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4540ac400 msgr2=0x7fe454142ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:08.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.322+0000 7fe453e00640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4540ac400 0x7fe454142ab0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe43c009fc0 tx=0x7fe43c00d560 comp rx=0 tx=0).stop 2024-04-12T19:39:08.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.322+0000 7fe453e00640 1 -- 172.21.15.131:0/4155738932 shutdown_connections 2024-04-12T19:39:08.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.322+0000 7fe453e00640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe43006c860 0x7fe43006ed20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.322+0000 7fe453e00640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe45414b120 0x7fe454148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.322+0000 7fe453e00640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4540ac400 0x7fe454142ab0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.322+0000 7fe453e00640 1 --2- 172.21.15.131:0/4155738932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe45406c8c0 0x7fe45414a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.322+0000 7fe453e00640 1 -- 172.21.15.131:0/4155738932 >> 172.21.15.131:0/4155738932 conn(0x7fe4540c31a0 msgr2=0x7fe4540c5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:08.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.323+0000 7fe453e00640 1 -- 172.21.15.131:0/4155738932 shutdown_connections 2024-04-12T19:39:08.324 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.323+0000 7fe453e00640 1 -- 172.21.15.131:0/4155738932 wait complete. 2024-04-12T19:39:08.343 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-12T19:39:08.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.546+0000 7f1610400640 1 Processor -- start 2024-04-12T19:39:08.547 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.546+0000 7f1610400640 1 -- start start 2024-04-12T19:39:08.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.547+0000 7f1610400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f16080c4a30 0x7f16080c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:08.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.548+0000 7f1610400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1608157810 0x7f1608159c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:08.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.548+0000 7f1610400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f160814f8f0 con 0x7f16080b96d0 2024-04-12T19:39:08.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.548+0000 7f1610400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f1608149630 con 0x7f1608157810 2024-04-12T19:39:08.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.548+0000 7f1610400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f160814fe50 con 0x7f16080c4a30 2024-04-12T19:39:08.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.548+0000 7f160da00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f16080c4a30 0x7f16080c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:08.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.548+0000 7f160da00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f16080c4a30 0x7f16080c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:35112/0 (socket says 172.21.15.131:35112) 2024-04-12T19:39:08.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.548+0000 7f160da00640 1 -- 172.21.15.131:0/2483808217 learned_addr learned my addr 172.21.15.131:0/2483808217 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:08.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.548+0000 7f160e400640 1 --2- 172.21.15.131:0/2483808217 >> v2:172.21.15.131:3300/0 conn(0x7f1608157810 0x7f1608159c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:08.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.549+0000 7f160da00640 1 -- 172.21.15.131:0/2483808217 >> v2:172.21.15.131:3300/0 conn(0x7f1608157810 msgr2=0x7f1608159c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:08.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.549+0000 7f160da00640 1 --2- 172.21.15.131:0/2483808217 >> v2:172.21.15.131:3300/0 conn(0x7f1608157810 0x7f1608159c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.549+0000 7f160da00640 1 -- 172.21.15.131:0/2483808217 >> v1:172.21.15.131:6789/0 conn(0x7f16080b96d0 legacy=0x7f1608150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:08.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.549+0000 7f160da00640 1 -- 172.21.15.131:0/2483808217 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16080bb810 con 0x7f16080c4a30 2024-04-12T19:39:08.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.550+0000 7f160da00640 1 --2- 172.21.15.131:0/2483808217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16080c4a30 0x7f16080c4e10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1608070a40 tx=0x7f15fc02b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=750de990748c3595 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:08.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.551+0000 7f1607e00640 1 -- 172.21.15.131:0/2483808217 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc035020 con 0x7f16080c4a30 2024-04-12T19:39:08.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.551+0000 7f1607e00640 1 -- 172.21.15.131:0/2483808217 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15fc031870 con 0x7f16080c4a30 2024-04-12T19:39:08.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.551+0000 7f1607e00640 1 -- 172.21.15.131:0/2483808217 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15fc031c40 con 0x7f16080c4a30 2024-04-12T19:39:08.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.551+0000 7f1610400640 1 -- 172.21.15.131:0/2483808217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16080c4a30 msgr2=0x7f16080c4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:08.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.551+0000 7f1610400640 1 --2- 172.21.15.131:0/2483808217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16080c4a30 0x7f16080c4e10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1608070a40 tx=0x7f15fc02b910 comp rx=0 tx=0).stop 2024-04-12T19:39:08.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.552+0000 7f1610400640 1 -- 172.21.15.131:0/2483808217 shutdown_connections 2024-04-12T19:39:08.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.552+0000 7f1610400640 1 --2- 172.21.15.131:0/2483808217 >> v2:172.21.15.131:3300/0 conn(0x7f1608157810 0x7f1608159c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.552+0000 7f1610400640 1 --2- 172.21.15.131:0/2483808217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f16080c4a30 0x7f16080c4e10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.552+0000 7f1610400640 1 -- 172.21.15.131:0/2483808217 >> 172.21.15.131:0/2483808217 conn(0x7f1608073380 msgr2=0x7f1608073760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:08.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.552+0000 7f1610400640 1 -- 172.21.15.131:0/2483808217 shutdown_connections 2024-04-12T19:39:08.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.552+0000 7f1610400640 1 -- 172.21.15.131:0/2483808217 wait complete. 2024-04-12T19:39:08.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.553+0000 7f1610400640 1 Processor -- start 2024-04-12T19:39:08.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.553+0000 7f1610400640 1 -- start start 2024-04-12T19:39:08.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.554+0000 7f1610400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16080b96d0 0x7f16080be1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:08.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.554+0000 7f1610400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16080c4a30 0x7f1608155180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:08.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.554+0000 7f1610400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1608157810 0x7f16080bcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:08.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.554+0000 7f1610400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f16080bb2f0 con 0x7f16080c4a30 2024-04-12T19:39:08.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.554+0000 7f1610400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f16080bb010 con 0x7f1608157810 2024-04-12T19:39:08.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.554+0000 7f1610400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1608150aa0 con 0x7f16080b96d0 2024-04-12T19:39:08.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.554+0000 7f160d000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16080c4a30 0x7f1608155180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:08.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.555+0000 7f160d000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16080c4a30 0x7f1608155180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49220/0 (socket says 172.21.15.131:49220) 2024-04-12T19:39:08.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.555+0000 7f160d000640 1 -- 172.21.15.131:0/3790947444 learned_addr learned my addr 172.21.15.131:0/3790947444 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:08.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.555+0000 7f160da00640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16080b96d0 0x7f16080be1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:08.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.555+0000 7f160e400640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1608157810 0x7f16080bcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:08.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.555+0000 7f160d000640 1 -- 172.21.15.131:0/3790947444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16080b96d0 msgr2=0x7f16080be1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:08.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.555+0000 7f160d000640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16080b96d0 0x7f16080be1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.555+0000 7f160d000640 1 -- 172.21.15.131:0/3790947444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1608157810 msgr2=0x7f16080bcb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:08.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.555+0000 7f160d000640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1608157810 0x7f16080bcb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.555+0000 7f160d000640 1 -- 172.21.15.131:0/3790947444 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16081e6cb0 con 0x7f16080c4a30 2024-04-12T19:39:08.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.555+0000 7f160e400640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1608157810 0x7f16080bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T19:39:08.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.556+0000 7f160d000640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16080c4a30 0x7f1608155180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15f400c470 tx=0x7f15f4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:08.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.684+0000 7f1605600640 1 -- 172.21.15.131:0/3790947444 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f40052d0 con 0x7f16080c4a30 2024-04-12T19:39:08.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.685+0000 7f1605600640 1 -- 172.21.15.131:0/3790947444 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f15f4005470 con 0x7f16080c4a30 2024-04-12T19:39:08.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.685+0000 7f1605600640 1 -- 172.21.15.131:0/3790947444 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15f4007260 con 0x7f16080c4a30 2024-04-12T19:39:08.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.685+0000 7f1610400640 1 -- 172.21.15.131:0/3790947444 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1608154420 con 0x7f16080c4a30 2024-04-12T19:39:08.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.685+0000 7f1610400640 1 -- 172.21.15.131:0/3790947444 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16081e7210 con 0x7f16080c4a30 2024-04-12T19:39:08.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.687+0000 7f1610400640 1 -- 172.21.15.131:0/3790947444 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f160804fd50 con 0x7f16080c4a30 2024-04-12T19:39:08.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.689+0000 7f1605600640 1 -- 172.21.15.131:0/3790947444 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f15f4007400 con 0x7f16080c4a30 2024-04-12T19:39:08.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.690+0000 7f1605600640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f15e806c8b0 0x7f15e806ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:08.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.690+0000 7f1605600640 1 -- 172.21.15.131:0/3790947444 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f15f408a9f0 con 0x7f16080c4a30 2024-04-12T19:39:08.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.690+0000 7f160da00640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f15e806c8b0 0x7f15e806ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:08.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.691+0000 7f160da00640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f15e806c8b0 0x7f15e806ed70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15fc036000 tx=0x7f15fc03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:08.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.697+0000 7f1605600640 1 -- 172.21.15.131:0/3790947444 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f16081e6cb0 con 0x7f16080c4a30 2024-04-12T19:39:08.820 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:39:08.828 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:39:08.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.912+0000 7f1610400640 1 -- 172.21.15.131:0/3790947444 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f160814f180 con 0x7f16080c4a30 2024-04-12T19:39:08.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.913+0000 7f1605600640 1 -- 172.21.15.131:0/3790947444 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7f160814f8f0 con 0x7f16080c4a30 2024-04-12T19:39:08.914 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:08.914 INFO:teuthology.orchestra.run.smithi131.stdout:[ 2024-04-12T19:39:08.914 INFO:teuthology.orchestra.run.smithi131.stdout: { 2024-04-12T19:39:08.914 INFO:teuthology.orchestra.run.smithi131.stdout: "poolnum": 1, 2024-04-12T19:39:08.914 INFO:teuthology.orchestra.run.smithi131.stdout: "poolname": ".mgr" 2024-04-12T19:39:08.915 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-12T19:39:08.915 INFO:teuthology.orchestra.run.smithi131.stdout:] 2024-04-12T19:39:08.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.915+0000 7f1610400640 1 -- 172.21.15.131:0/3790947444 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f15e806c8b0 msgr2=0x7f15e806ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:08.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.915+0000 7f1610400640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f15e806c8b0 0x7f15e806ed70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f15fc036000 tx=0x7f15fc03c040 comp rx=0 tx=0).stop 2024-04-12T19:39:08.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.915+0000 7f1610400640 1 -- 172.21.15.131:0/3790947444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16080c4a30 msgr2=0x7f1608155180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:08.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.915+0000 7f1610400640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16080c4a30 0x7f1608155180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f15f400c470 tx=0x7f15f4001e70 comp rx=0 tx=0).stop 2024-04-12T19:39:08.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.915+0000 7f1610400640 1 -- 172.21.15.131:0/3790947444 shutdown_connections 2024-04-12T19:39:08.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.915+0000 7f1610400640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f15e806c8b0 0x7f15e806ed70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.915+0000 7f1610400640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1608157810 0x7f16080bcb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.915+0000 7f1610400640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16080c4a30 0x7f1608155180 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.916+0000 7f1610400640 1 --2- 172.21.15.131:0/3790947444 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f16080b96d0 0x7f16080be1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.916+0000 7f1610400640 1 -- 172.21.15.131:0/3790947444 >> 172.21.15.131:0/3790947444 conn(0x7f1608073380 msgr2=0x7f16080c2850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.916+0000 7f1610400640 1 -- 172.21.15.131:0/3790947444 shutdown_connections 2024-04-12T19:39:08.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:08.916+0000 7f1610400640 1 -- 172.21.15.131:0/3790947444 wait complete. 2024-04-12T19:39:08.937 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-12T19:39:08.937 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-12T19:39:09.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.139+0000 7f87c3a00640 1 Processor -- start 2024-04-12T19:39:09.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.140+0000 7f87c3a00640 1 -- start start 2024-04-12T19:39:09.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.141+0000 7f87c3a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f87bc06e690 0x7f87bc0bdc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.141+0000 7f87c3a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f87bc0be640 0x7f87bc15fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.141+0000 7f87c3a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87bc0bedc0 con 0x7f87bc0be150 2024-04-12T19:39:09.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.141+0000 7f87c3a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f87bc0bd780 con 0x7f87bc06e690 2024-04-12T19:39:09.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.141+0000 7f87c3a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f87bc0b75b0 con 0x7f87bc0be640 2024-04-12T19:39:09.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.141+0000 7f87c1000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f87bc06e690 0x7f87bc0bdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.142+0000 7f87c1000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f87bc06e690 0x7f87bc0bdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49228/0 (socket says 172.21.15.131:49228) 2024-04-12T19:39:09.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.142+0000 7f87c1000640 1 -- 172.21.15.131:0/2865131700 learned_addr learned my addr 172.21.15.131:0/2865131700 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:09.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.142+0000 7f87c1a00640 1 --2- 172.21.15.131:0/2865131700 >> v2:172.21.15.171:3300/0 conn(0x7f87bc0be640 0x7f87bc15fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.142+0000 7f87c1000640 1 -- 172.21.15.131:0/2865131700 >> v2:172.21.15.171:3300/0 conn(0x7f87bc0be640 msgr2=0x7f87bc15fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:09.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.142+0000 7f87c1000640 1 --2- 172.21.15.131:0/2865131700 >> v2:172.21.15.171:3300/0 conn(0x7f87bc0be640 0x7f87bc15fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.142+0000 7f87c1000640 1 -- 172.21.15.131:0/2865131700 >> v1:172.21.15.171:6789/0 conn(0x7f87bc0be150 legacy=0x7f87bc14f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:09.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.142+0000 7f87c1000640 1 -- 172.21.15.131:0/2865131700 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87bc1561b0 con 0x7f87bc06e690 2024-04-12T19:39:09.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.143+0000 7f87c1000640 1 --2- 172.21.15.131:0/2865131700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc06e690 0x7f87bc0bdc10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f87bc1553e0 tx=0x7f87a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df5ec90392469cc5 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:09.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.144+0000 7f87bbe00640 1 -- 172.21.15.131:0/2865131700 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a402e070 con 0x7f87bc06e690 2024-04-12T19:39:09.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.144+0000 7f87bbe00640 1 -- 172.21.15.131:0/2865131700 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a4037070 con 0x7f87bc06e690 2024-04-12T19:39:09.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.144+0000 7f87bbe00640 1 -- 172.21.15.131:0/2865131700 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a4031a00 con 0x7f87bc06e690 2024-04-12T19:39:09.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.144+0000 7f87c3a00640 1 -- 172.21.15.131:0/2865131700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc06e690 msgr2=0x7f87bc0bdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:09.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.144+0000 7f87c3a00640 1 --2- 172.21.15.131:0/2865131700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc06e690 0x7f87bc0bdc10 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f87bc1553e0 tx=0x7f87a402b880 comp rx=0 tx=0).stop 2024-04-12T19:39:09.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.144+0000 7f87c3a00640 1 -- 172.21.15.131:0/2865131700 shutdown_connections 2024-04-12T19:39:09.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.144+0000 7f87c3a00640 1 --2- 172.21.15.131:0/2865131700 >> v2:172.21.15.171:3300/0 conn(0x7f87bc0be640 0x7f87bc15fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.144+0000 7f87c3a00640 1 --2- 172.21.15.131:0/2865131700 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc06e690 0x7f87bc0bdc10 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.144+0000 7f87c3a00640 1 -- 172.21.15.131:0/2865131700 >> 172.21.15.131:0/2865131700 conn(0x7f87bc06c320 msgr2=0x7f87bc0c2590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:09.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.145+0000 7f87c3a00640 1 -- 172.21.15.131:0/2865131700 shutdown_connections 2024-04-12T19:39:09.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.145+0000 7f87c3a00640 1 -- 172.21.15.131:0/2865131700 wait complete. 2024-04-12T19:39:09.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.146+0000 7f87c3a00640 1 Processor -- start 2024-04-12T19:39:09.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.146+0000 7f87c3a00640 1 -- start start 2024-04-12T19:39:09.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.147+0000 7f87c3a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc06e690 0x7f87bc0bb540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.147+0000 7f87c3a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87bc0be150 0x7f87bc0b9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.147+0000 7f87c3a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87bc0be640 0x7f87bc0bc1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.147+0000 7f87c3a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc155e60 con 0x7f87bc06e690 2024-04-12T19:39:09.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.147+0000 7f87c3a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc0bd410 con 0x7f87bc0be150 2024-04-12T19:39:09.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.147+0000 7f87c3a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f87bc06ea70 con 0x7f87bc0be640 2024-04-12T19:39:09.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.147+0000 7f87c1000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc06e690 0x7f87bc0bb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.147+0000 7f87c1000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc06e690 0x7f87bc0bb540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49238/0 (socket says 172.21.15.131:49238) 2024-04-12T19:39:09.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.147+0000 7f87c1000640 1 -- 172.21.15.131:0/2143284768 learned_addr learned my addr 172.21.15.131:0/2143284768 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:09.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.148+0000 7f87c1000640 1 -- 172.21.15.131:0/2143284768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87bc0be640 msgr2=0x7f87bc0bc1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:09.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.148+0000 7f87c1000640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87bc0be640 0x7f87bc0bc1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.148+0000 7f87b3e00640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87bc0be150 0x7f87bc0b9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.148+0000 7f87c1000640 1 -- 172.21.15.131:0/2143284768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87bc0be150 msgr2=0x7f87bc0b9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:09.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.148+0000 7f87c1000640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87bc0be150 0x7f87bc0b9c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.148+0000 7f87c1000640 1 -- 172.21.15.131:0/2143284768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87bc0ba140 con 0x7f87bc06e690 2024-04-12T19:39:09.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.148+0000 7f87c1000640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc06e690 0x7f87bc0bb540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f87a4000c00 tx=0x7f87a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:09.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.148+0000 7f87b9600640 1 -- 172.21.15.131:0/2143284768 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a4032880 con 0x7f87bc06e690 2024-04-12T19:39:09.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.148+0000 7f87b9600640 1 -- 172.21.15.131:0/2143284768 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a4032a20 con 0x7f87bc06e690 2024-04-12T19:39:09.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.148+0000 7f87c3a00640 1 -- 172.21.15.131:0/2143284768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87bc152c00 con 0x7f87bc06e690 2024-04-12T19:39:09.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.148+0000 7f87b9600640 1 -- 172.21.15.131:0/2143284768 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a4032e10 con 0x7f87bc06e690 2024-04-12T19:39:09.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.149+0000 7f87c3a00640 1 -- 172.21.15.131:0/2143284768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87bc1ef420 con 0x7f87bc06e690 2024-04-12T19:39:09.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.150+0000 7f87c3a00640 1 -- 172.21.15.131:0/2143284768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87bc0ba880 con 0x7f87bc06e690 2024-04-12T19:39:09.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.151+0000 7f87b9600640 1 -- 172.21.15.131:0/2143284768 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 4) ==== 90984+0+0 (secure 0 0 0) 0x7f87a40453f0 con 0x7f87bc06e690 2024-04-12T19:39:09.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.152+0000 7f87b9600640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f879806c860 0x7f879806ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.152+0000 7f87b9600640 1 -- 172.21.15.131:0/2143284768 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f87a40adba0 con 0x7f87bc06e690 2024-04-12T19:39:09.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.152+0000 7f87b3e00640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f879806c860 0x7f879806ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.153+0000 7f87b3e00640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f879806c860 0x7f879806ed20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0a7b10 tx=0x7f87ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:09.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.156+0000 7f87b9600640 1 -- 172.21.15.131:0/2143284768 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f87a4040070 con 0x7f87bc06e690 2024-04-12T19:39:09.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.354+0000 7f87c3a00640 1 -- 172.21.15.131:0/2143284768 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f87bc0b86f0 con 0x7f87bc06e690 2024-04-12T19:39:09.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.391+0000 7f87b9600640 1 -- 172.21.15.131:0/2143284768 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f87bc0b86f0 con 0x7f87bc06e690 2024-04-12T19:39:09.393 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_metadata' created 2024-04-12T19:39:09.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.395+0000 7f87c3a00640 1 -- 172.21.15.131:0/2143284768 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f879806c860 msgr2=0x7f879806ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:09.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.395+0000 7f87c3a00640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f879806c860 0x7f879806ed20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f87bc0a7b10 tx=0x7f87ac009040 comp rx=0 tx=0).stop 2024-04-12T19:39:09.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.395+0000 7f87c3a00640 1 -- 172.21.15.131:0/2143284768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc06e690 msgr2=0x7f87bc0bb540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:09.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.395+0000 7f87c3a00640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc06e690 0x7f87bc0bb540 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f87a4000c00 tx=0x7f87a40046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.396+0000 7f87c3a00640 1 -- 172.21.15.131:0/2143284768 shutdown_connections 2024-04-12T19:39:09.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.396+0000 7f87c3a00640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f879806c860 0x7f879806ed20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.396+0000 7f87c3a00640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f87bc0be150 0x7f87bc0b9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.396+0000 7f87c3a00640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f87bc0be640 0x7f87bc0bc1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.396+0000 7f87c3a00640 1 --2- 172.21.15.131:0/2143284768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc06e690 0x7f87bc0bb540 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.396+0000 7f87c3a00640 1 -- 172.21.15.131:0/2143284768 >> 172.21.15.131:0/2143284768 conn(0x7f87bc06c320 msgr2=0x7f87bc14e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:09.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.396+0000 7f87c3a00640 1 -- 172.21.15.131:0/2143284768 shutdown_connections 2024-04-12T19:39:09.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.396+0000 7f87c3a00640 1 -- 172.21.15.131:0/2143284768 wait complete. 2024-04-12T19:39:09.427 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-12T19:39:09.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.622+0000 7f8b29200640 1 Processor -- start 2024-04-12T19:39:09.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.622+0000 7f8b29200640 1 -- start start 2024-04-12T19:39:09.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.623+0000 7f8b29200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b240bf1c0 0x7f8b2415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.623+0000 7f8b29200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b240bd9d0 con 0x7f8b240be420 2024-04-12T19:39:09.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.623+0000 7f8b29200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b2406e3c0 con 0x7f8b241546f0 2024-04-12T19:39:09.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.623+0000 7f8b29200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8b24155630 con 0x7f8b240bf1c0 2024-04-12T19:39:09.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.624+0000 7f8b23400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8b240be420 0x7f8b240be800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:53614/0 (socket says 172.21.15.131:53614) 2024-04-12T19:39:09.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.624+0000 7f8b23400640 1 -- 172.21.15.131:0/2437062493 learned_addr learned my addr 172.21.15.131:0/2437062493 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.624+0000 7f8b23e00640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b240bf1c0 0x7f8b2415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.624+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4179550620 0 0) 0x7f8b240bd9d0 con 0x7f8b240be420 2024-04-12T19:39:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.624+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8b08003520 con 0x7f8b240be420 2024-04-12T19:39:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2651911044 0 0) 0x7f8b08003520 con 0x7f8b240be420 2024-04-12T19:39:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b240bf1c0 msgr2=0x7f8b2415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b240bf1c0 0x7f8b2415ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 >> v1:172.21.15.171:6789/0 conn(0x7f8b241546f0 legacy=0x7f8b240bd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2406e660 con 0x7f8b240be420 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f8b14001670 con 0x7f8b240be420 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 >> v1:172.21.15.131:6789/0 conn(0x7f8b240be420 legacy=0x7f8b240be800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b240bf1c0 0x7f8b08003a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b08003f80 0x7f8b08004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b08004d40 0x7f8b080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8b24155630 con 0x7f8b08003f80 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8b0800bc00 con 0x7f8b08004d40 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8b0800be00 con 0x7f8b240bf1c0 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22a00640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b08003f80 0x7f8b08004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b23e00640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b08004d40 0x7f8b080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b23400640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b240bf1c0 0x7f8b08003a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22a00640 1 -- 172.21.15.131:0/2437062493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b240bf1c0 msgr2=0x7f8b08003a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:09.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.625+0000 7f8b22a00640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b240bf1c0 0x7f8b08003a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.626+0000 7f8b22a00640 1 -- 172.21.15.131:0/2437062493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b08004d40 msgr2=0x7f8b080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:09.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.626+0000 7f8b22a00640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b08004d40 0x7f8b080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.626+0000 7f8b22a00640 1 -- 172.21.15.131:0/2437062493 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b08003520 con 0x7f8b08003f80 2024-04-12T19:39:09.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.626+0000 7f8b23e00640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b08004d40 0x7f8b080051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:09.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.627+0000 7f8b22a00640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b08003f80 0x7f8b08004800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b10001750 tx=0x7f8b08005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4195cd4a9d5d8c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:09.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.627+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10001370 con 0x7f8b08003f80 2024-04-12T19:39:09.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.627+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b100052d0 con 0x7f8b08003f80 2024-04-12T19:39:09.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.627+0000 7f8b22000640 1 -- 172.21.15.131:0/2437062493 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10003830 con 0x7f8b08003f80 2024-04-12T19:39:09.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.627+0000 7f8b29200640 1 -- 172.21.15.131:0/2437062493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b08003f80 msgr2=0x7f8b08004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:09.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.627+0000 7f8b29200640 1 --2- 172.21.15.131:0/2437062493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b08003f80 0x7f8b08004800 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8b10001750 tx=0x7f8b08005830 comp rx=0 tx=0).stop 2024-04-12T19:39:09.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.627+0000 7f8b23e00640 1 -- 172.21.15.131:0/2437062493 reap_dead start 2024-04-12T19:39:09.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.628+0000 7f8b29200640 1 -- 172.21.15.131:0/2437062493 shutdown_connections 2024-04-12T19:39:09.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.628+0000 7f8b29200640 1 -- 172.21.15.131:0/2437062493 >> 172.21.15.131:0/2437062493 conn(0x7f8b2406bbc0 msgr2=0x7f8b2406bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:09.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.628+0000 7f8b29200640 1 -- 172.21.15.131:0/2437062493 shutdown_connections 2024-04-12T19:39:09.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.628+0000 7f8b29200640 1 -- 172.21.15.131:0/2437062493 wait complete. 2024-04-12T19:39:09.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.629+0000 7f8b29200640 1 Processor -- start 2024-04-12T19:39:09.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.629+0000 7f8b29200640 1 -- start start 2024-04-12T19:39:09.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.630+0000 7f8b29200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b08003f80 0x7f8b24148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.630+0000 7f8b29200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b24147780 0x7f8b24147c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.630+0000 7f8b29200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b240a10f0 0x7f8b240a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.630+0000 7f8b29200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2406f420 con 0x7f8b240a10f0 2024-04-12T19:39:09.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.630+0000 7f8b29200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2406ec20 con 0x7f8b08003f80 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.630+0000 7f8b29200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8b240b92d0 con 0x7f8b24147780 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.630+0000 7f8b23e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b240a10f0 0x7f8b240a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.631+0000 7f8b23e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b240a10f0 0x7f8b240a1570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:49266/0 (socket says 172.21.15.131:49266) 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.631+0000 7f8b23e00640 1 -- 172.21.15.131:0/4221695040 learned_addr learned my addr 172.21.15.131:0/4221695040 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.631+0000 7f8b22a00640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b24147780 0x7f8b24147c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.631+0000 7f8b23400640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b08003f80 0x7f8b24148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.631+0000 7f8b23e00640 1 -- 172.21.15.131:0/4221695040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b24147780 msgr2=0x7f8b24147c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.631+0000 7f8b23e00640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b24147780 0x7f8b24147c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.631+0000 7f8b23e00640 1 -- 172.21.15.131:0/4221695040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b08003f80 msgr2=0x7f8b24148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.631+0000 7f8b23e00640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b08003f80 0x7f8b24148900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.631+0000 7f8b23e00640 1 -- 172.21.15.131:0/4221695040 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b24148e40 con 0x7f8b240a10f0 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.631+0000 7f8b23400640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b08003f80 0x7f8b24148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:09.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.631+0000 7f8b23e00640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b240a10f0 0x7f8b240a1570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b24071080 tx=0x7f8b1c00f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:09.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.631+0000 7f8b1b400640 1 -- 172.21.15.131:0/4221695040 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c01c070 con 0x7f8b240a10f0 2024-04-12T19:39:09.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.632+0000 7f8b1b400640 1 -- 172.21.15.131:0/4221695040 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1c017400 con 0x7f8b240a10f0 2024-04-12T19:39:09.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.632+0000 7f8b29200640 1 -- 172.21.15.131:0/4221695040 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b240a05b0 con 0x7f8b240a10f0 2024-04-12T19:39:09.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.632+0000 7f8b1b400640 1 -- 172.21.15.131:0/4221695040 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c0177f0 con 0x7f8b240a10f0 2024-04-12T19:39:09.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.632+0000 7f8b29200640 1 -- 172.21.15.131:0/4221695040 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b24154240 con 0x7f8b240a10f0 2024-04-12T19:39:09.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.633+0000 7f8b29200640 1 -- 172.21.15.131:0/4221695040 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b241536b0 con 0x7f8b240a10f0 2024-04-12T19:39:09.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.634+0000 7f8b1b400640 1 -- 172.21.15.131:0/4221695040 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8b1c005d10 con 0x7f8b240a10f0 2024-04-12T19:39:09.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.635+0000 7f8b1b400640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8b0406c920 0x7f8b0406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:09.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.635+0000 7f8b1b400640 1 -- 172.21.15.131:0/4221695040 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7f8b1c08bbd0 con 0x7f8b240a10f0 2024-04-12T19:39:09.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.635+0000 7f8b23400640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8b0406c920 0x7f8b0406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:09.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.636+0000 7f8b23400640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8b0406c920 0x7f8b0406ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b14001200 tx=0x7f8b14001e50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:09.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.640+0000 7f8b1b400640 1 -- 172.21.15.131:0/4221695040 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8b240a05b0 con 0x7f8b240a10f0 2024-04-12T19:39:09.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:09.843+0000 7f8b29200640 1 -- 172.21.15.131:0/4221695040 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f8b2404fd50 con 0x7f8b240a10f0 2024-04-12T19:39:10.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.398+0000 7f8b1b400640 1 -- 172.21.15.131:0/4221695040 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7f8b1c012070 con 0x7f8b240a10f0 2024-04-12T19:39:10.400 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data' created 2024-04-12T19:39:10.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.402+0000 7f8b29200640 1 -- 172.21.15.131:0/4221695040 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8b0406c920 msgr2=0x7f8b0406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:10.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.402+0000 7f8b29200640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8b0406c920 0x7f8b0406ede0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8b14001200 tx=0x7f8b14001e50 comp rx=0 tx=0).stop 2024-04-12T19:39:10.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.402+0000 7f8b29200640 1 -- 172.21.15.131:0/4221695040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b240a10f0 msgr2=0x7f8b240a1570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:10.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.402+0000 7f8b29200640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b240a10f0 0x7f8b240a1570 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f8b24071080 tx=0x7f8b1c00f4a0 comp rx=0 tx=0).stop 2024-04-12T19:39:10.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.403+0000 7f8b29200640 1 -- 172.21.15.131:0/4221695040 shutdown_connections 2024-04-12T19:39:10.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.403+0000 7f8b29200640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8b0406c920 0x7f8b0406ede0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:10.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.403+0000 7f8b29200640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8b240a10f0 0x7f8b240a1570 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:10.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.403+0000 7f8b29200640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8b24147780 0x7f8b24147c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:10.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.403+0000 7f8b29200640 1 --2- 172.21.15.131:0/4221695040 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8b08003f80 0x7f8b24148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:10.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.403+0000 7f8b29200640 1 -- 172.21.15.131:0/4221695040 >> 172.21.15.131:0/4221695040 conn(0x7f8b2406bbc0 msgr2=0x7f8b24153910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:10.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.403+0000 7f8b29200640 1 -- 172.21.15.131:0/4221695040 shutdown_connections 2024-04-12T19:39:10.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.403+0000 7f8b29200640 1 -- 172.21.15.131:0/4221695040 wait complete. 2024-04-12T19:39:10.440 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-12T19:39:10.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.623+0000 7f5f0ae00640 1 Processor -- start 2024-04-12T19:39:10.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.623+0000 7f5f0ae00640 1 -- start start 2024-04-12T19:39:10.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.624+0000 7f5f0ae00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5f04073cc0 0x7f5f040a7150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:10.625 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.624+0000 7f5f0ae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040c2ac0 0x7f5f041586d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:10.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.624+0000 7f5f0ae00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f040a5850 con 0x7f5f040bd310 2024-04-12T19:39:10.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.624+0000 7f5f0ae00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5f0406f510 con 0x7f5f04073cc0 2024-04-12T19:39:10.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.624+0000 7f5f0ae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5f040a5b10 con 0x7f5f040c2ac0 2024-04-12T19:39:10.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.625+0000 7f5f08e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040c2ac0 0x7f5f041586d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:10.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.625+0000 7f5f08e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040c2ac0 0x7f5f041586d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:49044/0 (socket says 172.21.15.131:49044) 2024-04-12T19:39:10.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.625+0000 7f5f08e00640 1 -- 172.21.15.131:0/3458770027 learned_addr learned my addr 172.21.15.131:0/3458770027 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:10.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.625+0000 7f5f03e00640 1 --2- 172.21.15.131:0/3458770027 >> v2:172.21.15.171:3300/0 conn(0x7f5f04073cc0 0x7f5f040a7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:10.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.626+0000 7f5f03400640 1 -- 172.21.15.131:0/3458770027 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2715922499 0 0) 0x7f5f040a5850 con 0x7f5f040bd310 2024-04-12T19:39:10.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.626+0000 7f5f08e00640 1 -- 172.21.15.131:0/3458770027 >> v2:172.21.15.171:3300/0 conn(0x7f5f04073cc0 msgr2=0x7f5f040a7150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:10.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.626+0000 7f5f08e00640 1 --2- 172.21.15.131:0/3458770027 >> v2:172.21.15.171:3300/0 conn(0x7f5f04073cc0 0x7f5f040a7150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:10.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.626+0000 7f5f08e00640 1 -- 172.21.15.131:0/3458770027 >> v1:172.21.15.171:6789/0 conn(0x7f5f040bd310 legacy=0x7f5f040be870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:10.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.626+0000 7f5f08e00640 1 -- 172.21.15.131:0/3458770027 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0406f010 con 0x7f5f040c2ac0 2024-04-12T19:39:10.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.626+0000 7f5f03e00640 1 --2- 172.21.15.131:0/3458770027 >> v2:172.21.15.171:3300/0 conn(0x7f5f04073cc0 0x7f5f040a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:39:10.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.628+0000 7f5f08e00640 1 --2- 172.21.15.131:0/3458770027 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040c2ac0 0x7f5f041586d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009e50 tx=0x7f5efc02e0e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ec965d00d5122a1b server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:10.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.628+0000 7f5f03400640 1 -- 172.21.15.131:0/3458770027 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc02ec80 con 0x7f5f040c2ac0 2024-04-12T19:39:10.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.628+0000 7f5f03400640 1 -- 172.21.15.131:0/3458770027 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5efc02ee20 con 0x7f5f040c2ac0 2024-04-12T19:39:10.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.628+0000 7f5f03400640 1 -- 172.21.15.131:0/3458770027 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5efc036610 con 0x7f5f040c2ac0 2024-04-12T19:39:10.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.629+0000 7f5f0ae00640 1 -- 172.21.15.131:0/3458770027 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040c2ac0 msgr2=0x7f5f041586d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:10.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.629+0000 7f5f0ae00640 1 --2- 172.21.15.131:0/3458770027 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040c2ac0 0x7f5f041586d0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5efc009e50 tx=0x7f5efc02e0e0 comp rx=0 tx=0).stop 2024-04-12T19:39:10.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.629+0000 7f5f0ae00640 1 -- 172.21.15.131:0/3458770027 shutdown_connections 2024-04-12T19:39:10.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.629+0000 7f5f0ae00640 1 --2- 172.21.15.131:0/3458770027 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f040c2ac0 0x7f5f041586d0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:10.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.629+0000 7f5f0ae00640 1 --2- 172.21.15.131:0/3458770027 >> v2:172.21.15.171:3300/0 conn(0x7f5f04073cc0 0x7f5f040a7150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:10.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.629+0000 7f5f0ae00640 1 -- 172.21.15.131:0/3458770027 >> 172.21.15.131:0/3458770027 conn(0x7f5f0406be00 msgr2=0x7f5f0406c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:10.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.629+0000 7f5f0ae00640 1 -- 172.21.15.131:0/3458770027 shutdown_connections 2024-04-12T19:39:10.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.629+0000 7f5f0ae00640 1 -- 172.21.15.131:0/3458770027 wait complete. 2024-04-12T19:39:10.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.631+0000 7f5f0ae00640 1 Processor -- start 2024-04-12T19:39:10.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.631+0000 7f5f0ae00640 1 -- start start 2024-04-12T19:39:10.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.632+0000 7f5f0ae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f04073cc0 0x7f5f0414ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:10.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.632+0000 7f5f0ae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f040bd310 0x7f5f041d7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:10.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.632+0000 7f5f0ae00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f040c2ac0 0x7f5f041d9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:10.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.632+0000 7f5f0ae00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5f040a7a80 con 0x7f5f040bd310 2024-04-12T19:39:10.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.632+0000 7f5f0ae00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5f040b62a0 con 0x7f5f040c2ac0 2024-04-12T19:39:10.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.632+0000 7f5f0ae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5f040c2f50 con 0x7f5f04073cc0 2024-04-12T19:39:10.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.632+0000 7f5efbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f040bd310 0x7f5f041d7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:10.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.632+0000 7f5efbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f040bd310 0x7f5f041d7ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39976/0 (socket says 172.21.15.131:39976) 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.632+0000 7f5efbe00640 1 -- 172.21.15.131:0/2921912470 learned_addr learned my addr 172.21.15.131:0/2921912470 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.633+0000 7f5f03e00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f04073cc0 0x7f5f0414ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.633+0000 7f5f08e00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f040c2ac0 0x7f5f041d9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.633+0000 7f5efbe00640 1 -- 172.21.15.131:0/2921912470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f04073cc0 msgr2=0x7f5f0414ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.633+0000 7f5efbe00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f04073cc0 0x7f5f0414ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.633+0000 7f5efbe00640 1 -- 172.21.15.131:0/2921912470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f040c2ac0 msgr2=0x7f5f041d9660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.633+0000 7f5efbe00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f040c2ac0 0x7f5f041d9660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.633+0000 7f5efbe00640 1 -- 172.21.15.131:0/2921912470 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f04150b50 con 0x7f5f040bd310 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.633+0000 7f5efbe00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f040bd310 0x7f5f041d7ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c490 tx=0x7f5eec00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.633+0000 7f5f00c00640 1 -- 172.21.15.131:0/2921912470 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec005480 con 0x7f5f040bd310 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.633+0000 7f5f00c00640 1 -- 172.21.15.131:0/2921912470 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5eec0035f0 con 0x7f5f040bd310 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.633+0000 7f5f00c00640 1 -- 172.21.15.131:0/2921912470 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0039c0 con 0x7f5f040bd310 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.633+0000 7f5f0ae00640 1 -- 172.21.15.131:0/2921912470 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f04150450 con 0x7f5f040bd310 2024-04-12T19:39:10.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.634+0000 7f5f0ae00640 1 -- 172.21.15.131:0/2921912470 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f041510a0 con 0x7f5f040bd310 2024-04-12T19:39:10.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.635+0000 7f5f0ae00640 1 -- 172.21.15.131:0/2921912470 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f0404fd50 con 0x7f5f040bd310 2024-04-12T19:39:10.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.636+0000 7f5f00c00640 1 -- 172.21.15.131:0/2921912470 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5eec003b60 con 0x7f5f040bd310 2024-04-12T19:39:10.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.637+0000 7f5f00c00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5ee006ca90 0x7f5ee006ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:10.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.637+0000 7f5f00c00640 1 -- 172.21.15.131:0/2921912470 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f5eec08b6c0 con 0x7f5f040bd310 2024-04-12T19:39:10.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.637+0000 7f5f03e00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5ee006ca90 0x7f5ee006ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:10.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.638+0000 7f5f03e00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5ee006ca90 0x7f5ee006ef50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009560 tx=0x7f5ef4008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:10.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.642+0000 7f5f00c00640 1 -- 172.21.15.131:0/2921912470 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5eec0182b0 con 0x7f5f040bd310 2024-04-12T19:39:10.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:10.874+0000 7f5f0ae00640 1 -- 172.21.15.131:0/2921912470 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5f0406c490 con 0x7f5f040bd310 2024-04-12T19:39:11.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.446+0000 7f5f00c00640 1 -- 172.21.15.131:0/2921912470 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f5eec059be0 con 0x7f5f040bd310 2024-04-12T19:39:11.450 INFO:teuthology.orchestra.run.smithi131.stderr:new fs with metadata pool 2 and data pool 3 2024-04-12T19:39:11.455 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.454+0000 7f5f0ae00640 1 -- 172.21.15.131:0/2921912470 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5ee006ca90 msgr2=0x7f5ee006ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:11.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.454+0000 7f5f0ae00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5ee006ca90 0x7f5ee006ef50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009560 tx=0x7f5ef4008040 comp rx=0 tx=0).stop 2024-04-12T19:39:11.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.454+0000 7f5f0ae00640 1 -- 172.21.15.131:0/2921912470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f040bd310 msgr2=0x7f5f041d7ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:11.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.454+0000 7f5f0ae00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f040bd310 0x7f5f041d7ac0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c490 tx=0x7f5eec00c950 comp rx=0 tx=0).stop 2024-04-12T19:39:11.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.455+0000 7f5f0ae00640 1 -- 172.21.15.131:0/2921912470 shutdown_connections 2024-04-12T19:39:11.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.455+0000 7f5f0ae00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5ee006ca90 0x7f5ee006ef50 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5ef4009560 tx=0x7f5ef4008040 comp rx=0 tx=0).stop 2024-04-12T19:39:11.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.455+0000 7f5f0ae00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f040c2ac0 0x7f5f041d9660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:11.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.455+0000 7f5f0ae00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f040bd310 0x7f5f041d7ac0 secure :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00c490 tx=0x7f5eec00c950 comp rx=0 tx=0).stop 2024-04-12T19:39:11.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.455+0000 7f5f0ae00640 1 --2- 172.21.15.131:0/2921912470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f04073cc0 0x7f5f0414ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:11.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.455+0000 7f5f0ae00640 1 -- 172.21.15.131:0/2921912470 >> 172.21.15.131:0/2921912470 conn(0x7f5f0406be00 msgr2=0x7f5f040c16e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:11.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.455+0000 7f5f0ae00640 1 -- 172.21.15.131:0/2921912470 shutdown_connections 2024-04-12T19:39:11.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.456+0000 7f5f0ae00640 1 -- 172.21.15.131:0/2921912470 wait complete. 2024-04-12T19:39:11.486 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-12T19:39:11.486 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-12T19:39:11.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.665+0000 7f0f6f600640 1 Processor -- start 2024-04-12T19:39:11.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.665+0000 7f0f6f600640 1 -- start start 2024-04-12T19:39:11.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.666+0000 7f0f6f600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0f680abec0 0x7f0f680c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:11.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.666+0000 7f0f6f600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0f68159bf0 0x7f0f6815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:11.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.667+0000 7f0f6f600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f680c6120 con 0x7f0f680c4df0 2024-04-12T19:39:11.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.667+0000 7f0f6f600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f0f680ac2a0 con 0x7f0f68159bf0 2024-04-12T19:39:11.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.667+0000 7f0f6f600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f0f680c48e0 con 0x7f0f680abec0 2024-04-12T19:39:11.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.667+0000 7f0f6d600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0f68159bf0 0x7f0f6815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:11.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.667+0000 7f0f6d600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0f68159bf0 0x7f0f6815bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39978/0 (socket says 172.21.15.131:39978) 2024-04-12T19:39:11.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.667+0000 7f0f6d600640 1 -- 172.21.15.131:0/1825162129 learned_addr learned my addr 172.21.15.131:0/1825162129 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:11.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.667+0000 7f0f6cc00640 1 --2- 172.21.15.131:0/1825162129 >> v2:172.21.15.171:3300/0 conn(0x7f0f680abec0 0x7f0f680c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:11.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.667+0000 7f0f6d600640 1 -- 172.21.15.131:0/1825162129 >> v2:172.21.15.171:3300/0 conn(0x7f0f680abec0 msgr2=0x7f0f680c1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:11.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.667+0000 7f0f6d600640 1 --2- 172.21.15.131:0/1825162129 >> v2:172.21.15.171:3300/0 conn(0x7f0f680abec0 0x7f0f680c1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:11.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.667+0000 7f0f6d600640 1 -- 172.21.15.131:0/1825162129 >> v1:172.21.15.171:6789/0 conn(0x7f0f680c4df0 legacy=0x7f0f680c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:11.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.667+0000 7f0f6d600640 1 -- 172.21.15.131:0/1825162129 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f680c63e0 con 0x7f0f68159bf0 2024-04-12T19:39:11.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.668+0000 7f0f6d600640 1 --2- 172.21.15.131:0/1825162129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68159bf0 0x7f0f6815bfe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0f680c79b0 tx=0x7f0f6002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=931c3ff67ae80332 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:11.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.669+0000 7f0f67400640 1 -- 172.21.15.131:0/1825162129 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60035020 con 0x7f0f68159bf0 2024-04-12T19:39:11.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.669+0000 7f0f67400640 1 -- 172.21.15.131:0/1825162129 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f60031870 con 0x7f0f68159bf0 2024-04-12T19:39:11.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.669+0000 7f0f67400640 1 -- 172.21.15.131:0/1825162129 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60031c40 con 0x7f0f68159bf0 2024-04-12T19:39:11.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.669+0000 7f0f6f600640 1 -- 172.21.15.131:0/1825162129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68159bf0 msgr2=0x7f0f6815bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:11.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.669+0000 7f0f6f600640 1 --2- 172.21.15.131:0/1825162129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68159bf0 0x7f0f6815bfe0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0f680c79b0 tx=0x7f0f6002b910 comp rx=0 tx=0).stop 2024-04-12T19:39:11.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.669+0000 7f0f6f600640 1 -- 172.21.15.131:0/1825162129 shutdown_connections 2024-04-12T19:39:11.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.669+0000 7f0f6f600640 1 --2- 172.21.15.131:0/1825162129 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68159bf0 0x7f0f6815bfe0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:11.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.669+0000 7f0f6f600640 1 --2- 172.21.15.131:0/1825162129 >> v2:172.21.15.171:3300/0 conn(0x7f0f680abec0 0x7f0f680c1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:11.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.669+0000 7f0f6f600640 1 -- 172.21.15.131:0/1825162129 >> 172.21.15.131:0/1825162129 conn(0x7f0f680a84e0 msgr2=0x7f0f680a88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:11.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.670+0000 7f0f6f600640 1 -- 172.21.15.131:0/1825162129 shutdown_connections 2024-04-12T19:39:11.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.670+0000 7f0f6f600640 1 -- 172.21.15.131:0/1825162129 wait complete. 2024-04-12T19:39:11.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.671+0000 7f0f6f600640 1 Processor -- start 2024-04-12T19:39:11.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.671+0000 7f0f6f600640 1 -- start start 2024-04-12T19:39:11.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.672+0000 7f0f6f600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f680abec0 0x7f0f68153f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:11.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.672+0000 7f0f6f600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f680c4df0 0x7f0f681e70c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:11.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.672+0000 7f0f6f600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68159bf0 0x7f0f681e7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:11.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.672+0000 7f0f6f600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0f680c17b0 con 0x7f0f68159bf0 2024-04-12T19:39:11.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.672+0000 7f0f6f600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0f6806e8e0 con 0x7f0f680abec0 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.672+0000 7f0f6f600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0f681eaef0 con 0x7f0f680c4df0 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.672+0000 7f0f6d600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68159bf0 0x7f0f681e7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.672+0000 7f0f6d600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68159bf0 0x7f0f681e7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39984/0 (socket says 172.21.15.131:39984) 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.672+0000 7f0f6d600640 1 -- 172.21.15.131:0/4214959117 learned_addr learned my addr 172.21.15.131:0/4214959117 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.672+0000 7f0f6cc00640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f680abec0 0x7f0f68153f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.673+0000 7f0f67e00640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f680c4df0 0x7f0f681e70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.673+0000 7f0f6d600640 1 -- 172.21.15.131:0/4214959117 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f680c4df0 msgr2=0x7f0f681e70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.673+0000 7f0f6d600640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f680c4df0 0x7f0f681e70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.673+0000 7f0f6d600640 1 -- 172.21.15.131:0/4214959117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f680abec0 msgr2=0x7f0f68153f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.673+0000 7f0f6d600640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f680abec0 0x7f0f68153f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.673+0000 7f0f6d600640 1 -- 172.21.15.131:0/4214959117 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f68154450 con 0x7f0f68159bf0 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.673+0000 7f0f6d600640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68159bf0 0x7f0f681e7600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0f6002b950 tx=0x7f0f600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:11.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.673+0000 7f0f64c00640 1 -- 172.21.15.131:0/4214959117 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60040070 con 0x7f0f68159bf0 2024-04-12T19:39:11.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.673+0000 7f0f64c00640 1 -- 172.21.15.131:0/4214959117 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f60030d00 con 0x7f0f68159bf0 2024-04-12T19:39:11.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.673+0000 7f0f64c00640 1 -- 172.21.15.131:0/4214959117 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f60035040 con 0x7f0f68159bf0 2024-04-12T19:39:11.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.673+0000 7f0f6f600640 1 -- 172.21.15.131:0/4214959117 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f681eb140 con 0x7f0f68159bf0 2024-04-12T19:39:11.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.673+0000 7f0f6f600640 1 -- 172.21.15.131:0/4214959117 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f6814ea50 con 0x7f0f68159bf0 2024-04-12T19:39:11.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.675+0000 7f0f6f600640 1 -- 172.21.15.131:0/4214959117 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f6804fdc0 con 0x7f0f68159bf0 2024-04-12T19:39:11.676 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.675+0000 7f0f64c00640 1 -- 172.21.15.131:0/4214959117 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0f60038020 con 0x7f0f68159bf0 2024-04-12T19:39:11.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.676+0000 7f0f64c00640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0f4406c8f0 0x7f0f4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:11.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.676+0000 7f0f64c00640 1 -- 172.21.15.131:0/4214959117 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f0f600ad7d0 con 0x7f0f68159bf0 2024-04-12T19:39:11.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.676+0000 7f0f6cc00640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0f4406c8f0 0x7f0f4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:11.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.677+0000 7f0f6cc00640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0f4406c8f0 0x7f0f4406edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f58006fd0 tx=0x7f0f58008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:11.682 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.682+0000 7f0f64c00640 1 -- 172.21.15.131:0/4214959117 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0f6007bc90 con 0x7f0f68159bf0 2024-04-12T19:39:11.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:11.877+0000 7f0f6f600640 1 -- 172.21.15.131:0/4214959117 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f0f680c7740 con 0x7f0f68159bf0 2024-04-12T19:39:12.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.445+0000 7f0f64c00640 1 -- 172.21.15.131:0/4214959117 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f0f6007b590 con 0x7f0f68159bf0 2024-04-12T19:39:12.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.448+0000 7f0f6f600640 1 -- 172.21.15.131:0/4214959117 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0f4406c8f0 msgr2=0x7f0f4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:12.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.448+0000 7f0f6f600640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0f4406c8f0 0x7f0f4406edb0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f0f58006fd0 tx=0x7f0f58008040 comp rx=0 tx=0).stop 2024-04-12T19:39:12.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.449+0000 7f0f6f600640 1 -- 172.21.15.131:0/4214959117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68159bf0 msgr2=0x7f0f681e7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:12.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.449+0000 7f0f6f600640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68159bf0 0x7f0f681e7600 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f0f6002b950 tx=0x7f0f600046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:12.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.449+0000 7f0f6f600640 1 -- 172.21.15.131:0/4214959117 shutdown_connections 2024-04-12T19:39:12.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.449+0000 7f0f6f600640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0f4406c8f0 0x7f0f4406edb0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:12.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.449+0000 7f0f6f600640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0f68159bf0 0x7f0f681e7600 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:12.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.449+0000 7f0f6f600640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0f680c4df0 0x7f0f681e70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:12.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.449+0000 7f0f6f600640 1 --2- 172.21.15.131:0/4214959117 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0f680abec0 0x7f0f68153f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:12.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.449+0000 7f0f6f600640 1 -- 172.21.15.131:0/4214959117 >> 172.21.15.131:0/4214959117 conn(0x7f0f680a84e0 msgr2=0x7f0f680a7d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:12.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.449+0000 7f0f6f600640 1 -- 172.21.15.131:0/4214959117 shutdown_connections 2024-04-12T19:39:12.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.449+0000 7f0f6f600640 1 -- 172.21.15.131:0/4214959117 wait complete. 2024-04-12T19:39:12.474 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-12T19:39:12.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.691+0000 7fb3a1000640 1 Processor -- start 2024-04-12T19:39:12.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.692+0000 7fb3a1000640 1 -- start start 2024-04-12T19:39:12.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.693+0000 7fb3a1000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb39c0c1770 0x7fb39c0737e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:12.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.693+0000 7fb3a1000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb39c073d20 0x7fb39c0c2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:12.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.693+0000 7fb3a1000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb39c0c32b0 con 0x7fb39c0c2e60 2024-04-12T19:39:12.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.693+0000 7fb3a1000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb39c0bd750 con 0x7fb39c0c1770 2024-04-12T19:39:12.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.693+0000 7fb3a1000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb39c0b85a0 con 0x7fb39c073d20 2024-04-12T19:39:12.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.694+0000 7fb39a800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb39c0c2e60 0x7fb39c1513f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:37100/0 (socket says 172.21.15.131:37100) 2024-04-12T19:39:12.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.694+0000 7fb39a800640 1 -- 172.21.15.131:0/3519278474 learned_addr learned my addr 172.21.15.131:0/3519278474 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:12.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.694+0000 7fb399400640 1 --2- 172.21.15.131:0/3519278474 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb39c073d20 0x7fb39c0c2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:12.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.694+0000 7fb399e00640 1 --2- 172.21.15.131:0/3519278474 >> v2:172.21.15.171:3300/0 conn(0x7fb39c0c1770 0x7fb39c0737e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:12.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.694+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 687525236 0 0) 0x7fb39c0c32b0 con 0x7fb39c0c2e60 2024-04-12T19:39:12.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.694+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb380003520 con 0x7fb39c0c2e60 2024-04-12T19:39:12.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.694+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3981185916 0 0) 0x7fb380003520 con 0x7fb39c0c2e60 2024-04-12T19:39:12.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.694+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb39c073d20 msgr2=0x7fb39c0c2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:12.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.694+0000 7fb398a00640 1 --2- 172.21.15.131:0/3519278474 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb39c073d20 0x7fb39c0c2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:12.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 >> v2:172.21.15.171:3300/0 conn(0x7fb39c0c1770 msgr2=0x7fb39c0737e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:12.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb398a00640 1 --2- 172.21.15.131:0/3519278474 >> v2:172.21.15.171:3300/0 conn(0x7fb39c0c1770 0x7fb39c0737e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:12.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39c0b8880 con 0x7fb39c0c2e60 2024-04-12T19:39:12.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7fb3940019f0 con 0x7fb39c0c2e60 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 >> v1:172.21.15.131:6789/0 conn(0x7fb39c0c2e60 legacy=0x7fb39c1513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb398a00640 1 --2- 172.21.15.131:0/3519278474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3800039e0 0x7fb380003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb398a00640 1 --2- 172.21.15.131:0/3519278474 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb39c073d20 0x7fb380004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb398a00640 1 --2- 172.21.15.131:0/3519278474 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb380004d40 0x7fb3800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c0bd750 con 0x7fb3800039e0 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c0b85a0 con 0x7fb380004d40 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb38000b9f0 con 0x7fb39c073d20 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb399e00640 1 --2- 172.21.15.131:0/3519278474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3800039e0 0x7fb380003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb39a800640 1 --2- 172.21.15.131:0/3519278474 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb380004d40 0x7fb3800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb399e00640 1 -- 172.21.15.131:0/3519278474 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb39c073d20 msgr2=0x7fb380004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb399e00640 1 --2- 172.21.15.131:0/3519278474 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb39c073d20 0x7fb380004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb399e00640 1 -- 172.21.15.131:0/3519278474 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb380004d40 msgr2=0x7fb3800051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb399e00640 1 --2- 172.21.15.131:0/3519278474 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb380004d40 0x7fb3800051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb399e00640 1 -- 172.21.15.131:0/3519278474 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb380003520 con 0x7fb3800039e0 2024-04-12T19:39:12.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.695+0000 7fb39a800640 1 --2- 172.21.15.131:0/3519278474 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb380004d40 0x7fb3800051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:12.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.696+0000 7fb399e00640 1 --2- 172.21.15.131:0/3519278474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3800039e0 0x7fb380003e00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009ac0 tx=0x7fb380005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4cb2465165aea6c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:12.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.696+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38c039070 con 0x7fb3800039e0 2024-04-12T19:39:12.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.697+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb38c02c710 con 0x7fb3800039e0 2024-04-12T19:39:12.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.697+0000 7fb398a00640 1 -- 172.21.15.131:0/3519278474 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38c009690 con 0x7fb3800039e0 2024-04-12T19:39:12.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.697+0000 7fb3a1000640 1 -- 172.21.15.131:0/3519278474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3800039e0 msgr2=0x7fb380003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.697+0000 7fb3a1000640 1 --2- 172.21.15.131:0/3519278474 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3800039e0 0x7fb380003e00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fb38c009ac0 tx=0x7fb380005830 comp rx=0 tx=0).stop 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.697+0000 7fb39a800640 1 -- 172.21.15.131:0/3519278474 reap_dead start 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.697+0000 7fb3a1000640 1 -- 172.21.15.131:0/3519278474 shutdown_connections 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.697+0000 7fb3a1000640 1 -- 172.21.15.131:0/3519278474 >> 172.21.15.131:0/3519278474 conn(0x7fb39c0a42a0 msgr2=0x7fb39c0a4680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.697+0000 7fb3a1000640 1 -- 172.21.15.131:0/3519278474 shutdown_connections 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.697+0000 7fb3a1000640 1 -- 172.21.15.131:0/3519278474 wait complete. 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.699+0000 7fb3a1000640 1 Processor -- start 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.699+0000 7fb3a1000640 1 -- start start 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.700+0000 7fb3a1000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3800039e0 0x7fb39c135ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.700+0000 7fb3a1000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb39c13c750 0x7fb39c06eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.700+0000 7fb3a1000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb39c06f0c0 0x7fb39c147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.700+0000 7fb3a1000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c0b8b60 con 0x7fb39c13c750 2024-04-12T19:39:12.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.700+0000 7fb3a1000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c0bdbd0 con 0x7fb3800039e0 2024-04-12T19:39:12.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.700+0000 7fb3a1000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb39c0b8ce0 con 0x7fb39c06f0c0 2024-04-12T19:39:12.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.701+0000 7fb399400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb39c13c750 0x7fb39c06eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:12.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.701+0000 7fb399400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb39c13c750 0x7fb39c06eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40004/0 (socket says 172.21.15.131:40004) 2024-04-12T19:39:12.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.701+0000 7fb399400640 1 -- 172.21.15.131:0/1483452139 learned_addr learned my addr 172.21.15.131:0/1483452139 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:12.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.701+0000 7fb399e00640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3800039e0 0x7fb39c135ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:12.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.701+0000 7fb399400640 1 -- 172.21.15.131:0/1483452139 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb39c06f0c0 msgr2=0x7fb39c147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:12.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.701+0000 7fb399400640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb39c06f0c0 0x7fb39c147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:12.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.701+0000 7fb399400640 1 -- 172.21.15.131:0/1483452139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3800039e0 msgr2=0x7fb39c135ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:12.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.701+0000 7fb399400640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3800039e0 0x7fb39c135ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:12.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.701+0000 7fb399400640 1 -- 172.21.15.131:0/1483452139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39c144a80 con 0x7fb39c13c750 2024-04-12T19:39:12.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.701+0000 7fb399400640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb39c13c750 0x7fb39c06eb80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb38800e7f0 tx=0x7fb38800ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:12.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.701+0000 7fb392000640 1 -- 172.21.15.131:0/1483452139 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb388017070 con 0x7fb39c13c750 2024-04-12T19:39:12.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.702+0000 7fb392000640 1 -- 172.21.15.131:0/1483452139 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb38800c940 con 0x7fb39c13c750 2024-04-12T19:39:12.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.702+0000 7fb392000640 1 -- 172.21.15.131:0/1483452139 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb38800cd10 con 0x7fb39c13c750 2024-04-12T19:39:12.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.702+0000 7fb3a1000640 1 -- 172.21.15.131:0/1483452139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb39c1457b0 con 0x7fb39c13c750 2024-04-12T19:39:12.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.702+0000 7fb3a1000640 1 -- 172.21.15.131:0/1483452139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb39c0bfbc0 con 0x7fb39c13c750 2024-04-12T19:39:12.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.703+0000 7fb3a1000640 1 -- 172.21.15.131:0/1483452139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb39c147830 con 0x7fb39c13c750 2024-04-12T19:39:12.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.704+0000 7fb392000640 1 -- 172.21.15.131:0/1483452139 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb38801a070 con 0x7fb39c13c750 2024-04-12T19:39:12.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.704+0000 7fb392000640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb37c06c8f0 0x7fb37c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:12.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.705+0000 7fb392000640 1 -- 172.21.15.131:0/1483452139 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7fb38808bef0 con 0x7fb39c13c750 2024-04-12T19:39:12.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.705+0000 7fb399e00640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb37c06c8f0 0x7fb37c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:12.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.706+0000 7fb399e00640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb37c06c8f0 0x7fb37c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb38c036000 tx=0x7fb38c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:12.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.709+0000 7fb392000640 1 -- 172.21.15.131:0/1483452139 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb38805a1f0 con 0x7fb39c13c750 2024-04-12T19:39:12.900 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:12.899+0000 7fb3a1000640 1 -- 172.21.15.131:0/1483452139 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb39c1521e0 con 0x7fb39c13c750 2024-04-12T19:39:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.463+0000 7fb392000640 1 -- 172.21.15.131:0/1483452139 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7fb388059af0 con 0x7fb39c13c750 2024-04-12T19:39:14.465 INFO:teuthology.orchestra.run.smithi131.stderr:pool 'cephfs_data_ec' created 2024-04-12T19:39:14.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.467+0000 7fb3a1000640 1 -- 172.21.15.131:0/1483452139 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb37c06c8f0 msgr2=0x7fb37c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:14.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.467+0000 7fb3a1000640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb37c06c8f0 0x7fb37c06edb0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb38c036000 tx=0x7fb38c030000 comp rx=0 tx=0).stop 2024-04-12T19:39:14.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.467+0000 7fb3a1000640 1 -- 172.21.15.131:0/1483452139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb39c13c750 msgr2=0x7fb39c06eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:14.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.467+0000 7fb3a1000640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb39c13c750 0x7fb39c06eb80 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb38800e7f0 tx=0x7fb38800ecb0 comp rx=0 tx=0).stop 2024-04-12T19:39:14.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.467+0000 7fb3a1000640 1 -- 172.21.15.131:0/1483452139 shutdown_connections 2024-04-12T19:39:14.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.467+0000 7fb3a1000640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb37c06c8f0 0x7fb37c06edb0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:14.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.467+0000 7fb3a1000640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb39c06f0c0 0x7fb39c147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:14.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.467+0000 7fb3a1000640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb39c13c750 0x7fb39c06eb80 secure :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fb38800e7f0 tx=0x7fb38800ecb0 comp rx=0 tx=0).stop 2024-04-12T19:39:14.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.467+0000 7fb3a1000640 1 --2- 172.21.15.131:0/1483452139 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb3800039e0 0x7fb39c135ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:14.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.467+0000 7fb3a1000640 1 -- 172.21.15.131:0/1483452139 >> 172.21.15.131:0/1483452139 conn(0x7fb39c0a42a0 msgr2=0x7fb39c071270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:14.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.469+0000 7fb3a1000640 1 -- 172.21.15.131:0/1483452139 shutdown_connections 2024-04-12T19:39:14.471 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.469+0000 7fb3a1000640 1 -- 172.21.15.131:0/1483452139 wait complete. 2024-04-12T19:39:14.498 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-12T19:39:14.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.685+0000 7fdd3ea00640 1 Processor -- start 2024-04-12T19:39:14.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.685+0000 7fdd3ea00640 1 -- start start 2024-04-12T19:39:14.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.687+0000 7fdd3ea00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdd380abec0 0x7fdd380c1270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:14.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.687+0000 7fdd3ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd380c4df0 0x7fdd380c32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:14.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.687+0000 7fdd3ea00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd380c6120 con 0x7fdd380c37e0 2024-04-12T19:39:14.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.687+0000 7fdd3ea00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fdd380ac2a0 con 0x7fdd380abec0 2024-04-12T19:39:14.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.687+0000 7fdd3ea00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd380c48e0 con 0x7fdd380c4df0 2024-04-12T19:39:14.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.687+0000 7fdd37400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd380c4df0 0x7fdd380c32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:14.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.687+0000 7fdd37e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fdd380abec0 0x7fdd380c1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:14.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.687+0000 7fdd37400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd380c4df0 0x7fdd380c32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:49080/0 (socket says 172.21.15.131:49080) 2024-04-12T19:39:14.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.687+0000 7fdd37400640 1 -- 172.21.15.131:0/3390417091 learned_addr learned my addr 172.21.15.131:0/3390417091 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:14.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.687+0000 7fdd3ca00640 1 --1- 172.21.15.131:0/3390417091 >> v1:172.21.15.171:6789/0 conn(0x7fdd380c37e0 0x7fdd3806d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.131:38612/0 (socket says 172.21.15.131:38612) 2024-04-12T19:39:14.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.688+0000 7fdd37e00640 1 -- 172.21.15.131:0/3390417091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd380c4df0 msgr2=0x7fdd380c32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:14.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.688+0000 7fdd37e00640 1 --2- 172.21.15.131:0/3390417091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd380c4df0 0x7fdd380c32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:14.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.688+0000 7fdd37e00640 1 -- 172.21.15.131:0/3390417091 >> v1:172.21.15.171:6789/0 conn(0x7fdd380c37e0 legacy=0x7fdd3806d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:14.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.688+0000 7fdd37e00640 1 -- 172.21.15.131:0/3390417091 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd380c63e0 con 0x7fdd380abec0 2024-04-12T19:39:14.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.689+0000 7fdd37e00640 1 --2- 172.21.15.131:0/3390417091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd380abec0 0x7fdd380c1270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdd200097a0 tx=0x7fdd2002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c917efe2e0afdf61 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:14.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.690+0000 7fdd36a00640 1 -- 172.21.15.131:0/3390417091 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd20035020 con 0x7fdd380abec0 2024-04-12T19:39:14.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.690+0000 7fdd36a00640 1 -- 172.21.15.131:0/3390417091 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd20031830 con 0x7fdd380abec0 2024-04-12T19:39:14.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.690+0000 7fdd36a00640 1 -- 172.21.15.131:0/3390417091 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd20031c00 con 0x7fdd380abec0 2024-04-12T19:39:14.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.691+0000 7fdd3ea00640 1 -- 172.21.15.131:0/3390417091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd380abec0 msgr2=0x7fdd380c1270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:14.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.691+0000 7fdd3ea00640 1 --2- 172.21.15.131:0/3390417091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd380abec0 0x7fdd380c1270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fdd200097a0 tx=0x7fdd2002b8d0 comp rx=0 tx=0).stop 2024-04-12T19:39:14.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.691+0000 7fdd3ea00640 1 -- 172.21.15.131:0/3390417091 shutdown_connections 2024-04-12T19:39:14.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.691+0000 7fdd3ea00640 1 --2- 172.21.15.131:0/3390417091 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd380c4df0 0x7fdd380c32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:14.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.691+0000 7fdd3ea00640 1 --2- 172.21.15.131:0/3390417091 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd380abec0 0x7fdd380c1270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:14.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.691+0000 7fdd3ea00640 1 -- 172.21.15.131:0/3390417091 >> 172.21.15.131:0/3390417091 conn(0x7fdd380a84e0 msgr2=0x7fdd380a88f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:14.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.691+0000 7fdd3ea00640 1 -- 172.21.15.131:0/3390417091 shutdown_connections 2024-04-12T19:39:14.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.691+0000 7fdd3ea00640 1 -- 172.21.15.131:0/3390417091 wait complete. 2024-04-12T19:39:14.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.693+0000 7fdd3ea00640 1 Processor -- start 2024-04-12T19:39:14.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.693+0000 7fdd3ea00640 1 -- start start 2024-04-12T19:39:14.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.694+0000 7fdd3ea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd380abec0 0x7fdd380bf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:14.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.694+0000 7fdd3ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd380c37e0 0x7fdd380c03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:14.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.694+0000 7fdd3ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380c4df0 0x7fdd38153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:14.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.694+0000 7fdd3ea00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fdd380c17b0 con 0x7fdd380c4df0 2024-04-12T19:39:14.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.694+0000 7fdd3ea00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fdd381556a0 con 0x7fdd380abec0 2024-04-12T19:39:14.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.694+0000 7fdd3ea00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fdd38151af0 con 0x7fdd380c37e0 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.694+0000 7fdd3ca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380c4df0 0x7fdd38153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.694+0000 7fdd3ca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380c4df0 0x7fdd38153410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40018/0 (socket says 172.21.15.131:40018) 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.694+0000 7fdd3ca00640 1 -- 172.21.15.131:0/2396600757 learned_addr learned my addr 172.21.15.131:0/2396600757 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.694+0000 7fdd37e00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd380abec0 0x7fdd380bf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.694+0000 7fdd37400640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd380c37e0 0x7fdd380c03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.695+0000 7fdd3ca00640 1 -- 172.21.15.131:0/2396600757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd380c37e0 msgr2=0x7fdd380c03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.695+0000 7fdd3ca00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd380c37e0 0x7fdd380c03f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.695+0000 7fdd3ca00640 1 -- 172.21.15.131:0/2396600757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd380abec0 msgr2=0x7fdd380bf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.695+0000 7fdd3ca00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd380abec0 0x7fdd380bf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.695+0000 7fdd3ca00640 1 -- 172.21.15.131:0/2396600757 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd38151810 con 0x7fdd380c4df0 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.695+0000 7fdd3ca00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380c4df0 0x7fdd38153410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000c430 tx=0x7fdd3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.695+0000 7fdd2fe00640 1 -- 172.21.15.131:0/2396600757 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd300074e0 con 0x7fdd380c4df0 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.695+0000 7fdd2fe00640 1 -- 172.21.15.131:0/2396600757 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd30007680 con 0x7fdd380c4df0 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.695+0000 7fdd2fe00640 1 -- 172.21.15.131:0/2396600757 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd300049e0 con 0x7fdd380c4df0 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.695+0000 7fdd3ea00640 1 -- 172.21.15.131:0/2396600757 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd380bded0 con 0x7fdd380c4df0 2024-04-12T19:39:14.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.695+0000 7fdd3ea00640 1 -- 172.21.15.131:0/2396600757 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd38152ef0 con 0x7fdd380c4df0 2024-04-12T19:39:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.696+0000 7fdd3ea00640 1 -- 172.21.15.131:0/2396600757 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd381523b0 con 0x7fdd380c4df0 2024-04-12T19:39:14.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.697+0000 7fdd2fe00640 1 -- 172.21.15.131:0/2396600757 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fdd3001a020 con 0x7fdd380c4df0 2024-04-12T19:39:14.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.698+0000 7fdd2fe00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fdd1406c8f0 0x7fdd1406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:14.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.698+0000 7fdd2fe00640 1 -- 172.21.15.131:0/2396600757 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fdd3008b520 con 0x7fdd380c4df0 2024-04-12T19:39:14.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.699+0000 7fdd37e00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fdd1406c8f0 0x7fdd1406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:14.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.699+0000 7fdd37e00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fdd1406c8f0 0x7fdd1406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd20036000 tx=0x7fdd2003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:14.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.704+0000 7fdd2fe00640 1 -- 172.21.15.131:0/2396600757 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fdd300596c0 con 0x7fdd380c4df0 2024-04-12T19:39:14.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:14.905+0000 7fdd3ea00640 1 -- 172.21.15.131:0/2396600757 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fdd3804fdc0 con 0x7fdd380c4df0 2024-04-12T19:39:15.231 INFO:tasks.ceph.mds.b.smithi171.stderr:2024-04-12T19:39:15.231+0000 7fd5aa200640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-12T19:39:15.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.474+0000 7fdd2fe00640 1 -- 172.21.15.131:0/2396600757 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7fdd30058fc0 con 0x7fdd380c4df0 2024-04-12T19:39:15.476 INFO:teuthology.orchestra.run.smithi131.stderr:set pool 4 allow_ec_overwrites to true 2024-04-12T19:39:15.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.478+0000 7fdd3ea00640 1 -- 172.21.15.131:0/2396600757 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fdd1406c8f0 msgr2=0x7fdd1406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:15.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.478+0000 7fdd3ea00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fdd1406c8f0 0x7fdd1406edb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdd20036000 tx=0x7fdd2003c040 comp rx=0 tx=0).stop 2024-04-12T19:39:15.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.478+0000 7fdd3ea00640 1 -- 172.21.15.131:0/2396600757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380c4df0 msgr2=0x7fdd38153410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:15.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.478+0000 7fdd3ea00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380c4df0 0x7fdd38153410 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdd3000c430 tx=0x7fdd3000c8f0 comp rx=0 tx=0).stop 2024-04-12T19:39:15.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.478+0000 7fdd3ea00640 1 -- 172.21.15.131:0/2396600757 shutdown_connections 2024-04-12T19:39:15.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.478+0000 7fdd3ea00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fdd1406c8f0 0x7fdd1406edb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:15.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.478+0000 7fdd3ea00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380c4df0 0x7fdd38153410 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:15.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.478+0000 7fdd3ea00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fdd380c37e0 0x7fdd380c03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:15.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.478+0000 7fdd3ea00640 1 --2- 172.21.15.131:0/2396600757 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fdd380abec0 0x7fdd380bf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:15.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.478+0000 7fdd3ea00640 1 -- 172.21.15.131:0/2396600757 >> 172.21.15.131:0/2396600757 conn(0x7fdd380a84e0 msgr2=0x7fdd380a88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:15.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.478+0000 7fdd3ea00640 1 -- 172.21.15.131:0/2396600757 shutdown_connections 2024-04-12T19:39:15.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.478+0000 7fdd3ea00640 1 -- 172.21.15.131:0/2396600757 wait complete. 2024-04-12T19:39:15.520 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-12T19:39:15.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.700+0000 7f6bfde00640 1 Processor -- start 2024-04-12T19:39:15.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.700+0000 7f6bfde00640 1 -- start start 2024-04-12T19:39:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.702+0000 7f6bfde00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6bf8151840 0x7f6bf80c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.702+0000 7f6bfde00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bf80bf4f0 0x7f6bf815bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.702+0000 7f6bfde00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bf8151c20 con 0x7f6bf80c3000 2024-04-12T19:39:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.702+0000 7f6bfde00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6bf8073b40 con 0x7f6bf8151840 2024-04-12T19:39:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.702+0000 7f6bfde00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf806ed10 con 0x7f6bf80bf4f0 2024-04-12T19:39:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.702+0000 7f6bee000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6bf80c3000 0x7f6bf80bede0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:37106/0 (socket says 172.21.15.131:37106) 2024-04-12T19:39:15.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.702+0000 7f6bee000640 1 -- 172.21.15.131:0/3660330213 learned_addr learned my addr 172.21.15.131:0/3660330213 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:15.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.702+0000 7f6bf6a00640 1 --2- 172.21.15.131:0/3660330213 >> v2:172.21.15.171:3300/0 conn(0x7f6bf8151840 0x7f6bf80c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:15.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf7400640 1 --2- 172.21.15.131:0/3660330213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bf80bf4f0 0x7f6bf815bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:15.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 8648964 0 0) 0x7f6bf8151c20 con 0x7f6bf80c3000 2024-04-12T19:39:15.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bdc003520 con 0x7f6bf80c3000 2024-04-12T19:39:15.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4238939875 0 0) 0x7f6bdc003520 con 0x7f6bf80c3000 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bf80bf4f0 msgr2=0x7f6bf815bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 --2- 172.21.15.131:0/3660330213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bf80bf4f0 0x7f6bf815bbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 >> v2:172.21.15.171:3300/0 conn(0x7f6bf8151840 msgr2=0x7f6bf80c2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 --2- 172.21.15.131:0/3660330213 >> v2:172.21.15.171:3300/0 conn(0x7f6bf8151840 0x7f6bf80c2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf8151ee0 con 0x7f6bf80c3000 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f6be0001670 con 0x7f6bf80c3000 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 >> v1:172.21.15.131:6789/0 conn(0x7f6bf80c3000 legacy=0x7f6bf80bede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 --2- 172.21.15.131:0/3660330213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bdc0039b0 0x7f6bdc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 --2- 172.21.15.131:0/3660330213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bdc004800 0x7f6bdc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 --2- 172.21.15.131:0/3660330213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bf80bf4f0 0x7f6bdc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf8073b40 con 0x7f6bdc004800 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf806ed10 con 0x7f6bdc0039b0 2024-04-12T19:39:15.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6bdc00ba40 con 0x7f6bf80bf4f0 2024-04-12T19:39:15.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.703+0000 7f6bee000640 1 --2- 172.21.15.131:0/3660330213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bdc004800 0x7f6bdc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:15.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.704+0000 7f6bf7400640 1 --2- 172.21.15.131:0/3660330213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bf80bf4f0 0x7f6bdc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:15.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.704+0000 7f6bee000640 1 -- 172.21.15.131:0/3660330213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bf80bf4f0 msgr2=0x7f6bdc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:15.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.704+0000 7f6bee000640 1 --2- 172.21.15.131:0/3660330213 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bf80bf4f0 0x7f6bdc0051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:15.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.704+0000 7f6bf6a00640 1 --2- 172.21.15.131:0/3660330213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bdc0039b0 0x7f6bdc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:15.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.704+0000 7f6bee000640 1 -- 172.21.15.131:0/3660330213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bdc0039b0 msgr2=0x7f6bdc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:15.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.704+0000 7f6bee000640 1 --2- 172.21.15.131:0/3660330213 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bdc0039b0 0x7f6bdc003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:15.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.704+0000 7f6bee000640 1 -- 172.21.15.131:0/3660330213 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bdc003520 con 0x7f6bdc004800 2024-04-12T19:39:15.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.705+0000 7f6bee000640 1 --2- 172.21.15.131:0/3660330213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bdc004800 0x7f6bdc004c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6be000c210 tx=0x7f6bdc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99e545274eab9d52 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:15.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.705+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be0007d50 con 0x7f6bdc004800 2024-04-12T19:39:15.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.705+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6be0030070 con 0x7f6bdc004800 2024-04-12T19:39:15.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.705+0000 7f6bf6000640 1 -- 172.21.15.131:0/3660330213 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6be002cd80 con 0x7f6bdc004800 2024-04-12T19:39:15.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.706+0000 7f6bfde00640 1 -- 172.21.15.131:0/3660330213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bdc004800 msgr2=0x7f6bdc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:15.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.706+0000 7f6bfde00640 1 --2- 172.21.15.131:0/3660330213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bdc004800 0x7f6bdc004c80 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f6be000c210 tx=0x7f6bdc005830 comp rx=0 tx=0).stop 2024-04-12T19:39:15.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.706+0000 7f6bf7400640 1 -- 172.21.15.131:0/3660330213 reap_dead start 2024-04-12T19:39:15.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.706+0000 7f6bfde00640 1 -- 172.21.15.131:0/3660330213 shutdown_connections 2024-04-12T19:39:15.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.706+0000 7f6bfde00640 1 -- 172.21.15.131:0/3660330213 >> 172.21.15.131:0/3660330213 conn(0x7f6bf806be00 msgr2=0x7f6bf806c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:15.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.706+0000 7f6bfde00640 1 -- 172.21.15.131:0/3660330213 shutdown_connections 2024-04-12T19:39:15.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.706+0000 7f6bfde00640 1 -- 172.21.15.131:0/3660330213 wait complete. 2024-04-12T19:39:15.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.708+0000 7f6bfde00640 1 Processor -- start 2024-04-12T19:39:15.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.708+0000 7f6bfde00640 1 -- start start 2024-04-12T19:39:15.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.709+0000 7f6bfde00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bdc004800 0x7f6bf8154ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:15.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.709+0000 7f6bfde00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bf80ba410 0x7f6bf80b8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:15.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.709+0000 7f6bfde00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bf80b67a0 0x7f6bf80b6c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:15.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.709+0000 7f6bfde00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf806f6e0 con 0x7f6bf80b67a0 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.709+0000 7f6bfde00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6bf80be800 con 0x7f6bf80ba410 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.709+0000 7f6bfde00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6bf81521c0 con 0x7f6bdc004800 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.709+0000 7f6bf7400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bf80b67a0 0x7f6bf80b6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.709+0000 7f6bf7400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bf80b67a0 0x7f6bf80b6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40038/0 (socket says 172.21.15.131:40038) 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.709+0000 7f6bf7400640 1 -- 172.21.15.131:0/3532272053 learned_addr learned my addr 172.21.15.131:0/3532272053 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6bf6a00640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bdc004800 0x7f6bf8154ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6bee000640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bf80ba410 0x7f6bf80b8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6bf7400640 1 -- 172.21.15.131:0/3532272053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bdc004800 msgr2=0x7f6bf8154ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6bf7400640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bdc004800 0x7f6bf8154ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6bf7400640 1 -- 172.21.15.131:0/3532272053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bf80ba410 msgr2=0x7f6bf80b8160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6bf7400640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bf80ba410 0x7f6bf80b8160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6bf7400640 1 -- 172.21.15.131:0/3532272053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bf8155020 con 0x7f6bf80b67a0 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6bf6a00640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bdc004800 0x7f6bf8154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:15.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6bf7400640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bf80b67a0 0x7f6bf80b6c30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80bf900 tx=0x7f6bf000f4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:15.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6befe00640 1 -- 172.21.15.131:0/3532272053 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf001c070 con 0x7f6bf80b67a0 2024-04-12T19:39:15.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6befe00640 1 -- 172.21.15.131:0/3532272053 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bf0017400 con 0x7f6bf80b67a0 2024-04-12T19:39:15.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6bfde00640 1 -- 172.21.15.131:0/3532272053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bf80b7170 con 0x7f6bf80b67a0 2024-04-12T19:39:15.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.710+0000 7f6befe00640 1 -- 172.21.15.131:0/3532272053 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf00177f0 con 0x7f6bf80b67a0 2024-04-12T19:39:15.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.711+0000 7f6bfde00640 1 -- 172.21.15.131:0/3532272053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bf80b9010 con 0x7f6bf80b67a0 2024-04-12T19:39:15.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.712+0000 7f6bfde00640 1 -- 172.21.15.131:0/3532272053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bf804fd50 con 0x7f6bf80b67a0 2024-04-12T19:39:15.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.713+0000 7f6befe00640 1 -- 172.21.15.131:0/3532272053 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6bf0005d10 con 0x7f6bf80b67a0 2024-04-12T19:39:15.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.713+0000 7f6befe00640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6bd406c920 0x7f6bd406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:15.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.714+0000 7f6befe00640 1 -- 172.21.15.131:0/3532272053 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f6bf008bee0 con 0x7f6bf80b67a0 2024-04-12T19:39:15.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.714+0000 7f6bf6a00640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6bd406c920 0x7f6bd406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:15.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.715+0000 7f6bf6a00640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6bd406c920 0x7f6bd406ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009a60 tx=0x7f6be8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:15.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.718+0000 7f6befe00640 1 -- 172.21.15.131:0/3532272053 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6bf0012070 con 0x7f6bf80b67a0 2024-04-12T19:39:15.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:15.954+0000 7f6bfde00640 1 -- 172.21.15.131:0/3532272053 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f6bf8071770 con 0x7f6bf80b67a0 2024-04-12T19:39:16.479 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.478+0000 7f6befe00640 1 -- 172.21.15.131:0/3532272053 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) ==== 137+0+0 (secure 0 0 0) 0x7f6bf005a060 con 0x7f6bf80b67a0 2024-04-12T19:39:16.480 INFO:teuthology.orchestra.run.smithi131.stderr:added data pool 4 to fsmap 2024-04-12T19:39:16.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.482+0000 7f6bfde00640 1 -- 172.21.15.131:0/3532272053 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6bd406c920 msgr2=0x7f6bd406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:16.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.482+0000 7f6bfde00640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6bd406c920 0x7f6bd406ede0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6be8009a60 tx=0x7f6be8008040 comp rx=0 tx=0).stop 2024-04-12T19:39:16.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.482+0000 7f6bfde00640 1 -- 172.21.15.131:0/3532272053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bf80b67a0 msgr2=0x7f6bf80b6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:16.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.482+0000 7f6bfde00640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bf80b67a0 0x7f6bf80b6c30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6bf80bf900 tx=0x7f6bf000f4a0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.482+0000 7f6bfde00640 1 -- 172.21.15.131:0/3532272053 shutdown_connections 2024-04-12T19:39:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.482+0000 7f6bfde00640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6bd406c920 0x7f6bd406ede0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.482+0000 7f6bfde00640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6bf80ba410 0x7f6bf80b8160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.482+0000 7f6bfde00640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6bf80b67a0 0x7f6bf80b6c30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.482+0000 7f6bfde00640 1 --2- 172.21.15.131:0/3532272053 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6bdc004800 0x7f6bf8154ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.482+0000 7f6bfde00640 1 -- 172.21.15.131:0/3532272053 >> 172.21.15.131:0/3532272053 conn(0x7f6bf806be00 msgr2=0x7f6bf8071f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.482+0000 7f6bfde00640 1 -- 172.21.15.131:0/3532272053 shutdown_connections 2024-04-12T19:39:16.484 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.483+0000 7f6bfde00640 1 -- 172.21.15.131:0/3532272053 wait complete. 2024-04-12T19:39:16.507 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-12T19:39:16.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.697+0000 7f7e10200640 1 Processor -- start 2024-04-12T19:39:16.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.697+0000 7f7e10200640 1 -- start start 2024-04-12T19:39:16.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.698+0000 7f7e10200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7e080a8500 0x7f7e081526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:16.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.698+0000 7f7e10200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e080a4e60 0x7f7e08159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:16.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.698+0000 7f7e10200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e081531a0 con 0x7f7e080a8120 2024-04-12T19:39:16.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.698+0000 7f7e10200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7e08153680 con 0x7f7e080a8500 2024-04-12T19:39:16.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.698+0000 7f7e10200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7e08071df0 con 0x7f7e080a4e60 2024-04-12T19:39:16.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.699+0000 7f7e0d800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f7e080a8120 0x7f7e080728d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:37120/0 (socket says 172.21.15.131:37120) 2024-04-12T19:39:16.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.699+0000 7f7e0d800640 1 -- 172.21.15.131:0/692942252 learned_addr learned my addr 172.21.15.131:0/692942252 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.699+0000 7f7e0e200640 1 --2- 172.21.15.131:0/692942252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e080a4e60 0x7f7e08159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.699+0000 7f7e0ce00640 1 --2- 172.21.15.131:0/692942252 >> v2:172.21.15.171:3300/0 conn(0x7f7e080a8500 0x7f7e081526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.699+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1590949575 0 0) 0x7f7e081531a0 con 0x7f7e080a8120 2024-04-12T19:39:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.699+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7df0003520 con 0x7f7e080a8120 2024-04-12T19:39:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2003145058 0 0) 0x7f7df0003520 con 0x7f7e080a8120 2024-04-12T19:39:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e080a4e60 msgr2=0x7f7e08159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:16.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 --2- 172.21.15.131:0/692942252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e080a4e60 0x7f7e08159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 >> v2:172.21.15.171:3300/0 conn(0x7f7e080a8500 msgr2=0x7f7e081526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:16.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 --2- 172.21.15.131:0/692942252 >> v2:172.21.15.171:3300/0 conn(0x7f7e080a8500 0x7f7e081526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e080720d0 con 0x7f7e080a8120 2024-04-12T19:39:16.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f7dfc001670 con 0x7f7e080a8120 2024-04-12T19:39:16.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 >> v1:172.21.15.131:6789/0 conn(0x7f7e080a8120 legacy=0x7f7e080728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:16.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 --2- 172.21.15.131:0/692942252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7df00039b0 0x7f7df0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:16.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 --2- 172.21.15.131:0/692942252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7df0004800 0x7f7df0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:16.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 --2- 172.21.15.131:0/692942252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e080a4e60 0x7f7df00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:16.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7e08153680 con 0x7f7df0004800 2024-04-12T19:39:16.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7e08071df0 con 0x7f7df00039b0 2024-04-12T19:39:16.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7df000b9c0 con 0x7f7e080a4e60 2024-04-12T19:39:16.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e0ce00640 1 --2- 172.21.15.131:0/692942252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7df0004800 0x7f7df0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:16.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e0d800640 1 --2- 172.21.15.131:0/692942252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7df00039b0 0x7f7df0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:16.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e0ce00640 1 -- 172.21.15.131:0/692942252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e080a4e60 msgr2=0x7f7df00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:16.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e0ce00640 1 --2- 172.21.15.131:0/692942252 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7e080a4e60 0x7f7df00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e0ce00640 1 -- 172.21.15.131:0/692942252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7df00039b0 msgr2=0x7f7df0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:16.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.700+0000 7f7e0ce00640 1 --2- 172.21.15.131:0/692942252 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7df00039b0 0x7f7df0003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.701+0000 7f7e0ce00640 1 -- 172.21.15.131:0/692942252 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7df0003520 con 0x7f7df0004800 2024-04-12T19:39:16.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.702+0000 7f7e0ce00640 1 --2- 172.21.15.131:0/692942252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7df0004800 0x7f7df0004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009a90 tx=0x7f7df0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6673e2efeaa21ab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:16.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.702+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4039070 con 0x7f7df0004800 2024-04-12T19:39:16.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.702+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df402c6b0 con 0x7f7df0004800 2024-04-12T19:39:16.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.702+0000 7f7e07e00640 1 -- 172.21.15.131:0/692942252 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4009690 con 0x7f7df0004800 2024-04-12T19:39:16.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.702+0000 7f7e10200640 1 -- 172.21.15.131:0/692942252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7df0004800 msgr2=0x7f7df0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:16.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.702+0000 7f7e10200640 1 --2- 172.21.15.131:0/692942252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7df0004800 0x7f7df0004c80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7df4009a90 tx=0x7f7df0005830 comp rx=0 tx=0).stop 2024-04-12T19:39:16.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.702+0000 7f7e0e200640 1 -- 172.21.15.131:0/692942252 reap_dead start 2024-04-12T19:39:16.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.702+0000 7f7e10200640 1 -- 172.21.15.131:0/692942252 shutdown_connections 2024-04-12T19:39:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.702+0000 7f7e10200640 1 -- 172.21.15.131:0/692942252 >> 172.21.15.131:0/692942252 conn(0x7f7e080c2590 msgr2=0x7f7e080c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.703+0000 7f7e10200640 1 -- 172.21.15.131:0/692942252 shutdown_connections 2024-04-12T19:39:16.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.703+0000 7f7e10200640 1 -- 172.21.15.131:0/692942252 wait complete. 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.704+0000 7f7e10200640 1 Processor -- start 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.704+0000 7f7e10200640 1 -- start start 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.705+0000 7f7e10200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7df0004800 0x7f7e0814cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.705+0000 7f7e10200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e0814c5a0 0x7f7e081ea3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.705+0000 7f7e10200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e0814b870 0x7f7e08147d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.705+0000 7f7e10200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0806f520 con 0x7f7e0814c5a0 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.705+0000 7f7e10200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0806d970 con 0x7f7e0814b870 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.705+0000 7f7e10200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7e0806f6a0 con 0x7f7df0004800 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.705+0000 7f7e0ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e0814c5a0 0x7f7e081ea3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.705+0000 7f7e0ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e0814c5a0 0x7f7e081ea3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40058/0 (socket says 172.21.15.131:40058) 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.705+0000 7f7e0ce00640 1 -- 172.21.15.131:0/3784172681 learned_addr learned my addr 172.21.15.131:0/3784172681 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.706+0000 7f7e0d800640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7df0004800 0x7f7e0814cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:16.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.706+0000 7f7e0ce00640 1 -- 172.21.15.131:0/3784172681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7df0004800 msgr2=0x7f7e0814cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.706+0000 7f7e0ce00640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7df0004800 0x7f7e0814cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.706+0000 7f7e0ce00640 1 -- 172.21.15.131:0/3784172681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e0814b870 msgr2=0x7f7e08147d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.706+0000 7f7e0e200640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e0814b870 0x7f7e08147d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.706+0000 7f7e0ce00640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e0814b870 0x7f7e08147d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.706+0000 7f7e0ce00640 1 -- 172.21.15.131:0/3784172681 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e08149a50 con 0x7f7e0814c5a0 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.706+0000 7f7e0ce00640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e0814c5a0 0x7f7e081ea3a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7df4000c00 tx=0x7f7df4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.706+0000 7f7e05600640 1 -- 172.21.15.131:0/3784172681 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4039050 con 0x7f7e0814c5a0 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.706+0000 7f7e05600640 1 -- 172.21.15.131:0/3784172681 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7df4045070 con 0x7f7e0814c5a0 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.706+0000 7f7e05600640 1 -- 172.21.15.131:0/3784172681 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7df4003a50 con 0x7f7e0814c5a0 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.706+0000 7f7e10200640 1 -- 172.21.15.131:0/3784172681 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e08149d10 con 0x7f7e0814c5a0 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.707+0000 7f7e10200640 1 -- 172.21.15.131:0/3784172681 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e08148a30 con 0x7f7e0814c5a0 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.708+0000 7f7e10200640 1 -- 172.21.15.131:0/3784172681 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e08068a00 con 0x7f7e0814c5a0 2024-04-12T19:39:16.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.709+0000 7f7e05600640 1 -- 172.21.15.131:0/3784172681 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7df4003bf0 con 0x7f7e0814c5a0 2024-04-12T19:39:16.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.709+0000 7f7e05600640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7de806c920 0x7f7de806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:16.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.710+0000 7f7e05600640 1 -- 172.21.15.131:0/3784172681 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7df40ad990 con 0x7f7e0814c5a0 2024-04-12T19:39:16.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.710+0000 7f7e0d800640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7de806c920 0x7f7de806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:16.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.710+0000 7f7e0d800640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7de806c920 0x7f7de806ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc001eb0 tx=0x7f7dfc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:16.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.714+0000 7f7e05600640 1 -- 172.21.15.131:0/3784172681 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7e08068a00 con 0x7f7e0814c5a0 2024-04-12T19:39:16.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.954+0000 7f7e10200640 1 -- 172.21.15.131:0/3784172681 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e080bffa0 con 0x7f7e0814c5a0 2024-04-12T19:39:16.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.955+0000 7f7e05600640 1 -- 172.21.15.131:0/3784172681 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5186 (secure 0 0 0) 0x7f7e080bffa0 con 0x7f7e0814c5a0 2024-04-12T19:39:16.957 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:16.957 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3941197710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3941197710},{"type":"v1","addr":"172.21.15.131:6836","nonce":3941197710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2898590457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2898590457},{"type":"v1","addr":"172.21.15.131:6837","nonce":2898590457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/373698102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":373698102},{"type":"v1","addr":"172.21.15.171:6835","nonce":373698102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T19:39:10.876760+0000","modified":"2024-04-12T19:39:15.957260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6834/1013642393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1013642393},{"type":"v1","addr":"172.21.15.171:6834","nonce":1013642393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4257,"qdb_cluster":[4257]},"id":1}]} 2024-04-12T19:39:16.957 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 6 2024-04-12T19:39:16.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.958+0000 7f7e10200640 1 -- 172.21.15.131:0/3784172681 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7de806c920 msgr2=0x7f7de806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.958+0000 7f7e10200640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7de806c920 0x7f7de806ede0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc001eb0 tx=0x7f7dfc009040 comp rx=0 tx=0).stop 2024-04-12T19:39:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.958+0000 7f7e10200640 1 -- 172.21.15.131:0/3784172681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e0814c5a0 msgr2=0x7f7e081ea3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.958+0000 7f7e10200640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e0814c5a0 0x7f7e081ea3a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7df4000c00 tx=0x7f7df4004730 comp rx=0 tx=0).stop 2024-04-12T19:39:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.958+0000 7f7e10200640 1 -- 172.21.15.131:0/3784172681 shutdown_connections 2024-04-12T19:39:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.958+0000 7f7e10200640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7de806c920 0x7f7de806ede0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.958+0000 7f7e10200640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7e0814b870 0x7f7e08147d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.958+0000 7f7e10200640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e0814c5a0 0x7f7e081ea3a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.958+0000 7f7e10200640 1 --2- 172.21.15.131:0/3784172681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7df0004800 0x7f7e0814cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.958+0000 7f7e10200640 1 -- 172.21.15.131:0/3784172681 >> 172.21.15.131:0/3784172681 conn(0x7f7e080c2590 msgr2=0x7f7e080727d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:16.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.958+0000 7f7e10200640 1 -- 172.21.15.131:0/3784172681 shutdown_connections 2024-04-12T19:39:16.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:16.958+0000 7f7e10200640 1 -- 172.21.15.131:0/3784172681 wait complete. 2024-04-12T19:39:16.979 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:17.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.185+0000 7fcfc3800640 1 Processor -- start 2024-04-12T19:39:17.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.185+0000 7fcfc3800640 1 -- start start 2024-04-12T19:39:17.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.186+0000 7fcfc3800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fcfbc0a8120 0x7fcfbc0728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.186+0000 7fcfc3800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfbc1531a0 con 0x7fcfbc0a4e60 2024-04-12T19:39:17.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.186+0000 7fcfc3800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfbc071df0 con 0x7fcfbc0a8500 2024-04-12T19:39:17.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.186+0000 7fcfc3800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fcfbc153680 con 0x7fcfbc0a8120 2024-04-12T19:39:17.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.187+0000 7fcfc1800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fcfbc0a4e60 0x7fcfbc159a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:37122/0 (socket says 172.21.15.131:37122) 2024-04-12T19:39:17.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.187+0000 7fcfc1800640 1 -- 172.21.15.131:0/158657159 learned_addr learned my addr 172.21.15.131:0/158657159 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:17.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.187+0000 7fcfc0e00640 1 --2- 172.21.15.131:0/158657159 >> v2:172.21.15.171:3300/0 conn(0x7fcfbc0a8120 0x7fcfbc0728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.187+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743862486 0 0) 0x7fcfbc1531a0 con 0x7fcfbc0a4e60 2024-04-12T19:39:17.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.187+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfa0003520 con 0x7fcfbc0a4e60 2024-04-12T19:39:17.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 366225892 0 0) 0x7fcfa0003520 con 0x7fcfbc0a4e60 2024-04-12T19:39:17.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 >> v2:172.21.15.171:3300/0 conn(0x7fcfbc0a8120 msgr2=0x7fcfbc0728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:17.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 --2- 172.21.15.131:0/158657159 >> v2:172.21.15.171:3300/0 conn(0x7fcfbc0a8120 0x7fcfbc0728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 >> v1:172.21.15.171:6789/0 conn(0x7fcfbc0a8500 legacy=0x7fcfbc1526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc0720d0 con 0x7fcfbc0a4e60 2024-04-12T19:39:17.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7fcfb4001670 con 0x7fcfbc0a4e60 2024-04-12T19:39:17.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 >> v1:172.21.15.131:6789/0 conn(0x7fcfbc0a4e60 legacy=0x7fcfbc159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 --2- 172.21.15.131:0/158657159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfa00039b0 0x7fcfa0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 --2- 172.21.15.131:0/158657159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfa0004800 0x7fcfa0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 --2- 172.21.15.131:0/158657159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfa00051c0 0x7fcfa000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc153680 con 0x7fcfa00051c0 2024-04-12T19:39:17.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa000c060 con 0x7fcfa00039b0 2024-04-12T19:39:17.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa000c260 con 0x7fcfa0004800 2024-04-12T19:39:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfc1800640 1 --2- 172.21.15.131:0/158657159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfa00051c0 0x7fcfa000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfbbe00640 1 --2- 172.21.15.131:0/158657159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfa0004800 0x7fcfa0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.188+0000 7fcfc0e00640 1 --2- 172.21.15.131:0/158657159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfa00039b0 0x7fcfa0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.189+0000 7fcfc1800640 1 -- 172.21.15.131:0/158657159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfa0004800 msgr2=0x7fcfa0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.189+0000 7fcfc1800640 1 --2- 172.21.15.131:0/158657159 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfa0004800 0x7fcfa0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.189+0000 7fcfc1800640 1 -- 172.21.15.131:0/158657159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfa00039b0 msgr2=0x7fcfa0003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.189+0000 7fcfc1800640 1 --2- 172.21.15.131:0/158657159 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfa00039b0 0x7fcfa0003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.189+0000 7fcfc1800640 1 -- 172.21.15.131:0/158657159 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa0003520 con 0x7fcfa00051c0 2024-04-12T19:39:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.190+0000 7fcfc1800640 1 -- 172.21.15.131:0/158657159 reap_dead start 2024-04-12T19:39:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.190+0000 7fcfc1800640 1 --2- 172.21.15.131:0/158657159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfa00051c0 0x7fcfa000b9c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400c210 tx=0x7fcfa0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467b94281c8a9a75 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:17.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.190+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4007d10 con 0x7fcfa00051c0 2024-04-12T19:39:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.190+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfb4030070 con 0x7fcfa00051c0 2024-04-12T19:39:17.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.190+0000 7fcfbb400640 1 -- 172.21.15.131:0/158657159 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4005cf0 con 0x7fcfa00051c0 2024-04-12T19:39:17.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.191+0000 7fcfc3800640 1 -- 172.21.15.131:0/158657159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfa00051c0 msgr2=0x7fcfa000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.191+0000 7fcfc3800640 1 --2- 172.21.15.131:0/158657159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfa00051c0 0x7fcfa000b9c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400c210 tx=0x7fcfa0005830 comp rx=0 tx=0).stop 2024-04-12T19:39:17.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.191+0000 7fcfc3800640 1 -- 172.21.15.131:0/158657159 shutdown_connections 2024-04-12T19:39:17.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.191+0000 7fcfc3800640 1 --2- 172.21.15.131:0/158657159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfa00051c0 0x7fcfa000b9c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.191+0000 7fcfc3800640 1 -- 172.21.15.131:0/158657159 >> 172.21.15.131:0/158657159 conn(0x7fcfbc0c2590 msgr2=0x7fcfbc0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:17.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.191+0000 7fcfc3800640 1 -- 172.21.15.131:0/158657159 shutdown_connections 2024-04-12T19:39:17.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.191+0000 7fcfc3800640 1 -- 172.21.15.131:0/158657159 wait complete. 2024-04-12T19:39:17.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.193+0000 7fcfc3800640 1 Processor -- start 2024-04-12T19:39:17.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.193+0000 7fcfc3800640 1 -- start start 2024-04-12T19:39:17.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.194+0000 7fcfc3800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfa00051c0 0x7fcfbc14f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.194+0000 7fcfc3800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfbc13f8e0 0x7fcfbc14c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.194+0000 7fcfc3800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfbc145f40 0x7fcfbc14c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.194+0000 7fcfc3800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc06f520 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.194+0000 7fcfc3800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcfbc06d970 con 0x7fcfbc145f40 2024-04-12T19:39:17.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.194+0000 7fcfc3800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcfbc06f6a0 con 0x7fcfa00051c0 2024-04-12T19:39:17.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.195+0000 7fcfbbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfbc13f8e0 0x7fcfbc14c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.195+0000 7fcfbbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfbc13f8e0 0x7fcfbc14c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40076/0 (socket says 172.21.15.131:40076) 2024-04-12T19:39:17.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.195+0000 7fcfbbe00640 1 -- 172.21.15.131:0/1979710259 learned_addr learned my addr 172.21.15.131:0/1979710259 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:17.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.195+0000 7fcfc0e00640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfa00051c0 0x7fcfbc14f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.195+0000 7fcfc1800640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfbc145f40 0x7fcfbc14c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.195+0000 7fcfbbe00640 1 -- 172.21.15.131:0/1979710259 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfa00051c0 msgr2=0x7fcfbc14f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.195+0000 7fcfbbe00640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfa00051c0 0x7fcfbc14f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.195+0000 7fcfbbe00640 1 -- 172.21.15.131:0/1979710259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfbc145f40 msgr2=0x7fcfbc14c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.195+0000 7fcfbbe00640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfbc145f40 0x7fcfbc14c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.195+0000 7fcfbbe00640 1 -- 172.21.15.131:0/1979710259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfbc14d010 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.195+0000 7fcfbbe00640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfbc13f8e0 0x7fcfbc14c170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400e410 tx=0x7fcfa400e8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:17.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.196+0000 7fcfb8c00640 1 -- 172.21.15.131:0/1979710259 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4019070 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.196+0000 7fcfb8c00640 1 -- 172.21.15.131:0/1979710259 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa40052e0 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.196+0000 7fcfb8c00640 1 -- 172.21.15.131:0/1979710259 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa4003810 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.196+0000 7fcfc3800640 1 -- 172.21.15.131:0/1979710259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfbc14d2f0 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.196+0000 7fcfc3800640 1 -- 172.21.15.131:0/1979710259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfbc145320 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.197+0000 7fcfc3800640 1 -- 172.21.15.131:0/1979710259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfbc1531a0 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.198+0000 7fcfb8c00640 1 -- 172.21.15.131:0/1979710259 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcfa401c070 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.199+0000 7fcfb8c00640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcf9806c920 0x7fcf9806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.199+0000 7fcfb8c00640 1 -- 172.21.15.131:0/1979710259 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fcfa408b460 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.199+0000 7fcfc0e00640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcf9806c920 0x7fcf9806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.200+0000 7fcfc0e00640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcf9806c920 0x7fcf9806ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009fd0 tx=0x7fcfac00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:17.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.204+0000 7fcfb8c00640 1 -- 172.21.15.131:0/1979710259 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcfbc1531a0 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.404+0000 7fcfc3800640 1 -- 172.21.15.131:0/1979710259 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcfbc0bffa0 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.407+0000 7fcfb8c00640 1 -- 172.21.15.131:0/1979710259 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18515 (secure 0 0 0) 0x7fcfbc0bffa0 con 0x7fcfbc13f8e0 2024-04-12T19:39:17.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:17.409 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":25,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:15.956950+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:17.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.410+0000 7fcfc3800640 1 -- 172.21.15.131:0/1979710259 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcf9806c920 msgr2=0x7fcf9806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.410+0000 7fcfc3800640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcf9806c920 0x7fcf9806ede0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcfac009fd0 tx=0x7fcfac00b040 comp rx=0 tx=0).stop 2024-04-12T19:39:17.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.410+0000 7fcfc3800640 1 -- 172.21.15.131:0/1979710259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfbc13f8e0 msgr2=0x7fcfbc14c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.410+0000 7fcfc3800640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfbc13f8e0 0x7fcfbc14c170 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fcfa400e410 tx=0x7fcfa400e8d0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.410+0000 7fcfc3800640 1 -- 172.21.15.131:0/1979710259 shutdown_connections 2024-04-12T19:39:17.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.410+0000 7fcfc3800640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcf9806c920 0x7fcf9806ede0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.410+0000 7fcfc3800640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfbc145f40 0x7fcfbc14c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.410+0000 7fcfc3800640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfbc13f8e0 0x7fcfbc14c170 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.410+0000 7fcfc3800640 1 --2- 172.21.15.131:0/1979710259 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfa00051c0 0x7fcfbc14f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.410+0000 7fcfc3800640 1 -- 172.21.15.131:0/1979710259 >> 172.21.15.131:0/1979710259 conn(0x7fcfbc0c2590 msgr2=0x7fcfbc0a6040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:17.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.410+0000 7fcfc3800640 1 -- 172.21.15.131:0/1979710259 shutdown_connections 2024-04-12T19:39:17.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.410+0000 7fcfc3800640 1 -- 172.21.15.131:0/1979710259 wait complete. 2024-04-12T19:39:17.429 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:17.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.637+0000 7f7285c00640 1 Processor -- start 2024-04-12T19:39:17.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.637+0000 7f7285c00640 1 -- start start 2024-04-12T19:39:17.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.638+0000 7f7285c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7280073d00 0x7f7280147dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.638+0000 7f7285c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f728006f770 con 0x7f72800be310 2024-04-12T19:39:17.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.638+0000 7f7285c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72800716c0 con 0x7f7280148310 2024-04-12T19:39:17.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.638+0000 7f7285c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f728006f520 con 0x7f7280073d00 2024-04-12T19:39:17.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727ea00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f72800be310 0x7f72800735f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:37126/0 (socket says 172.21.15.131:37126) 2024-04-12T19:39:17.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727ea00640 1 -- 172.21.15.131:0/300428938 learned_addr learned my addr 172.21.15.131:0/300428938 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:17.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3723836363 0 0) 0x7f728006f770 con 0x7f72800be310 2024-04-12T19:39:17.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7264003520 con 0x7f72800be310 2024-04-12T19:39:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727e000640 1 --2- 172.21.15.131:0/300428938 >> v2:172.21.15.171:3300/0 conn(0x7f7280073d00 0x7f7280147dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 843643356 0 0) 0x7f7264003520 con 0x7f72800be310 2024-04-12T19:39:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 >> v2:172.21.15.171:3300/0 conn(0x7f7280073d00 msgr2=0x7f7280147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727d600640 1 --2- 172.21.15.131:0/300428938 >> v2:172.21.15.171:3300/0 conn(0x7f7280073d00 0x7f7280147dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 >> v1:172.21.15.171:6789/0 conn(0x7f7280148310 legacy=0x7f7280158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72800719a0 con 0x7f72800be310 2024-04-12T19:39:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f7270001670 con 0x7f72800be310 2024-04-12T19:39:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 >> v1:172.21.15.131:6789/0 conn(0x7f72800be310 legacy=0x7f72800735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727d600640 1 --2- 172.21.15.131:0/300428938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72640039b0 0x7f7264003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.639+0000 7f727d600640 1 --2- 172.21.15.131:0/300428938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7264004800 0x7f7264004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.640+0000 7f727d600640 1 --2- 172.21.15.131:0/300428938 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72640053c0 0x7f726400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.640+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f728006f520 con 0x7f7264004800 2024-04-12T19:39:17.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.640+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f726400c260 con 0x7f72640039b0 2024-04-12T19:39:17.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.640+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f726400c460 con 0x7f72640053c0 2024-04-12T19:39:17.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.640+0000 7f727e000640 1 --2- 172.21.15.131:0/300428938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7264004800 0x7f7264004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.640+0000 7f727ea00640 1 --2- 172.21.15.131:0/300428938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72640039b0 0x7f7264003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.640+0000 7f727e000640 1 -- 172.21.15.131:0/300428938 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72640053c0 msgr2=0x7f726400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:17.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.640+0000 7f727e000640 1 --2- 172.21.15.131:0/300428938 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72640053c0 0x7f726400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.640+0000 7f727e000640 1 -- 172.21.15.131:0/300428938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72640039b0 msgr2=0x7f7264003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:17.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.640+0000 7f727e000640 1 --2- 172.21.15.131:0/300428938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72640039b0 0x7f7264003db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.640+0000 7f727e000640 1 -- 172.21.15.131:0/300428938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7264003520 con 0x7f7264004800 2024-04-12T19:39:17.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.640+0000 7f727f400640 1 -- 172.21.15.131:0/300428938 reap_dead start 2024-04-12T19:39:17.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.641+0000 7f727e000640 1 --2- 172.21.15.131:0/300428938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7264004800 0x7f7264004c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f726c00a9a0 tx=0x7f7264005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=150a795c7121c179 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:17.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.641+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c034070 con 0x7f7264004800 2024-04-12T19:39:17.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.642+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f726c030400 con 0x7f7264004800 2024-04-12T19:39:17.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.642+0000 7f727d600640 1 -- 172.21.15.131:0/300428938 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c00a570 con 0x7f7264004800 2024-04-12T19:39:17.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.642+0000 7f7285c00640 1 -- 172.21.15.131:0/300428938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7264004800 msgr2=0x7f7264004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.642+0000 7f7285c00640 1 --2- 172.21.15.131:0/300428938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7264004800 0x7f7264004c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f726c00a9a0 tx=0x7f7264005830 comp rx=0 tx=0).stop 2024-04-12T19:39:17.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.642+0000 7f7285c00640 1 -- 172.21.15.131:0/300428938 shutdown_connections 2024-04-12T19:39:17.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.642+0000 7f7285c00640 1 --2- 172.21.15.131:0/300428938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7264004800 0x7f7264004c80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.642+0000 7f7285c00640 1 -- 172.21.15.131:0/300428938 >> 172.21.15.131:0/300428938 conn(0x7f72800c2590 msgr2=0x7f72800c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:17.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.642+0000 7f7285c00640 1 -- 172.21.15.131:0/300428938 shutdown_connections 2024-04-12T19:39:17.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.642+0000 7f7285c00640 1 -- 172.21.15.131:0/300428938 wait complete. 2024-04-12T19:39:17.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.644+0000 7f7285c00640 1 Processor -- start 2024-04-12T19:39:17.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.644+0000 7f7285c00640 1 -- start start 2024-04-12T19:39:17.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.645+0000 7f7285c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7264004800 0x7f728014c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.645+0000 7f7285c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f728013e7e0 0x7f72801434e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.645+0000 7f7285c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72801e42b0 0x7f72801e78a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.645+0000 7f7285c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f72801487a0 con 0x7f728013e7e0 2024-04-12T19:39:17.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.645+0000 7f7285c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f728006d5a0 con 0x7f7264004800 2024-04-12T19:39:17.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.645+0000 7f7285c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f728006fa30 con 0x7f72801e42b0 2024-04-12T19:39:17.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.645+0000 7f727e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f728013e7e0 0x7f72801434e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.645+0000 7f727e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f728013e7e0 0x7f72801434e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40098/0 (socket says 172.21.15.131:40098) 2024-04-12T19:39:17.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.645+0000 7f727e000640 1 -- 172.21.15.131:0/1489824861 learned_addr learned my addr 172.21.15.131:0/1489824861 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f727f400640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72801e42b0 0x7f72801e78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f727ea00640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7264004800 0x7f728014c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f727e000640 1 -- 172.21.15.131:0/1489824861 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72801e42b0 msgr2=0x7f72801e78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f727e000640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72801e42b0 0x7f72801e78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f727e000640 1 -- 172.21.15.131:0/1489824861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7264004800 msgr2=0x7f728014c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f727e000640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7264004800 0x7f728014c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f727e000640 1 -- 172.21.15.131:0/1489824861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f728014c8e0 con 0x7f728013e7e0 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f727f400640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72801e42b0 0x7f72801e78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f727e000640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f728013e7e0 0x7f72801434e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f726c00a9a0 tx=0x7f726c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f7276a00640 1 -- 172.21.15.131:0/1489824861 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c048070 con 0x7f728013e7e0 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f7276a00640 1 -- 172.21.15.131:0/1489824861 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f726c0396e0 con 0x7f728013e7e0 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f7276a00640 1 -- 172.21.15.131:0/1489824861 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f726c034040 con 0x7f728013e7e0 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.646+0000 7f7285c00640 1 -- 172.21.15.131:0/1489824861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7280143a20 con 0x7f728013e7e0 2024-04-12T19:39:17.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.647+0000 7f7285c00640 1 -- 172.21.15.131:0/1489824861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7280142720 con 0x7f728013e7e0 2024-04-12T19:39:17.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.648+0000 7f7285c00640 1 -- 172.21.15.131:0/1489824861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72800bffa0 con 0x7f728013e7e0 2024-04-12T19:39:17.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.649+0000 7f7276a00640 1 -- 172.21.15.131:0/1489824861 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f726c04b070 con 0x7f728013e7e0 2024-04-12T19:39:17.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.649+0000 7f7276a00640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f726006c8f0 0x7f726006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:17.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.650+0000 7f7276a00640 1 -- 172.21.15.131:0/1489824861 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f726c0ada50 con 0x7f728013e7e0 2024-04-12T19:39:17.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.650+0000 7f727ea00640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f726006c8f0 0x7f726006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:17.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.650+0000 7f727ea00640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f726006c8f0 0x7f726006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7270001eb0 tx=0x7f7270009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:17.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.654+0000 7f7276a00640 1 -- 172.21.15.131:0/1489824861 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f72800bffa0 con 0x7f728013e7e0 2024-04-12T19:39:17.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.854+0000 7f7285c00640 1 -- 172.21.15.131:0/1489824861 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f728004fd50 con 0x7f728013e7e0 2024-04-12T19:39:17.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.855+0000 7f7276a00640 1 -- 172.21.15.131:0/1489824861 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f726c07b450 con 0x7f728013e7e0 2024-04-12T19:39:17.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:17.857 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":26,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:17.479662+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:17.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.858+0000 7f7285c00640 1 -- 172.21.15.131:0/1489824861 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f726006c8f0 msgr2=0x7f726006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.858+0000 7f7285c00640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f726006c8f0 0x7f726006edb0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7270001eb0 tx=0x7f7270009040 comp rx=0 tx=0).stop 2024-04-12T19:39:17.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.858+0000 7f7285c00640 1 -- 172.21.15.131:0/1489824861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f728013e7e0 msgr2=0x7f72801434e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:17.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.858+0000 7f7285c00640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f728013e7e0 0x7f72801434e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f726c00a9a0 tx=0x7f726c0046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.858+0000 7f7285c00640 1 -- 172.21.15.131:0/1489824861 shutdown_connections 2024-04-12T19:39:17.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.858+0000 7f7285c00640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f726006c8f0 0x7f726006edb0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.858+0000 7f7285c00640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72801e42b0 0x7f72801e78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.858+0000 7f7285c00640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f728013e7e0 0x7f72801434e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.858+0000 7f7285c00640 1 --2- 172.21.15.131:0/1489824861 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7264004800 0x7f728014c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:17.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.858+0000 7f7285c00640 1 -- 172.21.15.131:0/1489824861 >> 172.21.15.131:0/1489824861 conn(0x7f72800c2590 msgr2=0x7f72800c2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:17.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.858+0000 7f7285c00640 1 -- 172.21.15.131:0/1489824861 shutdown_connections 2024-04-12T19:39:17.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:17.858+0000 7f7285c00640 1 -- 172.21.15.131:0/1489824861 wait complete. 2024-04-12T19:39:17.895 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-12T19:39:18.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.107+0000 7f6dede00640 1 Processor -- start 2024-04-12T19:39:18.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.108+0000 7f6dede00640 1 -- start start 2024-04-12T19:39:18.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.109+0000 7f6dede00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6de814e870 0x7f6de806df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.109+0000 7f6dede00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6de80c4550 0x7f6de806c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.109+0000 7f6dede00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6de806c0d0 con 0x7f6de80c49b0 2024-04-12T19:39:18.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.109+0000 7f6dede00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6de80c2b80 con 0x7f6de80c4550 2024-04-12T19:39:18.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.109+0000 7f6dede00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6de8151c60 con 0x7f6de814e870 2024-04-12T19:39:18.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.109+0000 7f6ddfe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6de80c4550 0x7f6de806c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.109+0000 7f6ddfe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6de80c4550 0x7f6de806c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40112/0 (socket says 172.21.15.131:40112) 2024-04-12T19:39:18.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.109+0000 7f6ddfe00640 1 -- 172.21.15.131:0/2842269167 learned_addr learned my addr 172.21.15.131:0/2842269167 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:18.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.109+0000 7f6deca00640 1 --2- 172.21.15.131:0/2842269167 >> v2:172.21.15.171:3300/0 conn(0x7f6de814e870 0x7f6de806df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.110+0000 7f6ddfe00640 1 -- 172.21.15.131:0/2842269167 >> v2:172.21.15.171:3300/0 conn(0x7f6de814e870 msgr2=0x7f6de806df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:18.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.110+0000 7f6ddfe00640 1 --2- 172.21.15.131:0/2842269167 >> v2:172.21.15.171:3300/0 conn(0x7f6de814e870 0x7f6de806df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.110+0000 7f6ddfe00640 1 -- 172.21.15.131:0/2842269167 >> v1:172.21.15.171:6789/0 conn(0x7f6de80c49b0 legacy=0x7f6de806cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:18.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.110+0000 7f6ddfe00640 1 -- 172.21.15.131:0/2842269167 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de806c370 con 0x7f6de80c4550 2024-04-12T19:39:18.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.111+0000 7f6ddfe00640 1 --2- 172.21.15.131:0/2842269167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de80c4550 0x7f6de806c890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6de80c72a0 tx=0x7f6dd002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=effffcc5de5c2b8d server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:18.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.111+0000 7f6de7e00640 1 -- 172.21.15.131:0/2842269167 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0035020 con 0x7f6de80c4550 2024-04-12T19:39:18.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.111+0000 7f6de7e00640 1 -- 172.21.15.131:0/2842269167 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd0031870 con 0x7f6de80c4550 2024-04-12T19:39:18.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.111+0000 7f6de7e00640 1 -- 172.21.15.131:0/2842269167 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd0031c40 con 0x7f6de80c4550 2024-04-12T19:39:18.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.112+0000 7f6dede00640 1 -- 172.21.15.131:0/2842269167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de80c4550 msgr2=0x7f6de806c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:18.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.112+0000 7f6dede00640 1 --2- 172.21.15.131:0/2842269167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de80c4550 0x7f6de806c890 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6de80c72a0 tx=0x7f6dd002b910 comp rx=0 tx=0).stop 2024-04-12T19:39:18.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.112+0000 7f6dede00640 1 -- 172.21.15.131:0/2842269167 shutdown_connections 2024-04-12T19:39:18.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.112+0000 7f6dede00640 1 --2- 172.21.15.131:0/2842269167 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de80c4550 0x7f6de806c890 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.112+0000 7f6dede00640 1 --2- 172.21.15.131:0/2842269167 >> v2:172.21.15.171:3300/0 conn(0x7f6de814e870 0x7f6de806df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.112+0000 7f6dede00640 1 -- 172.21.15.131:0/2842269167 >> 172.21.15.131:0/2842269167 conn(0x7f6de80c6750 msgr2=0x7f6de80c6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:18.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.112+0000 7f6dede00640 1 -- 172.21.15.131:0/2842269167 shutdown_connections 2024-04-12T19:39:18.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.112+0000 7f6dede00640 1 -- 172.21.15.131:0/2842269167 wait complete. 2024-04-12T19:39:18.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.114+0000 7f6dede00640 1 Processor -- start 2024-04-12T19:39:18.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.114+0000 7f6dede00640 1 -- start start 2024-04-12T19:39:18.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.115+0000 7f6dede00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6de80c4550 0x7f6de81e0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.115+0000 7f6dede00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de80c49b0 0x7f6de81e9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.115+0000 7f6dede00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de814e870 0x7f6de81ea260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.115+0000 7f6dede00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6de814ec50 con 0x7f6de814e870 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.115+0000 7f6dede00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6de806e800 con 0x7f6de80c49b0 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.115+0000 7f6dede00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6de80c1920 con 0x7f6de80c4550 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.115+0000 7f6ded400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de814e870 0x7f6de81ea260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.115+0000 7f6ded400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de814e870 0x7f6de81ea260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40128/0 (socket says 172.21.15.131:40128) 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.115+0000 7f6ded400640 1 -- 172.21.15.131:0/873610194 learned_addr learned my addr 172.21.15.131:0/873610194 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.115+0000 7f6deca00640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6de80c4550 0x7f6de81e0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.115+0000 7f6ddfe00640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de80c49b0 0x7f6de81e9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.116+0000 7f6ded400640 1 -- 172.21.15.131:0/873610194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6de80c4550 msgr2=0x7f6de81e0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.116+0000 7f6ded400640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6de80c4550 0x7f6de81e0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.116+0000 7f6ded400640 1 -- 172.21.15.131:0/873610194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de80c49b0 msgr2=0x7f6de81e9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:18.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.116+0000 7f6ded400640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de80c49b0 0x7f6de81e9d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.116+0000 7f6ded400640 1 -- 172.21.15.131:0/873610194 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6de80bd5b0 con 0x7f6de814e870 2024-04-12T19:39:18.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.116+0000 7f6deca00640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6de80c4550 0x7f6de81e0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:18.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.116+0000 7f6ded400640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de814e870 0x7f6de81ea260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6de000c700 tx=0x7f6de000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:18.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.116+0000 7f6de5600640 1 -- 172.21.15.131:0/873610194 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de0016020 con 0x7f6de814e870 2024-04-12T19:39:18.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.116+0000 7f6de5600640 1 -- 172.21.15.131:0/873610194 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6de000aa50 con 0x7f6de814e870 2024-04-12T19:39:18.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.116+0000 7f6de5600640 1 -- 172.21.15.131:0/873610194 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6de000ae40 con 0x7f6de814e870 2024-04-12T19:39:18.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.116+0000 7f6dede00640 1 -- 172.21.15.131:0/873610194 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6de809c090 con 0x7f6de814e870 2024-04-12T19:39:18.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.116+0000 7f6dede00640 1 -- 172.21.15.131:0/873610194 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6de81eabd0 con 0x7f6de814e870 2024-04-12T19:39:18.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.118+0000 7f6dede00640 1 -- 172.21.15.131:0/873610194 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6de8075c30 con 0x7f6de814e870 2024-04-12T19:39:18.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.118+0000 7f6de5600640 1 -- 172.21.15.131:0/873610194 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6de0019020 con 0x7f6de814e870 2024-04-12T19:39:18.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.119+0000 7f6de5600640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6dc406c8f0 0x7f6dc406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.120+0000 7f6de5600640 1 -- 172.21.15.131:0/873610194 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6de008c0a0 con 0x7f6de814e870 2024-04-12T19:39:18.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.120+0000 7f6deca00640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6dc406c8f0 0x7f6dc406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.120+0000 7f6deca00640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6dc406c8f0 0x7f6dc406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8006fd0 tx=0x7f6dd8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:18.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.124+0000 7f6de5600640 1 -- 172.21.15.131:0/873610194 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6de0020020 con 0x7f6de814e870 2024-04-12T19:39:18.365 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.363+0000 7f6dede00640 1 -- 172.21.15.131:0/873610194 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6de806dd40 con 0x7f6de814e870 2024-04-12T19:39:18.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.365+0000 7f6de5600640 1 -- 172.21.15.131:0/873610194 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5186 (secure 0 0 0) 0x7f6de0059bd0 con 0x7f6de814e870 2024-04-12T19:39:18.366 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:18.366 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3941197710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3941197710},{"type":"v1","addr":"172.21.15.131:6836","nonce":3941197710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2898590457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2898590457},{"type":"v1","addr":"172.21.15.131:6837","nonce":2898590457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/373698102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":373698102},{"type":"v1","addr":"172.21.15.171:6835","nonce":373698102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T19:39:10.876760+0000","modified":"2024-04-12T19:39:15.957260+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6834/1013642393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1013642393},{"type":"v1","addr":"172.21.15.171:6834","nonce":1013642393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4257,"qdb_cluster":[4257]},"id":1}]} 2024-04-12T19:39:18.366 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 6 2024-04-12T19:39:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.367+0000 7f6dede00640 1 -- 172.21.15.131:0/873610194 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6dc406c8f0 msgr2=0x7f6dc406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.367+0000 7f6dede00640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6dc406c8f0 0x7f6dc406edb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8006fd0 tx=0x7f6dd8008040 comp rx=0 tx=0).stop 2024-04-12T19:39:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.367+0000 7f6dede00640 1 -- 172.21.15.131:0/873610194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de814e870 msgr2=0x7f6de81ea260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.367+0000 7f6dede00640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de814e870 0x7f6de81ea260 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6de000c700 tx=0x7f6de000cbc0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.368+0000 7f6dede00640 1 -- 172.21.15.131:0/873610194 shutdown_connections 2024-04-12T19:39:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.368+0000 7f6dede00640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6dc406c8f0 0x7f6dc406edb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.368+0000 7f6dede00640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6de80c49b0 0x7f6de81e9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.368+0000 7f6dede00640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6de814e870 0x7f6de81ea260 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.368+0000 7f6dede00640 1 --2- 172.21.15.131:0/873610194 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6de80c4550 0x7f6de81e0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.368+0000 7f6dede00640 1 -- 172.21.15.131:0/873610194 >> 172.21.15.131:0/873610194 conn(0x7f6de80c6750 msgr2=0x7f6de8150550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.368+0000 7f6dede00640 1 -- 172.21.15.131:0/873610194 shutdown_connections 2024-04-12T19:39:18.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.368+0000 7f6dede00640 1 -- 172.21.15.131:0/873610194 wait complete. 2024-04-12T19:39:18.386 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:18.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.594+0000 7f8522c00640 1 Processor -- start 2024-04-12T19:39:18.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.594+0000 7f8522c00640 1 -- start start 2024-04-12T19:39:18.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8522c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f851c0a8a20 0x7f851c06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8522c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f851c06bf20 0x7f851c06f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8522c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c0bddb0 0x7f851c06f590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8522c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f851c06c4f0 con 0x7f851c0a8a20 2024-04-12T19:39:18.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8522c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f851c14f850 con 0x7f851c06bf20 2024-04-12T19:39:18.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8522c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f851c072240 con 0x7f851c0bddb0 2024-04-12T19:39:18.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8521800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f851c0a8a20 0x7f851c06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8521800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f851c0a8a20 0x7f851c06b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40132/0 (socket says 172.21.15.131:40132) 2024-04-12T19:39:18.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8521800640 1 -- 172.21.15.131:0/3829285748 learned_addr learned my addr 172.21.15.131:0/3829285748 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:18.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8521800640 1 -- 172.21.15.131:0/3829285748 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c0bddb0 msgr2=0x7f851c06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:18.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8522200640 1 --2- 172.21.15.131:0/3829285748 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c0bddb0 0x7f851c06f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8520e00640 1 --2- 172.21.15.131:0/3829285748 >> v2:172.21.15.171:3300/0 conn(0x7f851c06bf20 0x7f851c06f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.596+0000 7f8521800640 1 --2- 172.21.15.131:0/3829285748 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c0bddb0 0x7f851c06f590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.597+0000 7f8521800640 1 -- 172.21.15.131:0/3829285748 >> v2:172.21.15.171:3300/0 conn(0x7f851c06bf20 msgr2=0x7f851c06f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:18.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.597+0000 7f8521800640 1 --2- 172.21.15.131:0/3829285748 >> v2:172.21.15.171:3300/0 conn(0x7f851c06bf20 0x7f851c06f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.597+0000 7f8521800640 1 -- 172.21.15.131:0/3829285748 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851c072520 con 0x7f851c0a8a20 2024-04-12T19:39:18.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.598+0000 7f8521800640 1 --2- 172.21.15.131:0/3829285748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f851c0a8a20 0x7f851c06b9e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f851c072170 tx=0x7f851002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659cece0ac950ade server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:18.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.598+0000 7f851be00640 1 -- 172.21.15.131:0/3829285748 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8510035020 con 0x7f851c0a8a20 2024-04-12T19:39:18.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.598+0000 7f851be00640 1 -- 172.21.15.131:0/3829285748 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8510031870 con 0x7f851c0a8a20 2024-04-12T19:39:18.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.598+0000 7f851be00640 1 -- 172.21.15.131:0/3829285748 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8510031c40 con 0x7f851c0a8a20 2024-04-12T19:39:18.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.598+0000 7f8522c00640 1 -- 172.21.15.131:0/3829285748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f851c0a8a20 msgr2=0x7f851c06b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:18.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.598+0000 7f8522c00640 1 --2- 172.21.15.131:0/3829285748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f851c0a8a20 0x7f851c06b9e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f851c072170 tx=0x7f851002b910 comp rx=0 tx=0).stop 2024-04-12T19:39:18.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.599+0000 7f8522c00640 1 -- 172.21.15.131:0/3829285748 shutdown_connections 2024-04-12T19:39:18.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.599+0000 7f8522c00640 1 --2- 172.21.15.131:0/3829285748 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c0bddb0 0x7f851c06f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.599+0000 7f8522c00640 1 --2- 172.21.15.131:0/3829285748 >> v2:172.21.15.171:3300/0 conn(0x7f851c06bf20 0x7f851c06f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.599+0000 7f8522c00640 1 --2- 172.21.15.131:0/3829285748 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f851c0a8a20 0x7f851c06b9e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.599+0000 7f8522c00640 1 -- 172.21.15.131:0/3829285748 >> 172.21.15.131:0/3829285748 conn(0x7f851c0c3430 msgr2=0x7f851c0c3840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:18.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.599+0000 7f8522c00640 1 -- 172.21.15.131:0/3829285748 shutdown_connections 2024-04-12T19:39:18.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.599+0000 7f8522c00640 1 -- 172.21.15.131:0/3829285748 wait complete. 2024-04-12T19:39:18.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.600+0000 7f8522c00640 1 Processor -- start 2024-04-12T19:39:18.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.600+0000 7f8522c00640 1 -- start start 2024-04-12T19:39:18.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.601+0000 7f8522c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c06bf20 0x7f851c1e77d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.601+0000 7f8522c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f851c0a8a20 0x7f851c0a6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.601+0000 7f8522c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f851c0bddb0 0x7f851c150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.601+0000 7f8522c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f851c0be2c0 con 0x7f851c0bddb0 2024-04-12T19:39:18.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.601+0000 7f8522c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f851c14fb30 con 0x7f851c0a8a20 2024-04-12T19:39:18.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.601+0000 7f8522c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f851c0be440 con 0x7f851c06bf20 2024-04-12T19:39:18.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.601+0000 7f8522200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f851c0bddb0 0x7f851c150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8522200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f851c0bddb0 0x7f851c150870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40140/0 (socket says 172.21.15.131:40140) 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8522200640 1 -- 172.21.15.131:0/129512558 learned_addr learned my addr 172.21.15.131:0/129512558 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8520e00640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f851c0a8a20 0x7f851c0a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8521800640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c06bf20 0x7f851c1e77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8522200640 1 -- 172.21.15.131:0/129512558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c06bf20 msgr2=0x7f851c1e77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8522200640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c06bf20 0x7f851c1e77d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8522200640 1 -- 172.21.15.131:0/129512558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f851c0a8a20 msgr2=0x7f851c0a6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8522200640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f851c0a8a20 0x7f851c0a6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8522200640 1 -- 172.21.15.131:0/129512558 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f851c0c2810 con 0x7f851c0bddb0 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8522200640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f851c0bddb0 0x7f851c150870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f851400cd70 tx=0x7f851400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8519600640 1 -- 172.21.15.131:0/129512558 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514003b90 con 0x7f851c0bddb0 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8519600640 1 -- 172.21.15.131:0/129512558 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8514003d30 con 0x7f851c0bddb0 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8519600640 1 -- 172.21.15.131:0/129512558 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514004240 con 0x7f851c0bddb0 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.602+0000 7f8522c00640 1 -- 172.21.15.131:0/129512558 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f851c1eac90 con 0x7f851c0bddb0 2024-04-12T19:39:18.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.603+0000 7f8522c00640 1 -- 172.21.15.131:0/129512558 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f851c1e6fd0 con 0x7f851c0bddb0 2024-04-12T19:39:18.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.604+0000 7f8522c00640 1 -- 172.21.15.131:0/129512558 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f851c075c30 con 0x7f851c0bddb0 2024-04-12T19:39:18.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.605+0000 7f8519600640 1 -- 172.21.15.131:0/129512558 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f85140043e0 con 0x7f851c0bddb0 2024-04-12T19:39:18.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.606+0000 7f8519600640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f84fc06c8f0 0x7f84fc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:18.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.606+0000 7f8519600640 1 -- 172.21.15.131:0/129512558 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f851408c930 con 0x7f851c0bddb0 2024-04-12T19:39:18.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.606+0000 7f8521800640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f84fc06c8f0 0x7f84fc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:18.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.606+0000 7f8521800640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f84fc06c8f0 0x7f84fc06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8510036000 tx=0x7f8510008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:18.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.610+0000 7f8519600640 1 -- 172.21.15.131:0/129512558 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f851405aa10 con 0x7f851c0bddb0 2024-04-12T19:39:18.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.811+0000 7f8522c00640 1 -- 172.21.15.131:0/129512558 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f851c0bb9b0 con 0x7f851c0bddb0 2024-04-12T19:39:18.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.812+0000 7f8519600640 1 -- 172.21.15.131:0/129512558 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f851405a310 con 0x7f851c0bddb0 2024-04-12T19:39:18.814 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:18.814 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":26,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:17.479662+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:18.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.815+0000 7f8522c00640 1 -- 172.21.15.131:0/129512558 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f84fc06c8f0 msgr2=0x7f84fc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:18.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.815+0000 7f8522c00640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f84fc06c8f0 0x7f84fc06edb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8510036000 tx=0x7f8510008030 comp rx=0 tx=0).stop 2024-04-12T19:39:18.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.815+0000 7f8522c00640 1 -- 172.21.15.131:0/129512558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f851c0bddb0 msgr2=0x7f851c150870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:18.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.815+0000 7f8522c00640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f851c0bddb0 0x7f851c150870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f851400cd70 tx=0x7f851400a660 comp rx=0 tx=0).stop 2024-04-12T19:39:18.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.815+0000 7f8522c00640 1 -- 172.21.15.131:0/129512558 shutdown_connections 2024-04-12T19:39:18.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.815+0000 7f8522c00640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f84fc06c8f0 0x7f84fc06edb0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.815+0000 7f8522c00640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f851c0a8a20 0x7f851c0a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.815+0000 7f8522c00640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f851c0bddb0 0x7f851c150870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.815+0000 7f8522c00640 1 --2- 172.21.15.131:0/129512558 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f851c06bf20 0x7f851c1e77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:18.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.815+0000 7f8522c00640 1 -- 172.21.15.131:0/129512558 >> 172.21.15.131:0/129512558 conn(0x7f851c0c3430 msgr2=0x7f851c0c1330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:18.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.815+0000 7f8522c00640 1 -- 172.21.15.131:0/129512558 shutdown_connections 2024-04-12T19:39:18.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:18.815+0000 7f8522c00640 1 -- 172.21.15.131:0/129512558 wait complete. 2024-04-12T19:39:19.237 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-12T19:39:10.876760+0000', 'modified': '2024-04-12T19:39:15.957260+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4257}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4257': {'gid': 4257, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.171:6834/1013642393', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 1013642393}, {'type': 'v1', 'addr': '172.21.15.171:6834', 'nonce': 1013642393}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4257, 'qdb_cluster': [4257]} 2024-04-12T19:39:19.237 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-12T19:39:19.237 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-12T19:39:19.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.445+0000 7f81f7800640 1 Processor -- start 2024-04-12T19:39:19.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.445+0000 7f81f7800640 1 -- start start 2024-04-12T19:39:19.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.447+0000 7f81f7800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f81f00bf720 0x7f81f00a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.447+0000 7f81f7800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00a4f80 0x7f81f014eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.447+0000 7f81f7800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81f00a7ae0 con 0x7f81f0073840 2024-04-12T19:39:19.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.447+0000 7f81f7800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f81f00a5c90 con 0x7f81f00bf720 2024-04-12T19:39:19.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.447+0000 7f81f7800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81f00beed0 con 0x7f81f00a4f80 2024-04-12T19:39:19.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.447+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00a4f80 0x7f81f014eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.448+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00a4f80 0x7f81f014eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:49212/0 (socket says 172.21.15.131:49212) 2024-04-12T19:39:19.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.448+0000 7f81e7e00640 1 -- 172.21.15.131:0/1578332002 learned_addr learned my addr 172.21.15.131:0/1578332002 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:19.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.448+0000 7f81f4e00640 1 --2- 172.21.15.131:0/1578332002 >> v2:172.21.15.171:3300/0 conn(0x7f81f00bf720 0x7f81f00a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.448+0000 7f81efe00640 1 -- 172.21.15.131:0/1578332002 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349458615 0 0) 0x7f81f00a7ae0 con 0x7f81f0073840 2024-04-12T19:39:19.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.448+0000 7f81efe00640 1 -- 172.21.15.131:0/1578332002 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81d4003520 con 0x7f81f0073840 2024-04-12T19:39:19.449 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.448+0000 7f81e7e00640 1 -- 172.21.15.131:0/1578332002 >> v2:172.21.15.171:3300/0 conn(0x7f81f00bf720 msgr2=0x7f81f00a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:19.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.448+0000 7f81e7e00640 1 --2- 172.21.15.131:0/1578332002 >> v2:172.21.15.171:3300/0 conn(0x7f81f00bf720 0x7f81f00a6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.448+0000 7f81e7e00640 1 -- 172.21.15.131:0/1578332002 >> v1:172.21.15.171:6789/0 conn(0x7f81f0073840 legacy=0x7f81f01524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.448+0000 7f81e7e00640 1 -- 172.21.15.131:0/1578332002 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f00be2a0 con 0x7f81f00a4f80 2024-04-12T19:39:19.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.450+0000 7f81e7e00640 1 --2- 172.21.15.131:0/1578332002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00a4f80 0x7f81f014eee0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009870 tx=0x7f81d802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46a29c51a100331c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:19.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.450+0000 7f81efe00640 1 -- 172.21.15.131:0/1578332002 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d8035020 con 0x7f81f00a4f80 2024-04-12T19:39:19.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.450+0000 7f81efe00640 1 -- 172.21.15.131:0/1578332002 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d8031640 con 0x7f81f00a4f80 2024-04-12T19:39:19.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.450+0000 7f81efe00640 1 -- 172.21.15.131:0/1578332002 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d802d040 con 0x7f81f00a4f80 2024-04-12T19:39:19.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.451+0000 7f81f7800640 1 -- 172.21.15.131:0/1578332002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00a4f80 msgr2=0x7f81f014eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.451+0000 7f81f7800640 1 --2- 172.21.15.131:0/1578332002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00a4f80 0x7f81f014eee0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009870 tx=0x7f81d802b8f0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.451+0000 7f81f7800640 1 -- 172.21.15.131:0/1578332002 shutdown_connections 2024-04-12T19:39:19.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.451+0000 7f81f7800640 1 --2- 172.21.15.131:0/1578332002 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00a4f80 0x7f81f014eee0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.451+0000 7f81f7800640 1 --2- 172.21.15.131:0/1578332002 >> v2:172.21.15.171:3300/0 conn(0x7f81f00bf720 0x7f81f00a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.451+0000 7f81f7800640 1 -- 172.21.15.131:0/1578332002 >> 172.21.15.131:0/1578332002 conn(0x7f81f006be00 msgr2=0x7f81f006c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:19.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.451+0000 7f81f7800640 1 -- 172.21.15.131:0/1578332002 shutdown_connections 2024-04-12T19:39:19.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.451+0000 7f81f7800640 1 -- 172.21.15.131:0/1578332002 wait complete. 2024-04-12T19:39:19.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.452+0000 7f81f7800640 1 Processor -- start 2024-04-12T19:39:19.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.453+0000 7f81f7800640 1 -- start start 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.453+0000 7f81f7800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f0073840 0x7f81f01dc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.453+0000 7f81f7800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00a4f80 0x7f81f00baf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.453+0000 7f81f7800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f00bf720 0x7f81f00bb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.453+0000 7f81f7800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81f00bfb00 con 0x7f81f0073840 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.453+0000 7f81f7800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81f00beba0 con 0x7f81f00bf720 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.453+0000 7f81f7800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81f00bfc80 con 0x7f81f00a4f80 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.454+0000 7f81f4e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f0073840 0x7f81f01dc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.454+0000 7f81f4e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f0073840 0x7f81f01dc5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40156/0 (socket says 172.21.15.131:40156) 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.454+0000 7f81f4e00640 1 -- 172.21.15.131:0/2986572489 learned_addr learned my addr 172.21.15.131:0/2986572489 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.454+0000 7f81e7e00640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00a4f80 0x7f81f00baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.454+0000 7f81f5800640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f00bf720 0x7f81f00bb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.454+0000 7f81f4e00640 1 -- 172.21.15.131:0/2986572489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00a4f80 msgr2=0x7f81f00baf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.454+0000 7f81f4e00640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00a4f80 0x7f81f00baf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.454+0000 7f81f4e00640 1 -- 172.21.15.131:0/2986572489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f00bf720 msgr2=0x7f81f00bb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.454+0000 7f81f4e00640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f00bf720 0x7f81f00bb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.454+0000 7f81f4e00640 1 -- 172.21.15.131:0/2986572489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81f01dcb30 con 0x7f81f0073840 2024-04-12T19:39:19.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.455+0000 7f81f4e00640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f0073840 0x7f81f01dc5f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81e000e9b0 tx=0x7f81e000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:19.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.455+0000 7f81ed600640 1 -- 172.21.15.131:0/2986572489 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e0017070 con 0x7f81f0073840 2024-04-12T19:39:19.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.455+0000 7f81ed600640 1 -- 172.21.15.131:0/2986572489 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81e000c9a0 con 0x7f81f0073840 2024-04-12T19:39:19.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.455+0000 7f81ed600640 1 -- 172.21.15.131:0/2986572489 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81e000cd90 con 0x7f81f0073840 2024-04-12T19:39:19.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.455+0000 7f81f7800640 1 -- 172.21.15.131:0/2986572489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81f01e9fa0 con 0x7f81f0073840 2024-04-12T19:39:19.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.455+0000 7f81f7800640 1 -- 172.21.15.131:0/2986572489 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81f01ea560 con 0x7f81f0073840 2024-04-12T19:39:19.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.457+0000 7f81ed600640 1 -- 172.21.15.131:0/2986572489 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f81e001a070 con 0x7f81f0073840 2024-04-12T19:39:19.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.458+0000 7f81ed600640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f81cc06c8f0 0x7f81cc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.459+0000 7f81ed600640 1 -- 172.21.15.131:0/2986572489 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f81e008be50 con 0x7f81f0073840 2024-04-12T19:39:19.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.459+0000 7f81e7e00640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f81cc06c8f0 0x7f81cc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.459+0000 7f81fa7d6740 1 Processor -- start 2024-04-12T19:39:19.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.459+0000 7f81fa7d6740 1 -- start start 2024-04-12T19:39:19.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.460+0000 7f81e7e00640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f81cc06c8f0 0x7f81cc06edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f81d8036000 tx=0x7f81d8008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:19.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.460+0000 7f81fa7d6740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d1f4e0 0x564396cde6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.460+0000 7f81fa7d6740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396ce4a00 0x564396cdec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.460+0000 7f81fa7d6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce32a0 0x564396d00cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.460+0000 7f81fa7d6740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564396c49990 con 0x564396ce4a00 2024-04-12T19:39:19.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.460+0000 7f81fa7d6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564396bf0530 con 0x564396ce32a0 2024-04-12T19:39:19.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.460+0000 7f81fa7d6740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x564396c45950 con 0x564396d1f4e0 2024-04-12T19:39:19.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.460+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396ce4a00 0x564396cdec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.460+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396ce4a00 0x564396cdec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40168/0 (socket says 172.21.15.131:40168) 2024-04-12T19:39:19.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.460+0000 7f81e7e00640 1 -- 172.21.15.131:0/689594749 learned_addr learned my addr 172.21.15.131:0/689594749 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:19.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.461+0000 7f81f4e00640 1 --2- 172.21.15.131:0/689594749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d1f4e0 0x564396cde6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.461+0000 7f81f5800640 1 --2- 172.21.15.131:0/689594749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce32a0 0x564396d00cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.461+0000 7f81e7e00640 1 -- 172.21.15.131:0/689594749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d1f4e0 msgr2=0x564396cde6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:19.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.461+0000 7f81e7e00640 1 --2- 172.21.15.131:0/689594749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d1f4e0 0x564396cde6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.461+0000 7f81e7e00640 1 -- 172.21.15.131:0/689594749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce32a0 msgr2=0x564396d00cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:19.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.461+0000 7f81e7e00640 1 --2- 172.21.15.131:0/689594749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce32a0 0x564396d00cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.461+0000 7f81e7e00640 1 -- 172.21.15.131:0/689594749 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56439695c2d0 con 0x564396ce4a00 2024-04-12T19:39:19.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.461+0000 7f81e7e00640 1 --2- 172.21.15.131:0/689594749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396ce4a00 0x564396cdec00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009990 tx=0x7f81d8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=839596c4956674d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:19.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.461+0000 7f81e5600640 1 -- 172.21.15.131:0/689594749 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d8040070 con 0x564396ce4a00 2024-04-12T19:39:19.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.461+0000 7f81e5600640 1 -- 172.21.15.131:0/689594749 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d8003da0 con 0x564396ce4a00 2024-04-12T19:39:19.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.461+0000 7f81e5600640 1 -- 172.21.15.131:0/689594749 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d8035040 con 0x564396ce4a00 2024-04-12T19:39:19.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.462+0000 7f81fa7d6740 1 -- 172.21.15.131:0/689594749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396ce4a00 msgr2=0x564396cdec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.462+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/689594749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396ce4a00 0x564396cdec00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f81d8009990 tx=0x7f81d8030000 comp rx=0 tx=0).stop 2024-04-12T19:39:19.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.462+0000 7f81fa7d6740 1 -- 172.21.15.131:0/689594749 shutdown_connections 2024-04-12T19:39:19.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.462+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/689594749 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce32a0 0x564396d00cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.462+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/689594749 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396ce4a00 0x564396cdec00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.462+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/689594749 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d1f4e0 0x564396cde6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.462+0000 7f81fa7d6740 1 -- 172.21.15.131:0/689594749 >> 172.21.15.131:0/689594749 conn(0x564396ce0680 msgr2=0x564396d1ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:19.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.462+0000 7f81fa7d6740 1 -- 172.21.15.131:0/689594749 shutdown_connections 2024-04-12T19:39:19.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.462+0000 7f81fa7d6740 1 -- 172.21.15.131:0/689594749 wait complete. 2024-04-12T19:39:19.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.463+0000 7f81fa7d6740 1 -- start start 2024-04-12T19:39:19.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.463+0000 7f81fa7d6740 1 Processor -- start 2024-04-12T19:39:19.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81fa7d6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce4a00 0x564396d13560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81fa7d6740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d1f4e0 0x564396d2bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81fa7d6740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d10cc0 0x564396d11140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81fa7d6740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564396d197b0 con 0x564396d1f4e0 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81fa7d6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x564396c038f0 con 0x564396ce4a00 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81fa7d6740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x564396ce4e20 con 0x564396d10cc0 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81fa7d6740 10 client.0 _ll_register_callbacks cb 0x564396c032e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d1f4e0 0x564396d2bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d1f4e0 0x564396d2bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40174/0 (socket says 172.21.15.131:40174) 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81e7e00640 1 -- 172.21.15.131:0/2079872562 learned_addr learned my addr 172.21.15.131:0/2079872562 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81e7e00640 1 -- 172.21.15.131:0/2079872562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d10cc0 msgr2=0x564396d11140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81e7e00640 1 --2- 172.21.15.131:0/2079872562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d10cc0 0x564396d11140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81f4e00640 1 --2- 172.21.15.131:0/2079872562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce4a00 0x564396d13560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.464+0000 7f81e7e00640 1 -- 172.21.15.131:0/2079872562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce4a00 msgr2=0x564396d13560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:19.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.465+0000 7f81e7e00640 1 --2- 172.21.15.131:0/2079872562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce4a00 0x564396d13560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.465+0000 7f81e7e00640 1 -- 172.21.15.131:0/2079872562 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564396a266b0 con 0x564396d1f4e0 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.465+0000 7f81e7e00640 1 --2- 172.21.15.131:0/2079872562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d1f4e0 0x564396d2bf70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81d80317b0 tx=0x7f81d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34c3e125fcd64068 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.465+0000 7f81de000640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.465+0000 7f81de000640 1 -- 172.21.15.131:0/2079872562 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d8040050 con 0x564396d1f4e0 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.465+0000 7f81fa7d6740 1 -- 172.21.15.131:0/2079872562 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81d8003da0 con 0x564396d1f4e0 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.465+0000 7f81de000640 1 -- 172.21.15.131:0/2079872562 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f81d8031ba0 con 0x564396d1f4e0 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.466+0000 7f81de000640 1 -- 172.21.15.131:0/2079872562 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f81d8035040 con 0x564396d1f4e0 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.466+0000 7f81fa7d6740 10 client.4389 fetch_fsmap learned FSMap version 6 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.466+0000 7f81fa7d6740 1 -- 172.21.15.131:0/2079872562 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x564396d13aa0 con 0x564396d1f4e0 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.466+0000 7f81de000640 1 -- 172.21.15.131:0/2079872562 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d8003da0 con 0x564396d1f4e0 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.466+0000 7f81de000640 1 -- 172.21.15.131:0/2079872562 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f81d805a480 con 0x564396d1f4e0 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.466+0000 7f81fa7d6740 10 client.4389 fetch_fsmap finished waiting for FSMap version 6 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.466+0000 7f81fa7d6740 10 client.4389 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.466+0000 7f81fa7d6740 20 client.4389 populate_metadata read hostname 'smithi131' 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.466+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/2079872562 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x564396d38bd0 0x564396d3afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.466+0000 7f81fa7d6740 4 client.4389 mds_command: new command op to 4257 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-12T19:39:19.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.466+0000 7f81fa7d6740 1 -- 172.21.15.131:0/2079872562 --> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564396befb40 con 0x564396d38bd0 2024-04-12T19:39:19.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.467+0000 7f81f4e00640 1 --2- 172.21.15.131:0/2079872562 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x564396d38bd0 0x564396d3afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.468+0000 7f81f4e00640 1 --2- 172.21.15.131:0/2079872562 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x564396d38bd0 0x564396d3afc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4a52f959f1cfe62 server_cookie=cdbfd24ba212cfdc in_seq=0 out_seq=0 2024-04-12T19:39:19.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.468+0000 7f81de000640 10 client.4389 ms_handle_connect on v2:172.21.15.171:6832/1013642393 2024-04-12T19:39:19.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81de000640 1 -- 172.21.15.131:0/2079872562 <== mds.0 v2:172.21.15.171:6832/1013642393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564396befb40 con 0x564396d38bd0 2024-04-12T19:39:19.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81de000640 10 client.4389 handle_command_reply: tid=0 2024-04-12T19:39:19.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81fa7d6740 1 client.4389 shutdown 2024-04-12T19:39:19.472 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81fa7d6740 1 -- 172.21.15.131:0/2079872562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d1f4e0 msgr2=0x564396d2bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/2079872562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d1f4e0 0x564396d2bf70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f81d80317b0 tx=0x7f81d8004730 comp rx=0 tx=0).stop 2024-04-12T19:39:19.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81fa7d6740 1 -- 172.21.15.131:0/2079872562 shutdown_connections 2024-04-12T19:39:19.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/2079872562 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x564396d38bd0 0x564396d3afc0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/2079872562 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d10cc0 0x564396d11140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/2079872562 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d1f4e0 0x564396d2bf70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/2079872562 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce4a00 0x564396d13560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81de000640 0 client.4389 ms_handle_reset on v2:172.21.15.171:6832/1013642393 2024-04-12T19:39:19.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81fa7d6740 1 -- 172.21.15.131:0/2079872562 >> 172.21.15.131:0/2079872562 conn(0x564396ce32a0 msgr2=0x564396ce2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:19.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81fa7d6740 1 -- 172.21.15.131:0/2079872562 shutdown_connections 2024-04-12T19:39:19.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81fa7d6740 1 -- 172.21.15.131:0/2079872562 wait complete. 2024-04-12T19:39:19.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.471+0000 7f81fa7d6740 20 client.4389 trim_cache size 0 max 16384 2024-04-12T19:39:19.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.490+0000 7f81fa7d6740 1 Processor -- start 2024-04-12T19:39:19.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.490+0000 7f81fa7d6740 1 -- start start 2024-04-12T19:39:19.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.491+0000 7f81fa7d6740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396ce4a00 0x564396cd9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.491+0000 7f81fa7d6740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 0x564396cde480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.491+0000 7f81fa7d6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396d1f4e0 0x564396cde9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.491+0000 7f81fa7d6740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81f01f4e40 con 0x564396d10cc0 2024-04-12T19:39:19.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.491+0000 7f81fa7d6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81f01f3e60 con 0x564396d1f4e0 2024-04-12T19:39:19.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.491+0000 7f81fa7d6740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81f01f31c0 con 0x564396ce4a00 2024-04-12T19:39:19.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.492+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 0x564396cde480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.492+0000 7f81f5800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396d1f4e0 0x564396cde9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.492+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 0x564396cde480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40190/0 (socket says 172.21.15.131:40190) 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.492+0000 7f81e7e00640 1 -- 172.21.15.131:0/4210305283 learned_addr learned my addr 172.21.15.131:0/4210305283 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.492+0000 7f81f4e00640 1 --2- 172.21.15.131:0/4210305283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396ce4a00 0x564396cd9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.492+0000 7f81e7e00640 1 -- 172.21.15.131:0/4210305283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396ce4a00 msgr2=0x564396cd9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.492+0000 7f81e7e00640 1 --2- 172.21.15.131:0/4210305283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396ce4a00 0x564396cd9c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.492+0000 7f81e7e00640 1 -- 172.21.15.131:0/4210305283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396d1f4e0 msgr2=0x564396cde9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.492+0000 7f81e7e00640 1 --2- 172.21.15.131:0/4210305283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396d1f4e0 0x564396cde9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.492+0000 7f81e7e00640 1 -- 172.21.15.131:0/4210305283 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564396ce0410 con 0x564396d10cc0 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.492+0000 7f81e7e00640 1 --2- 172.21.15.131:0/4210305283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 0x564396cde480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f81d802c040 tx=0x7f81d8051070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261b1cab638274d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.493+0000 7f81e4c00640 1 -- 172.21.15.131:0/4210305283 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d8040070 con 0x564396d10cc0 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.493+0000 7f81e4c00640 1 -- 172.21.15.131:0/4210305283 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d8068070 con 0x564396d10cc0 2024-04-12T19:39:19.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.493+0000 7f81e4c00640 1 -- 172.21.15.131:0/4210305283 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d805ab80 con 0x564396d10cc0 2024-04-12T19:39:19.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.493+0000 7f81fa7d6740 1 -- 172.21.15.131:0/4210305283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 msgr2=0x564396cde480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.493+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/4210305283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 0x564396cde480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f81d802c040 tx=0x7f81d8051070 comp rx=0 tx=0).stop 2024-04-12T19:39:19.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.493+0000 7f81fa7d6740 1 -- 172.21.15.131:0/4210305283 shutdown_connections 2024-04-12T19:39:19.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.493+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/4210305283 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396d1f4e0 0x564396cde9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.493+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/4210305283 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 0x564396cde480 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.493+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/4210305283 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396ce4a00 0x564396cd9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.493+0000 7f81fa7d6740 1 -- 172.21.15.131:0/4210305283 >> 172.21.15.131:0/4210305283 conn(0x564396ce32a0 msgr2=0x564396d1a8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:19.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.494+0000 7f81fa7d6740 1 -- 172.21.15.131:0/4210305283 shutdown_connections 2024-04-12T19:39:19.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.494+0000 7f81fa7d6740 1 -- 172.21.15.131:0/4210305283 wait complete. 2024-04-12T19:39:19.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.494+0000 7f81fa7d6740 1 -- start start 2024-04-12T19:39:19.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.494+0000 7f81fa7d6740 1 Processor -- start 2024-04-12T19:39:19.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.495+0000 7f81fa7d6740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce4a00 0x564396d290a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.495+0000 7f81fa7d6740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 0x564396ce1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.495+0000 7f81fa7d6740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d1f4e0 0x564396d90060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.495+0000 7f81fa7d6740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x564396d197b0 con 0x564396d10cc0 2024-04-12T19:39:19.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.495+0000 7f81fa7d6740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81f01f3810 con 0x564396ce4a00 2024-04-12T19:39:19.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.495+0000 7f81fa7d6740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x564396d13040 con 0x564396d1f4e0 2024-04-12T19:39:19.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.495+0000 7f81fa7d6740 10 client.0 _ll_register_callbacks cb 0x7f81d80096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-12T19:39:19.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.495+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 0x564396ce1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.495+0000 7f81e7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 0x564396ce1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40192/0 (socket says 172.21.15.131:40192) 2024-04-12T19:39:19.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.495+0000 7f81e7e00640 1 -- 172.21.15.131:0/1216733583 learned_addr learned my addr 172.21.15.131:0/1216733583 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.496+0000 7f81f5800640 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d1f4e0 0x564396d90060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.496+0000 7f81f4e00640 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce4a00 0x564396d290a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.496+0000 7f81e7e00640 1 -- 172.21.15.131:0/1216733583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d1f4e0 msgr2=0x564396d90060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.496+0000 7f81e7e00640 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d1f4e0 0x564396d90060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.496+0000 7f81e7e00640 1 -- 172.21.15.131:0/1216733583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce4a00 msgr2=0x564396d290a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.496+0000 7f81e7e00640 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce4a00 0x564396d290a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.496+0000 7f81e7e00640 1 -- 172.21.15.131:0/1216733583 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564396d905a0 con 0x564396d10cc0 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.496+0000 7f81e7e00640 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 0x564396ce1a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f81d80040f0 tx=0x7f81d8031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2e565ee79ce0c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.496+0000 7f81de000640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.496+0000 7f81de000640 1 -- 172.21.15.131:0/1216733583 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81d8040040 con 0x564396d10cc0 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.496+0000 7f81de000640 1 -- 172.21.15.131:0/1216733583 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f81d80039e0 con 0x564396d10cc0 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.496+0000 7f81fa7d6740 1 -- 172.21.15.131:0/1216733583 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f81d8068070 con 0x564396d10cc0 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.497+0000 7f81de000640 1 -- 172.21.15.131:0/1216733583 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f81d807b050 con 0x564396d10cc0 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.497+0000 7f81fa7d6740 10 client.4395 fetch_fsmap learned FSMap version 6 2024-04-12T19:39:19.500 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.497+0000 7f81fa7d6740 1 -- 172.21.15.131:0/1216733583 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x564396d9a000 con 0x564396d10cc0 2024-04-12T19:39:19.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.497+0000 7f81de000640 1 -- 172.21.15.131:0/1216733583 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81d8068070 con 0x564396d10cc0 2024-04-12T19:39:19.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.497+0000 7f81de000640 1 -- 172.21.15.131:0/1216733583 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 6) ==== 3502+0+0 (secure 0 0 0) 0x7f81d807e020 con 0x564396d10cc0 2024-04-12T19:39:19.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.497+0000 7f81fa7d6740 10 client.4395 fetch_fsmap finished waiting for FSMap version 6 2024-04-12T19:39:19.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.497+0000 7f81fa7d6740 10 client.4395 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-12T19:39:19.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.497+0000 7f81fa7d6740 20 client.4395 populate_metadata read hostname 'smithi131' 2024-04-12T19:39:19.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.497+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x564396d0f690 0x564396d0fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.497+0000 7f81fa7d6740 4 client.4395 mds_command: new command op to 4257 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-12T19:39:19.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.497+0000 7f81fa7d6740 1 -- 172.21.15.131:0/1216733583 --> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] -- command(tid 0: {"prefix": "status"}) -- 0x564396c573b0 con 0x564396d0f690 2024-04-12T19:39:19.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.498+0000 7f81f4e00640 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x564396d0f690 0x564396d0fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.499+0000 7f81f4e00640 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x564396d0f690 0x564396d0fa70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed70cc205b136896 server_cookie=6be9f80beb918e68 in_seq=0 out_seq=0 2024-04-12T19:39:19.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.499+0000 7f81de000640 10 client.4395 ms_handle_connect on v2:172.21.15.171:6832/1013642393 2024-04-12T19:39:19.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.499+0000 7f81de000640 1 -- 172.21.15.131:0/1216733583 <== mds.0 v2:172.21.15.171:6832/1013642393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x564396c573b0 con 0x564396d0f690 2024-04-12T19:39:19.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.499+0000 7f81de000640 10 client.4395 handle_command_reply: tid=0 2024-04-12T19:39:19.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.499+0000 7f81fa7d6740 1 client.4395 shutdown 2024-04-12T19:39:19.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.500+0000 7f81fa7d6740 1 -- 172.21.15.131:0/1216733583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 msgr2=0x564396ce1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.500+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 0x564396ce1a80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f81d80040f0 tx=0x7f81d8031000 comp rx=0 tx=0).stop 2024-04-12T19:39:19.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.500+0000 7f81fa7d6740 1 -- 172.21.15.131:0/1216733583 shutdown_connections 2024-04-12T19:39:19.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.500+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x564396d0f690 0x564396d0fa70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.500+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x564396d1f4e0 0x564396d90060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.500+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x564396d10cc0 0x564396ce1a80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.500+0000 7f81de000640 0 client.4395 ms_handle_reset on v2:172.21.15.171:6832/1013642393 2024-04-12T19:39:19.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.500+0000 7f81fa7d6740 1 --2- 172.21.15.131:0/1216733583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x564396ce4a00 0x564396d290a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.500+0000 7f81fa7d6740 1 -- 172.21.15.131:0/1216733583 >> 172.21.15.131:0/1216733583 conn(0x564396ce32a0 msgr2=0x564396ce2740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:19.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.500+0000 7f81fa7d6740 1 -- 172.21.15.131:0/1216733583 shutdown_connections 2024-04-12T19:39:19.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.500+0000 7f81fa7d6740 1 -- 172.21.15.131:0/1216733583 wait complete. 2024-04-12T19:39:19.503 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.500+0000 7f81fa7d6740 20 client.4395 trim_cache size 0 max 16384 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout: "cluster_fsid": "7d934d91-9372-4a63-bf09-7016009c45b3", 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout: "whoami": 0, 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4257, 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout: "want_state": "up:active", 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout: "state": "up:active", 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs", 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout: "rank_uptime": 8.0487850170000002, 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout: "mdsmap_epoch": 6, 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch": 26, 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch_barrier": 24, 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout: "uptime": 15.269031789 2024-04-12T19:39:19.504 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-12T19:39:19.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.501+0000 7f81f7800640 1 -- 172.21.15.131:0/2986572489 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f81cc06c8f0 msgr2=0x7f81cc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.501+0000 7f81f7800640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f81cc06c8f0 0x7f81cc06edb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f81d8036000 tx=0x7f81d8008030 comp rx=0 tx=0).stop 2024-04-12T19:39:19.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.501+0000 7f81f7800640 1 -- 172.21.15.131:0/2986572489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f0073840 msgr2=0x7f81f01dc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.501+0000 7f81f7800640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f0073840 0x7f81f01dc5f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f81e000e9b0 tx=0x7f81e000ee70 comp rx=0 tx=0).stop 2024-04-12T19:39:19.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.501+0000 7f81f7800640 1 -- 172.21.15.131:0/2986572489 shutdown_connections 2024-04-12T19:39:19.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.501+0000 7f81f7800640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f81cc06c8f0 0x7f81cc06edb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.501+0000 7f81f7800640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81f00bf720 0x7f81f00bb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.501+0000 7f81f7800640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81f00a4f80 0x7f81f00baf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.501+0000 7f81f7800640 1 --2- 172.21.15.131:0/2986572489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81f0073840 0x7f81f01dc5f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.501+0000 7f81f7800640 1 -- 172.21.15.131:0/2986572489 >> 172.21.15.131:0/2986572489 conn(0x7f81f006be00 msgr2=0x7f81f006ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:19.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.501+0000 7f81f7800640 1 -- 172.21.15.131:0/2986572489 shutdown_connections 2024-04-12T19:39:19.506 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.501+0000 7f81f7800640 1 -- 172.21.15.131:0/2986572489 wait complete. 2024-04-12T19:39:19.520 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-12T19:39:19.520 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-12T19:39:19.520 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-12T19:39:19.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.721+0000 7f7a13800640 1 Processor -- start 2024-04-12T19:39:19.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.721+0000 7f7a13800640 1 -- start start 2024-04-12T19:39:19.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.722+0000 7f7a13800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7a0c0c0920 0x7f7a0c154630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.722+0000 7f7a13800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0c070bc0 0x7f7a0c0c0d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.722+0000 7f7a13800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a0c071220 con 0x7f7a0c151d10 2024-04-12T19:39:19.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.722+0000 7f7a13800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7a0c154b70 con 0x7f7a0c0c0920 2024-04-12T19:39:19.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.722+0000 7f7a13800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a0c151230 con 0x7f7a0c070bc0 2024-04-12T19:39:19.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.723+0000 7f7a0be00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0c070bc0 0x7f7a0c0c0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.723+0000 7f7a0be00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0c070bc0 0x7f7a0c0c0d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:49254/0 (socket says 172.21.15.131:49254) 2024-04-12T19:39:19.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.723+0000 7f7a0be00640 1 -- 172.21.15.131:0/1258342698 learned_addr learned my addr 172.21.15.131:0/1258342698 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:19.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.723+0000 7f7a10e00640 1 --2- 172.21.15.131:0/1258342698 >> v2:172.21.15.171:3300/0 conn(0x7f7a0c0c0920 0x7f7a0c154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.724+0000 7f7a0be00640 1 -- 172.21.15.131:0/1258342698 >> v2:172.21.15.171:3300/0 conn(0x7f7a0c0c0920 msgr2=0x7f7a0c154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:19.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.724+0000 7f7a0be00640 1 --2- 172.21.15.131:0/1258342698 >> v2:172.21.15.171:3300/0 conn(0x7f7a0c0c0920 0x7f7a0c154630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.724+0000 7f7a0be00640 1 -- 172.21.15.131:0/1258342698 >> v1:172.21.15.171:6789/0 conn(0x7f7a0c151d10 legacy=0x7f7a0c0c1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.724+0000 7f7a0be00640 1 -- 172.21.15.131:0/1258342698 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0c151510 con 0x7f7a0c070bc0 2024-04-12T19:39:19.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.725+0000 7f7a0be00640 1 --2- 172.21.15.131:0/1258342698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0c070bc0 0x7f7a0c0c0d00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009e50 tx=0x7f79f402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=18b1a4640a790be3 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:19.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.726+0000 7f7a0b400640 1 -- 172.21.15.131:0/1258342698 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f402cb00 con 0x7f7a0c070bc0 2024-04-12T19:39:19.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.726+0000 7f7a0b400640 1 -- 172.21.15.131:0/1258342698 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79f402cca0 con 0x7f7a0c070bc0 2024-04-12T19:39:19.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.726+0000 7f7a0b400640 1 -- 172.21.15.131:0/1258342698 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79f4034610 con 0x7f7a0c070bc0 2024-04-12T19:39:19.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.726+0000 7f7a13800640 1 -- 172.21.15.131:0/1258342698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0c070bc0 msgr2=0x7f7a0c0c0d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.726+0000 7f7a13800640 1 --2- 172.21.15.131:0/1258342698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0c070bc0 0x7f7a0c0c0d00 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f79f4009e50 tx=0x7f79f402bf60 comp rx=0 tx=0).stop 2024-04-12T19:39:19.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.727+0000 7f7a13800640 1 -- 172.21.15.131:0/1258342698 shutdown_connections 2024-04-12T19:39:19.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.727+0000 7f7a13800640 1 --2- 172.21.15.131:0/1258342698 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0c070bc0 0x7f7a0c0c0d00 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.727+0000 7f7a13800640 1 --2- 172.21.15.131:0/1258342698 >> v2:172.21.15.171:3300/0 conn(0x7f7a0c0c0920 0x7f7a0c154630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.727+0000 7f7a13800640 1 -- 172.21.15.131:0/1258342698 >> 172.21.15.131:0/1258342698 conn(0x7f7a0c06f410 msgr2=0x7f7a0c06f7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:19.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.727+0000 7f7a13800640 1 -- 172.21.15.131:0/1258342698 shutdown_connections 2024-04-12T19:39:19.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.727+0000 7f7a13800640 1 -- 172.21.15.131:0/1258342698 wait complete. 2024-04-12T19:39:19.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.728+0000 7f7a13800640 1 Processor -- start 2024-04-12T19:39:19.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.728+0000 7f7a13800640 1 -- start start 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.729+0000 7f7a13800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a0c070bc0 0x7f7a0c145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.729+0000 7f7a13800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0c0c0920 0x7f7a0c0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.729+0000 7f7a13800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a0c151d10 0x7f7a0c0c46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.729+0000 7f7a13800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c070560 con 0x7f7a0c070bc0 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.729+0000 7f7a13800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7a0c0703e0 con 0x7f7a0c151d10 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.729+0000 7f7a13800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7a0c06e7f0 con 0x7f7a0c0c0920 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.729+0000 7f7a10e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a0c070bc0 0x7f7a0c145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.730+0000 7f7a10e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a0c070bc0 0x7f7a0c145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40204/0 (socket says 172.21.15.131:40204) 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.730+0000 7f7a10e00640 1 -- 172.21.15.131:0/24574355 learned_addr learned my addr 172.21.15.131:0/24574355 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.730+0000 7f7a0be00640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0c0c0920 0x7f7a0c0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.730+0000 7f7a11800640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a0c151d10 0x7f7a0c0c46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.730+0000 7f7a10e00640 1 -- 172.21.15.131:0/24574355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0c0c0920 msgr2=0x7f7a0c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.730+0000 7f7a10e00640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0c0c0920 0x7f7a0c0c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.730+0000 7f7a10e00640 1 -- 172.21.15.131:0/24574355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a0c151d10 msgr2=0x7f7a0c0c46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.730+0000 7f7a10e00640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a0c151d10 0x7f7a0c0c46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.730+0000 7f7a10e00640 1 -- 172.21.15.131:0/24574355 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a0c145d40 con 0x7f7a0c070bc0 2024-04-12T19:39:19.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.730+0000 7f7a10e00640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a0c070bc0 0x7f7a0c145800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00e9b0 tx=0x7f79fc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:19.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.731+0000 7f7a08c00640 1 -- 172.21.15.131:0/24574355 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc017070 con 0x7f7a0c070bc0 2024-04-12T19:39:19.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.731+0000 7f7a08c00640 1 -- 172.21.15.131:0/24574355 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79fc00c9a0 con 0x7f7a0c070bc0 2024-04-12T19:39:19.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.731+0000 7f7a13800640 1 -- 172.21.15.131:0/24574355 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a0c1462b0 con 0x7f7a0c070bc0 2024-04-12T19:39:19.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.731+0000 7f7a08c00640 1 -- 172.21.15.131:0/24574355 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79fc00cd90 con 0x7f7a0c070bc0 2024-04-12T19:39:19.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.731+0000 7f7a13800640 1 -- 172.21.15.131:0/24574355 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a0c0c2a80 con 0x7f7a0c070bc0 2024-04-12T19:39:19.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.732+0000 7f7a13800640 1 -- 172.21.15.131:0/24574355 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a0c0c25d0 con 0x7f7a0c070bc0 2024-04-12T19:39:19.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.733+0000 7f7a08c00640 1 -- 172.21.15.131:0/24574355 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f79fc01a070 con 0x7f7a0c070bc0 2024-04-12T19:39:19.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.734+0000 7f7a08c00640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f79e806c8f0 0x7f79e806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:19.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.734+0000 7f7a08c00640 1 -- 172.21.15.131:0/24574355 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f79fc08beb0 con 0x7f7a0c070bc0 2024-04-12T19:39:19.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.734+0000 7f7a0be00640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f79e806c8f0 0x7f79e806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:19.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.735+0000 7f7a0be00640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f79e806c8f0 0x7f79e806edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79f4035000 tx=0x7f79f4030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:19.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.738+0000 7f7a08c00640 1 -- 172.21.15.131:0/24574355 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f79fc059f90 con 0x7f7a0c070bc0 2024-04-12T19:39:19.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.987+0000 7f7a13800640 1 -- 172.21.15.131:0/24574355 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7a0c04fd50 con 0x7f7a0c070bc0 2024-04-12T19:39:19.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.988+0000 7f7a08c00640 1 -- 172.21.15.131:0/24574355 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f79fc059890 con 0x7f7a0c070bc0 2024-04-12T19:39:19.989 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-12T19:39:19.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.991+0000 7f7a13800640 1 -- 172.21.15.131:0/24574355 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f79e806c8f0 msgr2=0x7f79e806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.991+0000 7f7a13800640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f79e806c8f0 0x7f79e806edb0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f79f4035000 tx=0x7f79f4030000 comp rx=0 tx=0).stop 2024-04-12T19:39:19.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.991+0000 7f7a13800640 1 -- 172.21.15.131:0/24574355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a0c070bc0 msgr2=0x7f7a0c145800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:19.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.991+0000 7f7a13800640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a0c070bc0 0x7f7a0c145800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f79fc00e9b0 tx=0x7f79fc00ee70 comp rx=0 tx=0).stop 2024-04-12T19:39:19.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.991+0000 7f7a13800640 1 -- 172.21.15.131:0/24574355 shutdown_connections 2024-04-12T19:39:19.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.991+0000 7f7a13800640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f79e806c8f0 0x7f79e806edb0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.991+0000 7f7a13800640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7a0c151d10 0x7f7a0c0c46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.991+0000 7f7a13800640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7a0c0c0920 0x7f7a0c0c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.991+0000 7f7a13800640 1 --2- 172.21.15.131:0/24574355 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7a0c070bc0 0x7f7a0c145800 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:19.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.991+0000 7f7a13800640 1 -- 172.21.15.131:0/24574355 >> 172.21.15.131:0/24574355 conn(0x7f7a0c06f410 msgr2=0x7f7a0c153090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:19.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.991+0000 7f7a13800640 1 -- 172.21.15.131:0/24574355 shutdown_connections 2024-04-12T19:39:19.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:19.992+0000 7f7a13800640 1 -- 172.21.15.131:0/24574355 wait complete. 2024-04-12T19:39:20.017 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-12T19:39:20.017 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-12T19:39:20.017 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-04-12T19:39:20.017 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-12T19:39:20.017 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-12T19:39:20.018 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-12T19:39:20.018 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-12T19:39:20.018 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-12T19:39:20.018 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-12T19:39:20.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:20.018 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-04-12T19:39:20.071 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-12T19:39:20.071 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-12T19:39:20.071 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-04-12T19:39:20.071 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42501sec preferred_lft 42501sec 2024-04-12T19:39:20.072 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-04-12T19:39:20.073 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-12T19:39:20.074 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-12T19:39:20.074 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T19:39:20.074 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-12T19:39:20.074 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add name ceph-brx type bridge 2024-04-12T19:39:20.074 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr flush dev ceph-brx 2024-04-12T19:39:20.074 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set ceph-brx up 2024-04-12T19:39:20.074 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-12T19:39:20.074 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-12T19:39:20.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T19:39:20.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:20.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:20.583 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-12T19:39:20.658 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-04-12T19:39:20.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:20.662 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-04-12T19:39:20.715 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-04-12T19:39:20.715 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-12T19:39:20.715 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-12T19:39:20.715 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-12T19:39:20.715 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-12T19:39:20.715 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T19:39:20.716 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-12T19:39:20.716 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-12T19:39:20.716 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-12T19:39:20.716 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-12T19:39:20.716 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-12T19:39:20.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T19:39:21.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:21.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:21.546 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-04-12T19:39:21.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:21.598 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-04-12T19:39:21.650 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T19:39:21.651 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-12T19:39:21.651 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-12T19:39:21.651 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-12T19:39:21.651 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-12T19:39:21.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T19:39:21.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:21.848 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-12T19:39:21.849 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T19:39:21.849 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-12T19:39:21.849 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-12T19:39:21.849 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-12T19:39:21.849 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-12T19:39:21.849 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-12T19:39:21.849 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-12T19:39:21.849 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-12T19:39:21.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:21 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T19:39:22.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:22.177 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T19:39:22.177 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-12T19:39:22.177 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2024-04-12T19:39:22.177 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.0 master ceph-brx 2024-04-12T19:39:22.177 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-12T19:39:22.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:22 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T19:39:22.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:22 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:22.404 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-12T19:39:22.404 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-12T19:39:22.404 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-12T19:39:22.451 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-12T19:39:22.451 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-12T19:39:22.451 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-12T19:39:22.541 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-04-12T19:39:22.633 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T19:39:22.687 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-04-12T19:39:22.687 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-04-12T19:39:22.687 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-04-12T19:39:22.687 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-04-12T19:39:22.687 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/selinux 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-04-12T19:39:22.688 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-0 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-1 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-2 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-3 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-12T19:39:22.689 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-12T19:39:22.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:22.690 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-04-12T19:39:22.740 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-12T19:39:22.741 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-12T19:39:22.787 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-04-12T19:39:22.869 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T19:39:22.910 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-04-12T19:39:22.910 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/selinux 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-04-12T19:39:22.911 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-0 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-1 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-2 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-3 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-12T19:39:22.912 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-12T19:39:22.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:22.913 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-04-12T19:39:22.982 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi131.stderr:2024-04-12T19:39:22.980+0000 7f5d7bc42480 -1 init, newargv = 0x55ed10e7aa30 newargc=15 2024-04-12T19:39:22.982 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi131.stderr:ceph-fuse[42102]: starting ceph client 2024-04-12T19:39:22.994 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi131.stderr:ceph-fuse[42102]: starting fuse 2024-04-12T19:39:22.999 INFO:teuthology.orchestra.run.smithi131.stdout:43 2024-04-12T19:39:22.999 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-12T19:39:22.999 DEBUG:teuthology.orchestra.run.smithi131:> sudo stdin-killer -- python3 -c ' 2024-04-12T19:39:22.999 DEBUG:teuthology.orchestra.run.smithi131:> import glob 2024-04-12T19:39:22.999 DEBUG:teuthology.orchestra.run.smithi131:> import re 2024-04-12T19:39:22.999 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-12T19:39:22.999 DEBUG:teuthology.orchestra.run.smithi131:> import subprocess 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> def _find_admin_socket(client_name): 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> files = glob.glob(asok_path) 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> # Given a non-glob path, it better be there 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> if "*" not in asok_path: 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> assert(len(files) == 1) 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> return files[0] 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> for f in files: 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> contents = proc_f.read() 2024-04-12T19:39:23.000 DEBUG:teuthology.orchestra.run.smithi131:> if mountpoint in contents: 2024-04-12T19:39:23.001 DEBUG:teuthology.orchestra.run.smithi131:> return f 2024-04-12T19:39:23.001 DEBUG:teuthology.orchestra.run.smithi131:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-12T19:39:23.001 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-12T19:39:23.001 DEBUG:teuthology.orchestra.run.smithi131:> print(_find_admin_socket("client.admin")) 2024-04-12T19:39:23.001 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-12T19:39:23.191 INFO:teuthology.orchestra.run.smithi131.stdout:/var/run/ceph/ceph-client.admin.42102.asok 2024-04-12T19:39:23.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:23.208 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.42102.asok 2024-04-12T19:39:23.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:23.208 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.42102.asok status 2024-04-12T19:39:23.442 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-12T19:39:23.442 INFO:teuthology.orchestra.run.smithi131.stdout: "metadata": { 2024-04-12T19:39:23.442 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_sha1": "324baf8ddb91dea46cac50cb535c306115791355", 2024-04-12T19:39:23.442 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev)", 2024-04-12T19:39:23.442 INFO:teuthology.orchestra.run.smithi131.stdout: "entity_id": "admin", 2024-04-12T19:39:23.442 INFO:teuthology.orchestra.run.smithi131.stdout: "hostname": "smithi131", 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "pid": "42102", 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "root": "/" 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_count": 0, 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_pinned_count": 0, 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4407, 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "inst": { 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "name": { 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "client", 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "num": 4407 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-04-12T19:39:23.443 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 1138991064 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 1138991064 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: "inst_str": "client.4407 192.168.0.1:0/1138991064", 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: "addr_str": "192.168.0.1:0/1138991064", 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: "inode_count": 1, 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_epoch": 6, 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch": 26, 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch_barrier": 0, 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: "blocklisted": false, 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs" 2024-04-12T19:39:23.444 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-12T19:39:23.457 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:23.457 DEBUG:teuthology.orchestra.run.smithi131:> stat --file-system '--printf=%T 2024-04-12T19:39:23.457 DEBUG:teuthology.orchestra.run.smithi131:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-12T19:39:23.509 INFO:teuthology.orchestra.run.smithi131.stdout:fuseblk 2024-04-12T19:39:23.509 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-12T19:39:23.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:23.509 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-12T19:39:23.600 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-12T19:39:23.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:23 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-12T19:39:23.750 INFO:teuthology.orchestra.run.smithi131.stdout:# file: . 2024-04-12T19:39:23.750 INFO:teuthology.orchestra.run.smithi131.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-12T19:39:23.750 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:23.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:23.761 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:39:23.761 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T19:39:23.813 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:24.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.022+0000 7f055ac00640 1 Processor -- start 2024-04-12T19:39:24.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.022+0000 7f055ac00640 1 -- start start 2024-04-12T19:39:24.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.024+0000 7f055ac00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0554158c00 0x7f0554158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.024+0000 7f055ac00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05540a4cd0 0x7f05540b8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.024+0000 7f055ac00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0554159620 con 0x7f055406f520 2024-04-12T19:39:24.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.024+0000 7f055ac00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f055414fd40 con 0x7f0554158c00 2024-04-12T19:39:24.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.024+0000 7f055ac00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0554159900 con 0x7f05540a4cd0 2024-04-12T19:39:24.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.024+0000 7f054b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05540a4cd0 0x7f05540b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.024+0000 7f0558c00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f055406f520 0x7f0554155610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.131:50260/0 (socket says 172.21.15.131:50260) 2024-04-12T19:39:24.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.024+0000 7f0558c00640 1 -- 172.21.15.131:0/2953179337 learned_addr learned my addr 172.21.15.131:0/2953179337 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:24.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.024+0000 7f0553e00640 1 --2- 172.21.15.131:0/2953179337 >> v2:172.21.15.171:3300/0 conn(0x7f0554158c00 0x7f0554158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.024+0000 7f054b400640 1 -- 172.21.15.131:0/2953179337 >> v2:172.21.15.171:3300/0 conn(0x7f0554158c00 msgr2=0x7f0554158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:24.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.024+0000 7f054b400640 1 --2- 172.21.15.131:0/2953179337 >> v2:172.21.15.171:3300/0 conn(0x7f0554158c00 0x7f0554158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.025+0000 7f054b400640 1 -- 172.21.15.131:0/2953179337 >> v1:172.21.15.171:6789/0 conn(0x7f055406f520 legacy=0x7f0554155610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.025+0000 7f054b400640 1 -- 172.21.15.131:0/2953179337 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05540b8e40 con 0x7f05540a4cd0 2024-04-12T19:39:24.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.025+0000 7f0553400640 1 -- 172.21.15.131:0/2953179337 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3308742357 0 0) 0x7f0554159620 con 0x7f055406f520 2024-04-12T19:39:24.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.026+0000 7f054b400640 1 --2- 172.21.15.131:0/2953179337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05540a4cd0 0x7f05540b8050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f053c009d90 tx=0x7f053c02beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b908b3e170932eac server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:24.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.026+0000 7f0553400640 1 -- 172.21.15.131:0/2953179337 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c039070 con 0x7f05540a4cd0 2024-04-12T19:39:24.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.026+0000 7f0553400640 1 -- 172.21.15.131:0/2953179337 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f053c02cc60 con 0x7f05540a4cd0 2024-04-12T19:39:24.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.026+0000 7f0553400640 1 -- 172.21.15.131:0/2953179337 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f053c034660 con 0x7f05540a4cd0 2024-04-12T19:39:24.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.027+0000 7f055ac00640 1 -- 172.21.15.131:0/2953179337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05540a4cd0 msgr2=0x7f05540b8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.027+0000 7f055ac00640 1 --2- 172.21.15.131:0/2953179337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05540a4cd0 0x7f05540b8050 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f053c009d90 tx=0x7f053c02beb0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.027+0000 7f055ac00640 1 -- 172.21.15.131:0/2953179337 shutdown_connections 2024-04-12T19:39:24.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.027+0000 7f055ac00640 1 --2- 172.21.15.131:0/2953179337 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05540a4cd0 0x7f05540b8050 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.027+0000 7f055ac00640 1 --2- 172.21.15.131:0/2953179337 >> v2:172.21.15.171:3300/0 conn(0x7f0554158c00 0x7f0554158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.027+0000 7f055ac00640 1 -- 172.21.15.131:0/2953179337 >> 172.21.15.131:0/2953179337 conn(0x7f05540c2590 msgr2=0x7f05540c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:24.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.027+0000 7f055ac00640 1 -- 172.21.15.131:0/2953179337 shutdown_connections 2024-04-12T19:39:24.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.027+0000 7f055ac00640 1 -- 172.21.15.131:0/2953179337 wait complete. 2024-04-12T19:39:24.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.029+0000 7f055ac00640 1 Processor -- start 2024-04-12T19:39:24.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.029+0000 7f055ac00640 1 -- start start 2024-04-12T19:39:24.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.030+0000 7f055ac00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f055406f520 0x7f055414e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.030+0000 7f055ac00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05540a4cd0 0x7f05541eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.030+0000 7f055ac00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0554158c00 0x7f05541ef430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.030+0000 7f055ac00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f05540becf0 con 0x7f0554158c00 2024-04-12T19:39:24.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.030+0000 7f055ac00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0554073e80 con 0x7f055406f520 2024-04-12T19:39:24.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.030+0000 7f055ac00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f05540bee70 con 0x7f05540a4cd0 2024-04-12T19:39:24.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.030+0000 7f0558c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0554158c00 0x7f05541ef430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.030+0000 7f0558c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0554158c00 0x7f05541ef430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44546/0 (socket says 172.21.15.131:44546) 2024-04-12T19:39:24.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.030+0000 7f0558c00640 1 -- 172.21.15.131:0/1836367175 learned_addr learned my addr 172.21.15.131:0/1836367175 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:24.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.031+0000 7f0553e00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f055406f520 0x7f055414e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.031+0000 7f054b400640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05540a4cd0 0x7f05541eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.031+0000 7f0558c00640 1 -- 172.21.15.131:0/1836367175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05540a4cd0 msgr2=0x7f05541eeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.031+0000 7f0558c00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05540a4cd0 0x7f05541eeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.031+0000 7f0558c00640 1 -- 172.21.15.131:0/1836367175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f055406f520 msgr2=0x7f055414e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.031+0000 7f0558c00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f055406f520 0x7f055414e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.031+0000 7f0558c00640 1 -- 172.21.15.131:0/1836367175 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f055414ece0 con 0x7f0554158c00 2024-04-12T19:39:24.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.031+0000 7f0553e00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f055406f520 0x7f055414e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:24.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.031+0000 7f0558c00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0554158c00 0x7f05541ef430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c3f0 tx=0x7f054c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:24.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.031+0000 7f0550c00640 1 -- 172.21.15.131:0/1836367175 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c0074e0 con 0x7f0554158c00 2024-04-12T19:39:24.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.031+0000 7f0550c00640 1 -- 172.21.15.131:0/1836367175 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f054c0047e0 con 0x7f0554158c00 2024-04-12T19:39:24.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.032+0000 7f0550c00640 1 -- 172.21.15.131:0/1836367175 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f054c004bd0 con 0x7f0554158c00 2024-04-12T19:39:24.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.032+0000 7f055ac00640 1 -- 172.21.15.131:0/1836367175 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05541dedd0 con 0x7f0554158c00 2024-04-12T19:39:24.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.032+0000 7f055ac00640 1 -- 172.21.15.131:0/1836367175 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05540b9ee0 con 0x7f0554158c00 2024-04-12T19:39:24.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.033+0000 7f055ac00640 1 -- 172.21.15.131:0/1836367175 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05540b9a30 con 0x7f0554158c00 2024-04-12T19:39:24.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.034+0000 7f0550c00640 1 -- 172.21.15.131:0/1836367175 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f054c011070 con 0x7f0554158c00 2024-04-12T19:39:24.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.035+0000 7f0550c00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f053006c8f0 0x7f053006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.035+0000 7f0550c00640 1 -- 172.21.15.131:0/1836367175 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f054c08ba20 con 0x7f0554158c00 2024-04-12T19:39:24.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.035+0000 7f0553e00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f053006c8f0 0x7f053006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.036+0000 7f0553e00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f053006c8f0 0x7f053006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0544009a20 tx=0x7f0544008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:24.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.040+0000 7f0550c00640 1 -- 172.21.15.131:0/1836367175 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f054c059b00 con 0x7f0554158c00 2024-04-12T19:39:24.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.246+0000 7f055ac00640 1 -- 172.21.15.131:0/1836367175 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f05540bffa0 con 0x7f0554158c00 2024-04-12T19:39:24.250 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.249+0000 7f0550c00640 1 -- 172.21.15.131:0/1836367175 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f05540bffa0 con 0x7f0554158c00 2024-04-12T19:39:24.251 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:24.251 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":26,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:17.479662+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:24.252 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.252+0000 7f055ac00640 1 -- 172.21.15.131:0/1836367175 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f053006c8f0 msgr2=0x7f053006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.252+0000 7f055ac00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f053006c8f0 0x7f053006edb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0544009a20 tx=0x7f0544008040 comp rx=0 tx=0).stop 2024-04-12T19:39:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.252+0000 7f055ac00640 1 -- 172.21.15.131:0/1836367175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0554158c00 msgr2=0x7f05541ef430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.252+0000 7f055ac00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0554158c00 0x7f05541ef430 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f054c00c3f0 tx=0x7f054c00c8b0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.252+0000 7f055ac00640 1 -- 172.21.15.131:0/1836367175 shutdown_connections 2024-04-12T19:39:24.253 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.252+0000 7f055ac00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f053006c8f0 0x7f053006edb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.252+0000 7f055ac00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0554158c00 0x7f05541ef430 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.252+0000 7f055ac00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f05540a4cd0 0x7f05541eeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.252+0000 7f055ac00640 1 --2- 172.21.15.131:0/1836367175 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f055406f520 0x7f055414e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.252+0000 7f055ac00640 1 -- 172.21.15.131:0/1836367175 >> 172.21.15.131:0/1836367175 conn(0x7f05540c2590 msgr2=0x7f05540c1970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:24.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.252+0000 7f055ac00640 1 -- 172.21.15.131:0/1836367175 shutdown_connections 2024-04-12T19:39:24.254 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.252+0000 7f055ac00640 1 -- 172.21.15.131:0/1836367175 wait complete. 2024-04-12T19:39:24.271 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T19:39:04.855067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-12T19:39:09.370965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-12T19:39:09.858079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-12T19:39:13.479306+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-12T19:39:24.271 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T19:39:24.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.486+0000 7fa61ca00640 1 Processor -- start 2024-04-12T19:39:24.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.486+0000 7fa61ca00640 1 -- start start 2024-04-12T19:39:24.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.486+0000 7fa61ca00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6180be030 0x7fa6181510b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.486+0000 7fa61ca00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6180a7410 con 0x7fa618147fb0 2024-04-12T19:39:24.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.486+0000 7fa61ca00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa61806d3d0 con 0x7fa6181515f0 2024-04-12T19:39:24.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.486+0000 7fa61ca00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa6180be9f0 con 0x7fa6180be030 2024-04-12T19:39:24.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.487+0000 7fa617400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa618147fb0 0x7fa61806f010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60102/0 (socket says 172.21.15.131:60102) 2024-04-12T19:39:24.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.487+0000 7fa617400640 1 -- 172.21.15.131:0/918685646 learned_addr learned my addr 172.21.15.131:0/918685646 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:24.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.487+0000 7fa616a00640 1 --2- 172.21.15.131:0/918685646 >> v2:172.21.15.131:3300/0 conn(0x7fa6180be030 0x7fa6181510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.487+0000 7fa616000640 1 -- 172.21.15.131:0/918685646 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960138844 0 0) 0x7fa6180a7410 con 0x7fa618147fb0 2024-04-12T19:39:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.487+0000 7fa616000640 1 -- 172.21.15.131:0/918685646 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5fc003520 con 0x7fa618147fb0 2024-04-12T19:39:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.487+0000 7fa616a00640 1 -- 172.21.15.131:0/918685646 >> v1:172.21.15.171:6789/0 conn(0x7fa6181515f0 legacy=0x7fa618158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.487+0000 7fa616a00640 1 -- 172.21.15.131:0/918685646 >> v1:172.21.15.131:6789/0 conn(0x7fa618147fb0 legacy=0x7fa61806f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.487+0000 7fa616a00640 1 -- 172.21.15.131:0/918685646 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6180a7680 con 0x7fa6180be030 2024-04-12T19:39:24.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.489+0000 7fa616a00640 1 --2- 172.21.15.131:0/918685646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6180be030 0x7fa6181510b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa6040097a0 tx=0x7fa60402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bd8f9f514a34cdf server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:24.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.489+0000 7fa616000640 1 -- 172.21.15.131:0/918685646 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604035020 con 0x7fa6180be030 2024-04-12T19:39:24.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.489+0000 7fa616000640 1 -- 172.21.15.131:0/918685646 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa604031830 con 0x7fa6180be030 2024-04-12T19:39:24.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.489+0000 7fa616000640 1 -- 172.21.15.131:0/918685646 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604031c00 con 0x7fa6180be030 2024-04-12T19:39:24.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.489+0000 7fa61ca00640 1 -- 172.21.15.131:0/918685646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6180be030 msgr2=0x7fa6181510b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.489+0000 7fa61ca00640 1 --2- 172.21.15.131:0/918685646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6180be030 0x7fa6181510b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa6040097a0 tx=0x7fa60402b8d0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.491+0000 7fa61ca00640 1 -- 172.21.15.131:0/918685646 shutdown_connections 2024-04-12T19:39:24.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.491+0000 7fa61ca00640 1 --2- 172.21.15.131:0/918685646 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6180be030 0x7fa6181510b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.491+0000 7fa61ca00640 1 -- 172.21.15.131:0/918685646 >> 172.21.15.131:0/918685646 conn(0x7fa61806b9e0 msgr2=0x7fa61806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:24.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.491+0000 7fa61ca00640 1 -- 172.21.15.131:0/918685646 shutdown_connections 2024-04-12T19:39:24.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.491+0000 7fa61ca00640 1 -- 172.21.15.131:0/918685646 wait complete. 2024-04-12T19:39:24.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.492+0000 7fa61ca00640 1 Processor -- start 2024-04-12T19:39:24.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.492+0000 7fa61ca00640 1 -- start start 2024-04-12T19:39:24.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.493+0000 7fa61ca00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6180be030 0x7fa61813f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.493+0000 7fa61ca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa618147fb0 0x7fa61814f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.493+0000 7fa61ca00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6181515f0 0x7fa6180bd0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.493+0000 7fa61ca00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa61806c980 con 0x7fa618147fb0 2024-04-12T19:39:24.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.493+0000 7fa61ca00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa6180a7c40 con 0x7fa6181515f0 2024-04-12T19:39:24.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.493+0000 7fa61ca00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa61806f720 con 0x7fa6180be030 2024-04-12T19:39:24.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.493+0000 7fa616a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa618147fb0 0x7fa61814f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.493+0000 7fa616a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa618147fb0 0x7fa61814f640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44568/0 (socket says 172.21.15.131:44568) 2024-04-12T19:39:24.494 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.493+0000 7fa616a00640 1 -- 172.21.15.131:0/1297293969 learned_addr learned my addr 172.21.15.131:0/1297293969 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:24.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.494+0000 7fa617400640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6180be030 0x7fa61813f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.494+0000 7fa616a00640 1 -- 172.21.15.131:0/1297293969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6180be030 msgr2=0x7fa61813f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.494+0000 7fa617e00640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6181515f0 0x7fa6180bd0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.494+0000 7fa616a00640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6180be030 0x7fa61813f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.495 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.494+0000 7fa616a00640 1 -- 172.21.15.131:0/1297293969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6181515f0 msgr2=0x7fa6180bd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.494+0000 7fa616a00640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6181515f0 0x7fa6180bd0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.494+0000 7fa616a00640 1 -- 172.21.15.131:0/1297293969 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6181e4f30 con 0x7fa618147fb0 2024-04-12T19:39:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.494+0000 7fa616a00640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa618147fb0 0x7fa61814f640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa604009890 tx=0x7fa6040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.494+0000 7fa60f400640 1 -- 172.21.15.131:0/1297293969 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa604035040 con 0x7fa618147fb0 2024-04-12T19:39:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.495+0000 7fa60f400640 1 -- 172.21.15.131:0/1297293969 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa60403b920 con 0x7fa618147fb0 2024-04-12T19:39:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.495+0000 7fa60f400640 1 -- 172.21.15.131:0/1297293969 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa60403bd10 con 0x7fa618147fb0 2024-04-12T19:39:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.495+0000 7fa61ca00640 1 -- 172.21.15.131:0/1297293969 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6181e5210 con 0x7fa618147fb0 2024-04-12T19:39:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.495+0000 7fa61ca00640 1 -- 172.21.15.131:0/1297293969 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6180ba730 con 0x7fa618147fb0 2024-04-12T19:39:24.496 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.495+0000 7fa61ca00640 1 -- 172.21.15.131:0/1297293969 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa61804fd50 con 0x7fa618147fb0 2024-04-12T19:39:24.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.496+0000 7fa60f400640 1 -- 172.21.15.131:0/1297293969 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa604038020 con 0x7fa618147fb0 2024-04-12T19:39:24.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.496+0000 7fa60f400640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa5f806c8f0 0x7fa5f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.497 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.498+0000 7fa60f400640 1 -- 172.21.15.131:0/1297293969 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa6040adf10 con 0x7fa618147fb0 2024-04-12T19:39:24.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.498+0000 7fa617400640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa5f806c8f0 0x7fa5f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.498 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.498+0000 7fa617400640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa5f806c8f0 0x7fa5f806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa608000f60 tx=0x7fa608009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:24.502 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.503+0000 7fa60f400640 1 -- 172.21.15.131:0/1297293969 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa604044380 con 0x7fa618147fb0 2024-04-12T19:39:24.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.704+0000 7fa61ca00640 1 -- 172.21.15.131:0/1297293969 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa61813fe70 con 0x7fa618147fb0 2024-04-12T19:39:24.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.705+0000 7fa60f400640 1 -- 172.21.15.131:0/1297293969 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fa604031800 con 0x7fa618147fb0 2024-04-12T19:39:24.705 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-12T19:39:24.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.708+0000 7fa61ca00640 1 -- 172.21.15.131:0/1297293969 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa5f806c8f0 msgr2=0x7fa5f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.708+0000 7fa61ca00640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa5f806c8f0 0x7fa5f806edb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fa608000f60 tx=0x7fa608009040 comp rx=0 tx=0).stop 2024-04-12T19:39:24.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.708+0000 7fa61ca00640 1 -- 172.21.15.131:0/1297293969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa618147fb0 msgr2=0x7fa61814f640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.708+0000 7fa61ca00640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa618147fb0 0x7fa61814f640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa604009890 tx=0x7fa6040046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.708+0000 7fa61ca00640 1 -- 172.21.15.131:0/1297293969 shutdown_connections 2024-04-12T19:39:24.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.708+0000 7fa61ca00640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa5f806c8f0 0x7fa5f806edb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.708+0000 7fa61ca00640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6181515f0 0x7fa6180bd0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.708+0000 7fa61ca00640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa618147fb0 0x7fa61814f640 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.708+0000 7fa61ca00640 1 --2- 172.21.15.131:0/1297293969 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6180be030 0x7fa61813f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.708+0000 7fa61ca00640 1 -- 172.21.15.131:0/1297293969 >> 172.21.15.131:0/1297293969 conn(0x7fa61806b9e0 msgr2=0x7fa6181d70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:24.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.708+0000 7fa61ca00640 1 -- 172.21.15.131:0/1297293969 shutdown_connections 2024-04-12T19:39:24.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.708+0000 7fa61ca00640 1 -- 172.21.15.131:0/1297293969 wait complete. 2024-04-12T19:39:24.726 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-12T19:39:24.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.940+0000 7faa89000640 1 Processor -- start 2024-04-12T19:39:24.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.940+0000 7faa89000640 1 -- start start 2024-04-12T19:39:24.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.941+0000 7faa89000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840c17a0 0x7faa840c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa89000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa840c3900 0x7faa84151640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa89000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa840c5e80 con 0x7faa841511e0 2024-04-12T19:39:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa89000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7faa840c59f0 con 0x7faa840c3900 2024-04-12T19:39:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa89000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa840c4020 con 0x7faa840c17a0 2024-04-12T19:39:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa82800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa840c3900 0x7faa84151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa82800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa840c3900 0x7faa84151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44580/0 (socket says 172.21.15.131:44580) 2024-04-12T19:39:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa81400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7faa841511e0 0x7faa840c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60106/0 (socket says 172.21.15.131:60106) 2024-04-12T19:39:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa82800640 1 -- 172.21.15.131:0/355826479 learned_addr learned my addr 172.21.15.131:0/355826479 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa81e00640 1 --2- 172.21.15.131:0/355826479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840c17a0 0x7faa840c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa82800640 1 -- 172.21.15.131:0/355826479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840c17a0 msgr2=0x7faa840c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa82800640 1 --2- 172.21.15.131:0/355826479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840c17a0 0x7faa840c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa82800640 1 -- 172.21.15.131:0/355826479 >> v1:172.21.15.131:6789/0 conn(0x7faa841511e0 legacy=0x7faa840c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.942+0000 7faa82800640 1 -- 172.21.15.131:0/355826479 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa840c6260 con 0x7faa840c3900 2024-04-12T19:39:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.944+0000 7faa82800640 1 --2- 172.21.15.131:0/355826479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa840c3900 0x7faa84151640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009870 tx=0x7faa7c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6bcc0d4e9408bcc server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.944+0000 7faa80a00640 1 -- 172.21.15.131:0/355826479 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c034070 con 0x7faa840c3900 2024-04-12T19:39:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.944+0000 7faa80a00640 1 -- 172.21.15.131:0/355826479 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa7c030840 con 0x7faa840c3900 2024-04-12T19:39:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.944+0000 7faa80a00640 1 -- 172.21.15.131:0/355826479 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c030c10 con 0x7faa840c3900 2024-04-12T19:39:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.944+0000 7faa89000640 1 -- 172.21.15.131:0/355826479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa840c3900 msgr2=0x7faa84151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.944+0000 7faa89000640 1 --2- 172.21.15.131:0/355826479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa840c3900 0x7faa84151640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009870 tx=0x7faa7c02b980 comp rx=0 tx=0).stop 2024-04-12T19:39:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.945+0000 7faa89000640 1 -- 172.21.15.131:0/355826479 shutdown_connections 2024-04-12T19:39:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.945+0000 7faa89000640 1 --2- 172.21.15.131:0/355826479 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa840c3900 0x7faa84151640 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.945+0000 7faa89000640 1 --2- 172.21.15.131:0/355826479 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840c17a0 0x7faa840c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.945+0000 7faa89000640 1 -- 172.21.15.131:0/355826479 >> 172.21.15.131:0/355826479 conn(0x7faa840a8490 msgr2=0x7faa840a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.945+0000 7faa89000640 1 -- 172.21.15.131:0/355826479 shutdown_connections 2024-04-12T19:39:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.945+0000 7faa89000640 1 -- 172.21.15.131:0/355826479 wait complete. 2024-04-12T19:39:24.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.946+0000 7faa89000640 1 Processor -- start 2024-04-12T19:39:24.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.946+0000 7faa89000640 1 -- start start 2024-04-12T19:39:24.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.947+0000 7faa89000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa840c17a0 0x7faa840baf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.947+0000 7faa89000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840c3900 0x7faa8414d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.947+0000 7faa89000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa841511e0 0x7faa840b7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.947+0000 7faa89000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa840c48e0 con 0x7faa840c17a0 2024-04-12T19:39:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.947+0000 7faa89000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa840c4760 con 0x7faa841511e0 2024-04-12T19:39:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.947+0000 7faa89000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa840c1b80 con 0x7faa840c3900 2024-04-12T19:39:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.947+0000 7faa81e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa840c17a0 0x7faa840baf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.947+0000 7faa81e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa840c17a0 0x7faa840baf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44588/0 (socket says 172.21.15.131:44588) 2024-04-12T19:39:24.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.947+0000 7faa81e00640 1 -- 172.21.15.131:0/1046790983 learned_addr learned my addr 172.21.15.131:0/1046790983 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.948+0000 7faa81e00640 1 -- 172.21.15.131:0/1046790983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840c3900 msgr2=0x7faa8414d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.948+0000 7faa81e00640 1 --2- 172.21.15.131:0/1046790983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840c3900 0x7faa8414d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.948+0000 7faa81e00640 1 -- 172.21.15.131:0/1046790983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa841511e0 msgr2=0x7faa840b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.948+0000 7faa81e00640 1 --2- 172.21.15.131:0/1046790983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa841511e0 0x7faa840b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.948+0000 7faa81e00640 1 -- 172.21.15.131:0/1046790983 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa8414d2b0 con 0x7faa840c17a0 2024-04-12T19:39:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.948+0000 7faa81e00640 1 --2- 172.21.15.131:0/1046790983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa840c17a0 0x7faa840baf70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c7f0 tx=0x7faa7400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.948+0000 7faa7a000640 1 -- 172.21.15.131:0/1046790983 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74015070 con 0x7faa840c17a0 2024-04-12T19:39:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.948+0000 7faa7a000640 1 -- 172.21.15.131:0/1046790983 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa74004240 con 0x7faa840c17a0 2024-04-12T19:39:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.948+0000 7faa7a000640 1 -- 172.21.15.131:0/1046790983 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa74007620 con 0x7faa840c17a0 2024-04-12T19:39:24.951 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.948+0000 7faa89000640 1 -- 172.21.15.131:0/1046790983 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa8414c400 con 0x7faa840c17a0 2024-04-12T19:39:24.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.949+0000 7faa89000640 1 -- 172.21.15.131:0/1046790983 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa841e79a0 con 0x7faa840c17a0 2024-04-12T19:39:24.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.950+0000 7faa89000640 1 -- 172.21.15.131:0/1046790983 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa840c2170 con 0x7faa840c17a0 2024-04-12T19:39:24.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.951+0000 7faa7a000640 1 -- 172.21.15.131:0/1046790983 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa740079d0 con 0x7faa840c17a0 2024-04-12T19:39:24.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.952+0000 7faa7a000640 1 --2- 172.21.15.131:0/1046790983 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7faa6006c8f0 0x7faa6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:24.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.952+0000 7faa7a000640 1 -- 172.21.15.131:0/1046790983 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faa7408c260 con 0x7faa840c17a0 2024-04-12T19:39:24.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.952+0000 7faa81400640 1 --2- 172.21.15.131:0/1046790983 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7faa6006c8f0 0x7faa6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:24.953 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.953+0000 7faa81400640 1 --2- 172.21.15.131:0/1046790983 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7faa6006c8f0 0x7faa6006edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faa6c007fd0 tx=0x7faa6c007d80 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:24.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:24.956+0000 7faa7a000640 1 -- 172.21.15.131:0/1046790983 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa840c2170 con 0x7faa840c17a0 2024-04-12T19:39:25.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.158+0000 7faa89000640 1 -- 172.21.15.131:0/1046790983 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7faa8404fd50 con 0x7faa840c17a0 2024-04-12T19:39:25.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.159+0000 7faa7a000640 1 -- 172.21.15.131:0/1046790983 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7faa7405a340 con 0x7faa840c17a0 2024-04-12T19:39:25.159 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T19:39:25.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.161+0000 7faa89000640 1 -- 172.21.15.131:0/1046790983 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7faa6006c8f0 msgr2=0x7faa6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:25.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.161+0000 7faa89000640 1 --2- 172.21.15.131:0/1046790983 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7faa6006c8f0 0x7faa6006edb0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7faa6c007fd0 tx=0x7faa6c007d80 comp rx=0 tx=0).stop 2024-04-12T19:39:25.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.161+0000 7faa89000640 1 -- 172.21.15.131:0/1046790983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa840c17a0 msgr2=0x7faa840baf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:25.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.161+0000 7faa89000640 1 --2- 172.21.15.131:0/1046790983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa840c17a0 0x7faa840baf70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7faa7400c7f0 tx=0x7faa7400ccb0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.162+0000 7faa89000640 1 -- 172.21.15.131:0/1046790983 shutdown_connections 2024-04-12T19:39:25.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.162+0000 7faa89000640 1 --2- 172.21.15.131:0/1046790983 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7faa6006c8f0 0x7faa6006edb0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.162+0000 7faa89000640 1 --2- 172.21.15.131:0/1046790983 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa841511e0 0x7faa840b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.162+0000 7faa89000640 1 --2- 172.21.15.131:0/1046790983 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa840c3900 0x7faa8414d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.162+0000 7faa89000640 1 --2- 172.21.15.131:0/1046790983 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa840c17a0 0x7faa840baf70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.162+0000 7faa89000640 1 -- 172.21.15.131:0/1046790983 >> 172.21.15.131:0/1046790983 conn(0x7faa840a8490 msgr2=0x7faa840beae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:25.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.162+0000 7faa89000640 1 -- 172.21.15.131:0/1046790983 shutdown_connections 2024-04-12T19:39:25.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.162+0000 7faa89000640 1 -- 172.21.15.131:0/1046790983 wait complete. 2024-04-12T19:39:25.182 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-12T19:39:25.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.400+0000 7fcca1200640 1 Processor -- start 2024-04-12T19:39:25.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.400+0000 7fcca1200640 1 -- start start 2024-04-12T19:39:25.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.401+0000 7fcca1200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc9c1548f0 0x7fcc9c0b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:25.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.401+0000 7fcca1200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcc9c0bed50 0x7fcc9c14aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:25.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.402+0000 7fcca1200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc9c073780 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.402+0000 7fcca1200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fcc9c1553e0 con 0x7fcc9c0bed50 2024-04-12T19:39:25.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.402+0000 7fcca1200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9c067840 con 0x7fcc9c1548f0 2024-04-12T19:39:25.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.402+0000 7fcc9a800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcc9c0bed50 0x7fcc9c14aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:25.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.402+0000 7fcc9a800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fcc9c0bed50 0x7fcc9c14aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44602/0 (socket says 172.21.15.131:44602) 2024-04-12T19:39:25.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.402+0000 7fcc9a800640 1 -- 172.21.15.131:0/1646053308 learned_addr learned my addr 172.21.15.131:0/1646053308 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:25.402 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.402+0000 7fcc99e00640 1 --2- 172.21.15.131:0/1646053308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc9c1548f0 0x7fcc9c0b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:25.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.402+0000 7fcc9a800640 1 -- 172.21.15.131:0/1646053308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc9c1548f0 msgr2=0x7fcc9c0b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:25.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.402+0000 7fcc9a800640 1 --2- 172.21.15.131:0/1646053308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc9c1548f0 0x7fcc9c0b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.402+0000 7fcc9a800640 1 -- 172.21.15.131:0/1646053308 >> v1:172.21.15.171:6789/0 conn(0x7fcc9c0bf3f0 legacy=0x7fcc9c154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:25.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.402+0000 7fcc9a800640 1 -- 172.21.15.131:0/1646053308 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c0731c0 con 0x7fcc9c0bed50 2024-04-12T19:39:25.403 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.404+0000 7fcc9a800640 1 --2- 172.21.15.131:0/1646053308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c0bed50 0x7fcc9c14aff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009870 tx=0x7fcc9402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26a4dbeb8831bf83 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:25.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.404+0000 7fcc99400640 1 -- 172.21.15.131:0/1646053308 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94034070 con 0x7fcc9c0bed50 2024-04-12T19:39:25.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.404+0000 7fcc99400640 1 -- 172.21.15.131:0/1646053308 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc94030840 con 0x7fcc9c0bed50 2024-04-12T19:39:25.404 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.404+0000 7fcc99400640 1 -- 172.21.15.131:0/1646053308 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc94030c10 con 0x7fcc9c0bed50 2024-04-12T19:39:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.405+0000 7fcca1200640 1 -- 172.21.15.131:0/1646053308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c0bed50 msgr2=0x7fcc9c14aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.405+0000 7fcca1200640 1 --2- 172.21.15.131:0/1646053308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c0bed50 0x7fcc9c14aff0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fcc94009870 tx=0x7fcc9402b980 comp rx=0 tx=0).stop 2024-04-12T19:39:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.405+0000 7fcca1200640 1 -- 172.21.15.131:0/1646053308 shutdown_connections 2024-04-12T19:39:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.405+0000 7fcca1200640 1 --2- 172.21.15.131:0/1646053308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c0bed50 0x7fcc9c14aff0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.405+0000 7fcca1200640 1 --2- 172.21.15.131:0/1646053308 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc9c1548f0 0x7fcc9c0b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.405+0000 7fcca1200640 1 -- 172.21.15.131:0/1646053308 >> 172.21.15.131:0/1646053308 conn(0x7fcc9c06c920 msgr2=0x7fcc9c071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.405+0000 7fcca1200640 1 -- 172.21.15.131:0/1646053308 shutdown_connections 2024-04-12T19:39:25.405 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.405+0000 7fcca1200640 1 -- 172.21.15.131:0/1646053308 wait complete. 2024-04-12T19:39:25.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.407+0000 7fcca1200640 1 Processor -- start 2024-04-12T19:39:25.407 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.407+0000 7fcca1200640 1 -- start start 2024-04-12T19:39:25.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcca1200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc9c0bed50 0x7fcc9c1527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:25.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcca1200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c0bf3f0 0x7fcc9c150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:25.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcca1200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc9c1548f0 0x7fcc9c0bbd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:25.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcca1200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c0be550 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcca1200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcc9c0be270 con 0x7fcc9c0bed50 2024-04-12T19:39:25.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcca1200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcc9c0be830 con 0x7fcc9c1548f0 2024-04-12T19:39:25.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcc91400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c0bf3f0 0x7fcc9c150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:25.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcc91400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c0bf3f0 0x7fcc9c150a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44618/0 (socket says 172.21.15.131:44618) 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcc91400640 1 -- 172.21.15.131:0/1257323856 learned_addr learned my addr 172.21.15.131:0/1257323856 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcc99e00640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc9c0bed50 0x7fcc9c1527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcc9a800640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc9c1548f0 0x7fcc9c0bbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcc91400640 1 -- 172.21.15.131:0/1257323856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc9c1548f0 msgr2=0x7fcc9c0bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcc91400640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc9c1548f0 0x7fcc9c0bbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcc91400640 1 -- 172.21.15.131:0/1257323856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc9c0bed50 msgr2=0x7fcc9c1527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.408+0000 7fcc91400640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc9c0bed50 0x7fcc9c1527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.409+0000 7fcc91400640 1 -- 172.21.15.131:0/1257323856 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc9c0bca30 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.409+0000 7fcc99e00640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc9c0bed50 0x7fcc9c1527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.409+0000 7fcc9a800640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc9c1548f0 0x7fcc9c0bbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.409+0000 7fcc91400640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c0bf3f0 0x7fcc9c150a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc8400c440 tx=0x7fcc84001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.409+0000 7fcc92a00640 1 -- 172.21.15.131:0/1257323856 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc840052d0 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.409+0000 7fcc92a00640 1 -- 172.21.15.131:0/1257323856 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc84005470 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.409+0000 7fcc92a00640 1 -- 172.21.15.131:0/1257323856 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc84007260 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.409+0000 7fcca1200640 1 -- 172.21.15.131:0/1257323856 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc9c152d10 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.409+0000 7fcca1200640 1 -- 172.21.15.131:0/1257323856 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc9c151cd0 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.411+0000 7fcca1200640 1 -- 172.21.15.131:0/1257323856 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc9c06ce80 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.412+0000 7fcc92a00640 1 -- 172.21.15.131:0/1257323856 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcc84007400 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.412+0000 7fcc92a00640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcc7806c8f0 0x7fcc7806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:25.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.413+0000 7fcc92a00640 1 -- 172.21.15.131:0/1257323856 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcc8408b3c0 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.413+0000 7fcc99e00640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcc7806c8f0 0x7fcc7806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:25.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.414+0000 7fcc99e00640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcc7806c8f0 0x7fcc7806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c1507f0 tx=0x7fcc8c00b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:25.417 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.417+0000 7fcc92a00640 1 -- 172.21.15.131:0/1257323856 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcc840594a0 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.616+0000 7fcca1200640 1 -- 172.21.15.131:0/1257323856 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcc9c150fb0 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.617+0000 7fcc92a00640 1 -- 172.21.15.131:0/1257323856 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fcc84058da0 con 0x7fcc9c0bf3f0 2024-04-12T19:39:25.619 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-12T19:39:25.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.620+0000 7fcca1200640 1 -- 172.21.15.131:0/1257323856 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcc7806c8f0 msgr2=0x7fcc7806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:25.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.620+0000 7fcca1200640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcc7806c8f0 0x7fcc7806edb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fcc9c1507f0 tx=0x7fcc8c00b040 comp rx=0 tx=0).stop 2024-04-12T19:39:25.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.620+0000 7fcca1200640 1 -- 172.21.15.131:0/1257323856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c0bf3f0 msgr2=0x7fcc9c150a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:25.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.620+0000 7fcca1200640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c0bf3f0 0x7fcc9c150a70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fcc8400c440 tx=0x7fcc84001e70 comp rx=0 tx=0).stop 2024-04-12T19:39:25.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.621+0000 7fcca1200640 1 -- 172.21.15.131:0/1257323856 shutdown_connections 2024-04-12T19:39:25.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.621+0000 7fcca1200640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcc7806c8f0 0x7fcc7806edb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.621+0000 7fcca1200640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcc9c1548f0 0x7fcc9c0bbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.621+0000 7fcca1200640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcc9c0bf3f0 0x7fcc9c150a70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.621+0000 7fcca1200640 1 --2- 172.21.15.131:0/1257323856 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcc9c0bed50 0x7fcc9c1527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.621+0000 7fcca1200640 1 -- 172.21.15.131:0/1257323856 >> 172.21.15.131:0/1257323856 conn(0x7fcc9c06c920 msgr2=0x7fcc9c0c1250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:25.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.621+0000 7fcca1200640 1 -- 172.21.15.131:0/1257323856 shutdown_connections 2024-04-12T19:39:25.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.621+0000 7fcca1200640 1 -- 172.21.15.131:0/1257323856 wait complete. 2024-04-12T19:39:25.640 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-12T19:39:25.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.848+0000 7f7c7ea00640 1 Processor -- start 2024-04-12T19:39:25.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.849+0000 7f7c7ea00640 1 -- start start 2024-04-12T19:39:25.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.850+0000 7f7c7ea00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f7c7814f9f0 0x7f7c78148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:25.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.850+0000 7f7c7ea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7c78073330 0x7f7c78149300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:25.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.850+0000 7f7c7ea00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c78149840 con 0x7f7c7806bc50 2024-04-12T19:39:25.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.850+0000 7f7c7ea00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f7c780beae0 con 0x7f7c78073330 2024-04-12T19:39:25.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.850+0000 7f7c7ea00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f7c7806c770 con 0x7f7c7814f9f0 2024-04-12T19:39:25.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.850+0000 7f7c7ca00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7c78073330 0x7f7c78149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:25.850 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.850+0000 7f7c7ca00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f7c78073330 0x7f7c78149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44632/0 (socket says 172.21.15.131:44632) 2024-04-12T19:39:25.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.850+0000 7f7c7ca00640 1 -- 172.21.15.131:0/2661049334 learned_addr learned my addr 172.21.15.131:0/2661049334 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:25.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.851+0000 7f7c77400640 1 --2- 172.21.15.131:0/2661049334 >> v2:172.21.15.171:3300/0 conn(0x7f7c7814f9f0 0x7f7c78148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:25.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.851+0000 7f7c7ca00640 1 -- 172.21.15.131:0/2661049334 >> v2:172.21.15.171:3300/0 conn(0x7f7c7814f9f0 msgr2=0x7f7c78148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:25.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.851+0000 7f7c7ca00640 1 --2- 172.21.15.131:0/2661049334 >> v2:172.21.15.171:3300/0 conn(0x7f7c7814f9f0 0x7f7c78148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.851+0000 7f7c7ca00640 1 -- 172.21.15.131:0/2661049334 >> v1:172.21.15.171:6789/0 conn(0x7f7c7806bc50 legacy=0x7f7c7814f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:25.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.851+0000 7f7c7ca00640 1 -- 172.21.15.131:0/2661049334 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c78073e40 con 0x7f7c78073330 2024-04-12T19:39:25.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.852+0000 7f7c7ca00640 1 --2- 172.21.15.131:0/2661049334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c78073330 0x7f7c78149300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c78063690 tx=0x7f7c7002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a134328ecef83b3c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:25.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.852+0000 7f7c76a00640 1 -- 172.21.15.131:0/2661049334 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c7002ca80 con 0x7f7c78073330 2024-04-12T19:39:25.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.852+0000 7f7c76a00640 1 -- 172.21.15.131:0/2661049334 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c7002cc20 con 0x7f7c78073330 2024-04-12T19:39:25.852 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.852+0000 7f7c76a00640 1 -- 172.21.15.131:0/2661049334 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c700343f0 con 0x7f7c78073330 2024-04-12T19:39:25.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.853+0000 7f7c7ea00640 1 -- 172.21.15.131:0/2661049334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c78073330 msgr2=0x7f7c78149300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:25.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.853+0000 7f7c7ea00640 1 --2- 172.21.15.131:0/2661049334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c78073330 0x7f7c78149300 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7c78063690 tx=0x7f7c7002bee0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.853+0000 7f7c7ea00640 1 -- 172.21.15.131:0/2661049334 shutdown_connections 2024-04-12T19:39:25.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.853+0000 7f7c7ea00640 1 --2- 172.21.15.131:0/2661049334 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c78073330 0x7f7c78149300 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.853+0000 7f7c7ea00640 1 --2- 172.21.15.131:0/2661049334 >> v2:172.21.15.171:3300/0 conn(0x7f7c7814f9f0 0x7f7c78148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.853+0000 7f7c7ea00640 1 -- 172.21.15.131:0/2661049334 >> 172.21.15.131:0/2661049334 conn(0x7f7c780c0120 msgr2=0x7f7c780c0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:25.853 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.853+0000 7f7c7ea00640 1 -- 172.21.15.131:0/2661049334 shutdown_connections 2024-04-12T19:39:25.854 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.853+0000 7f7c7ea00640 1 -- 172.21.15.131:0/2661049334 wait complete. 2024-04-12T19:39:25.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.855+0000 7f7c7ea00640 1 Processor -- start 2024-04-12T19:39:25.855 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.855+0000 7f7c7ea00640 1 -- start start 2024-04-12T19:39:25.856 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.856+0000 7f7c7ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7806bc50 0x7f7c780b9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.856+0000 7f7c7ea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c78073330 0x7f7c781e6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.856+0000 7f7c7ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7814f9f0 0x7f7c781e7500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.856+0000 7f7c7ea00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7806c400 con 0x7f7c7806bc50 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.856+0000 7f7c7ea00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7c78073b60 con 0x7f7c78073330 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.856+0000 7f7c7ea00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c780c0fa0 con 0x7f7c7814f9f0 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.856+0000 7f7c77e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7806bc50 0x7f7c780b9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.856+0000 7f7c77e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7806bc50 0x7f7c780b9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44642/0 (socket says 172.21.15.131:44642) 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.856+0000 7f7c77e00640 1 -- 172.21.15.131:0/4043148947 learned_addr learned my addr 172.21.15.131:0/4043148947 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.856+0000 7f7c7ca00640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7814f9f0 0x7f7c781e7500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.856+0000 7f7c77400640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c78073330 0x7f7c781e6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c77e00640 1 -- 172.21.15.131:0/4043148947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7814f9f0 msgr2=0x7f7c781e7500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c77e00640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7814f9f0 0x7f7c781e7500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c77e00640 1 -- 172.21.15.131:0/4043148947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c78073330 msgr2=0x7f7c781e6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:25.857 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c77e00640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c78073330 0x7f7c781e6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:25.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c77e00640 1 -- 172.21.15.131:0/4043148947 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c780ba190 con 0x7f7c7806bc50 2024-04-12T19:39:25.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c7ca00640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7814f9f0 0x7f7c781e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:25.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c77400640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c78073330 0x7f7c781e6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:25.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c77e00640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7806bc50 0x7f7c780b9c50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800b420 tx=0x7f7c6800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:25.858 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c6fe00640 1 -- 172.21.15.131:0/4043148947 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68011830 con 0x7f7c7806bc50 2024-04-12T19:39:25.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c6fe00640 1 -- 172.21.15.131:0/4043148947 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c68016070 con 0x7f7c7806bc50 2024-04-12T19:39:25.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c6fe00640 1 -- 172.21.15.131:0/4043148947 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c68011c10 con 0x7f7c7806bc50 2024-04-12T19:39:25.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c7ea00640 1 -- 172.21.15.131:0/4043148947 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c780a95f0 con 0x7f7c7806bc50 2024-04-12T19:39:25.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.857+0000 7f7c7ea00640 1 -- 172.21.15.131:0/4043148947 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7814c290 con 0x7f7c7806bc50 2024-04-12T19:39:25.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.858+0000 7f7c7ea00640 1 -- 172.21.15.131:0/4043148947 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c7804fd50 con 0x7f7c7806bc50 2024-04-12T19:39:25.859 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.859+0000 7f7c6fe00640 1 -- 172.21.15.131:0/4043148947 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c6801b460 con 0x7f7c7806bc50 2024-04-12T19:39:25.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.860+0000 7f7c6fe00640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c5406c920 0x7f7c5406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:25.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.860+0000 7f7c6fe00640 1 -- 172.21.15.131:0/4043148947 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7c6808b8b0 con 0x7f7c7806bc50 2024-04-12T19:39:25.860 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.860+0000 7f7c77400640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c5406c920 0x7f7c5406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:25.861 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.861+0000 7f7c77400640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c5406c920 0x7f7c5406ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7c60006fd0 tx=0x7f7c60008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:25.864 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:25.865+0000 7f7c6fe00640 1 -- 172.21.15.131:0/4043148947 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c68020020 con 0x7f7c7806bc50 2024-04-12T19:39:26.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.063+0000 7f7c7ea00640 1 -- 172.21.15.131:0/4043148947 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7c7814ee70 con 0x7f7c7806bc50 2024-04-12T19:39:26.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.064+0000 7f7c6fe00640 1 -- 172.21.15.131:0/4043148947 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f7c68059a30 con 0x7f7c7806bc50 2024-04-12T19:39:26.064 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T19:39:26.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.067+0000 7f7c7ea00640 1 -- 172.21.15.131:0/4043148947 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c5406c920 msgr2=0x7f7c5406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.067+0000 7f7c7ea00640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c5406c920 0x7f7c5406ede0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7c60006fd0 tx=0x7f7c60008040 comp rx=0 tx=0).stop 2024-04-12T19:39:26.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.067+0000 7f7c7ea00640 1 -- 172.21.15.131:0/4043148947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7806bc50 msgr2=0x7f7c780b9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.067+0000 7f7c7ea00640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7806bc50 0x7f7c780b9c50 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7c6800b420 tx=0x7f7c6800b8e0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.067+0000 7f7c7ea00640 1 -- 172.21.15.131:0/4043148947 shutdown_connections 2024-04-12T19:39:26.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.067+0000 7f7c7ea00640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c5406c920 0x7f7c5406ede0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.067+0000 7f7c7ea00640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c78073330 0x7f7c781e6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.067+0000 7f7c7ea00640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c7814f9f0 0x7f7c781e7500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.067+0000 7f7c7ea00640 1 --2- 172.21.15.131:0/4043148947 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c7806bc50 0x7f7c780b9c50 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.067+0000 7f7c7ea00640 1 -- 172.21.15.131:0/4043148947 >> 172.21.15.131:0/4043148947 conn(0x7f7c780c0120 msgr2=0x7f7c7814d6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:26.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.067+0000 7f7c7ea00640 1 -- 172.21.15.131:0/4043148947 shutdown_connections 2024-04-12T19:39:26.068 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.067+0000 7f7c7ea00640 1 -- 172.21.15.131:0/4043148947 wait complete. 2024-04-12T19:39:26.087 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-12T19:39:26.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.289+0000 7fa089400640 1 Processor -- start 2024-04-12T19:39:26.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.289+0000 7fa089400640 1 -- start start 2024-04-12T19:39:26.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.290+0000 7fa089400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa0840beb40 0x7fa08415cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.290+0000 7fa089400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0840be300 con 0x7fa0840b8460 2024-04-12T19:39:26.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.290+0000 7fa089400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0840b76e0 con 0x7fa0840bf720 2024-04-12T19:39:26.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.290+0000 7fa089400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa0840bd140 con 0x7fa0840beb40 2024-04-12T19:39:26.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.291+0000 7fa083200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa0840beb40 0x7fa08415cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.291+0000 7fa083200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa0840beb40 0x7fa08415cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44656/0 (socket says 172.21.15.131:44656) 2024-04-12T19:39:26.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.291+0000 7fa081e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa0840b8460 0x7fa084151910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60108/0 (socket says 172.21.15.131:60108) 2024-04-12T19:39:26.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.291+0000 7fa083200640 1 -- 172.21.15.131:0/918077797 learned_addr learned my addr 172.21.15.131:0/918077797 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:26.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.291+0000 7fa083200640 1 -- 172.21.15.131:0/918077797 >> v1:172.21.15.171:6789/0 conn(0x7fa0840bf720 legacy=0x7fa08406e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.291+0000 7fa083200640 1 -- 172.21.15.131:0/918077797 >> v1:172.21.15.131:6789/0 conn(0x7fa0840b8460 legacy=0x7fa084151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.291+0000 7fa083200640 1 -- 172.21.15.131:0/918077797 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0840b7980 con 0x7fa0840beb40 2024-04-12T19:39:26.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.292+0000 7fa083200640 1 --2- 172.21.15.131:0/918077797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0840beb40 0x7fa08415cb40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009e50 tx=0x7fa07c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85d85f106933411b server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:26.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.293+0000 7fa081400640 1 -- 172.21.15.131:0/918077797 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c02cbb0 con 0x7fa0840beb40 2024-04-12T19:39:26.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.293+0000 7fa081400640 1 -- 172.21.15.131:0/918077797 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07c02cd50 con 0x7fa0840beb40 2024-04-12T19:39:26.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.293+0000 7fa081400640 1 -- 172.21.15.131:0/918077797 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c034610 con 0x7fa0840beb40 2024-04-12T19:39:26.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.293+0000 7fa089400640 1 -- 172.21.15.131:0/918077797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0840beb40 msgr2=0x7fa08415cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.293+0000 7fa089400640 1 --2- 172.21.15.131:0/918077797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0840beb40 0x7fa08415cb40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009e50 tx=0x7fa07c02c010 comp rx=0 tx=0).stop 2024-04-12T19:39:26.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.293+0000 7fa089400640 1 -- 172.21.15.131:0/918077797 shutdown_connections 2024-04-12T19:39:26.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.293+0000 7fa089400640 1 --2- 172.21.15.131:0/918077797 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0840beb40 0x7fa08415cb40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.293+0000 7fa089400640 1 -- 172.21.15.131:0/918077797 >> 172.21.15.131:0/918077797 conn(0x7fa08406be00 msgr2=0x7fa08406c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:26.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.293+0000 7fa089400640 1 -- 172.21.15.131:0/918077797 shutdown_connections 2024-04-12T19:39:26.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.293+0000 7fa089400640 1 -- 172.21.15.131:0/918077797 wait complete. 2024-04-12T19:39:26.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.295+0000 7fa089400640 1 Processor -- start 2024-04-12T19:39:26.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.295+0000 7fa089400640 1 -- start start 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.296+0000 7fa089400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0840b8460 0x7fa0840bc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.296+0000 7fa089400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0840beb40 0x7fa0840c13e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.296+0000 7fa089400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0840bf720 0x7fa0840bb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.296+0000 7fa089400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa0840b92f0 con 0x7fa0840bf720 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.296+0000 7fa089400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa0840b7f40 con 0x7fa0840beb40 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.296+0000 7fa089400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa0840bdfd0 con 0x7fa0840b8460 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.296+0000 7fa083200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0840bf720 0x7fa0840bb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.296+0000 7fa083200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0840bf720 0x7fa0840bb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44662/0 (socket says 172.21.15.131:44662) 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.296+0000 7fa083200640 1 -- 172.21.15.131:0/2723463414 learned_addr learned my addr 172.21.15.131:0/2723463414 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa081e00640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0840beb40 0x7fa0840c13e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa082800640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0840b8460 0x7fa0840bc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa083200640 1 -- 172.21.15.131:0/2723463414 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0840b8460 msgr2=0x7fa0840bc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa083200640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0840b8460 0x7fa0840bc2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa083200640 1 -- 172.21.15.131:0/2723463414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0840beb40 msgr2=0x7fa0840c13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa083200640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0840beb40 0x7fa0840c13e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa083200640 1 -- 172.21.15.131:0/2723463414 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0840734a0 con 0x7fa0840bf720 2024-04-12T19:39:26.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa083200640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0840bf720 0x7fa0840bb430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009e50 tx=0x7fa07c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:26.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa07aa00640 1 -- 172.21.15.131:0/2723463414 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c043020 con 0x7fa0840bf720 2024-04-12T19:39:26.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa07aa00640 1 -- 172.21.15.131:0/2723463414 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa07c03e450 con 0x7fa0840bf720 2024-04-12T19:39:26.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa089400640 1 -- 172.21.15.131:0/2723463414 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa084072f20 con 0x7fa0840bf720 2024-04-12T19:39:26.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa07aa00640 1 -- 172.21.15.131:0/2723463414 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa07c009510 con 0x7fa0840bf720 2024-04-12T19:39:26.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.297+0000 7fa089400640 1 -- 172.21.15.131:0/2723463414 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0840731c0 con 0x7fa0840bf720 2024-04-12T19:39:26.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.299+0000 7fa089400640 1 -- 172.21.15.131:0/2723463414 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa08404fd50 con 0x7fa0840bf720 2024-04-12T19:39:26.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.299+0000 7fa07aa00640 1 -- 172.21.15.131:0/2723463414 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa07c005d10 con 0x7fa0840bf720 2024-04-12T19:39:26.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.300+0000 7fa07aa00640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa06406c8f0 0x7fa06406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.300+0000 7fa07aa00640 1 -- 172.21.15.131:0/2723463414 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa07c0aeac0 con 0x7fa0840bf720 2024-04-12T19:39:26.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.301+0000 7fa082800640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa06406c8f0 0x7fa06406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.301+0000 7fa082800640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa06406c8f0 0x7fa06406edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa074000f60 tx=0x7fa074009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:26.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.305+0000 7fa07aa00640 1 -- 172.21.15.131:0/2723463414 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa07c07cba0 con 0x7fa0840bf720 2024-04-12T19:39:26.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.513+0000 7fa089400640 1 -- 172.21.15.131:0/2723463414 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa0840be710 con 0x7fa0840bf720 2024-04-12T19:39:26.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.514+0000 7fa07aa00640 1 -- 172.21.15.131:0/2723463414 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7fa07c07c4a0 con 0x7fa0840bf720 2024-04-12T19:39:26.514 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-04-12T19:39:26.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.516+0000 7fa089400640 1 -- 172.21.15.131:0/2723463414 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa06406c8f0 msgr2=0x7fa06406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.516+0000 7fa089400640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa06406c8f0 0x7fa06406edb0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa074000f60 tx=0x7fa074009040 comp rx=0 tx=0).stop 2024-04-12T19:39:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.516+0000 7fa089400640 1 -- 172.21.15.131:0/2723463414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0840bf720 msgr2=0x7fa0840bb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.516+0000 7fa089400640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0840bf720 0x7fa0840bb430 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa07c009e50 tx=0x7fa07c004a40 comp rx=0 tx=0).stop 2024-04-12T19:39:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.517+0000 7fa089400640 1 -- 172.21.15.131:0/2723463414 shutdown_connections 2024-04-12T19:39:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.517+0000 7fa089400640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa06406c8f0 0x7fa06406edb0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.517+0000 7fa089400640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa0840beb40 0x7fa0840c13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.517+0000 7fa089400640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0840bf720 0x7fa0840bb430 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.517+0000 7fa089400640 1 --2- 172.21.15.131:0/2723463414 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa0840b8460 0x7fa0840bc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.517+0000 7fa089400640 1 -- 172.21.15.131:0/2723463414 >> 172.21.15.131:0/2723463414 conn(0x7fa08406be00 msgr2=0x7fa08406eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.517+0000 7fa089400640 1 -- 172.21.15.131:0/2723463414 shutdown_connections 2024-04-12T19:39:26.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.517+0000 7fa089400640 1 -- 172.21.15.131:0/2723463414 wait complete. 2024-04-12T19:39:26.534 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:39:26.534 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T19:39:26.583 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:26.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.832+0000 7fd492400640 1 Processor -- start 2024-04-12T19:39:26.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.833+0000 7fd492400640 1 -- start start 2024-04-12T19:39:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.834+0000 7fd492400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd48c0a6950 0x7fd48c15a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.834+0000 7fd492400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd48c152d10 con 0x7fd48c0734c0 2024-04-12T19:39:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.834+0000 7fd492400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd48c0be570 con 0x7fd48c0bdbc0 2024-04-12T19:39:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.834+0000 7fd492400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd48c0be320 con 0x7fd48c0a6950 2024-04-12T19:39:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.834+0000 7fd491000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd48c0734c0 0x7fd48c1521f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60120/0 (socket says 172.21.15.131:60120) 2024-04-12T19:39:26.834 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.834+0000 7fd491000640 1 -- 172.21.15.131:0/55472579 learned_addr learned my addr 172.21.15.131:0/55472579 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:26.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd491a00640 1 --2- 172.21.15.131:0/55472579 >> v2:172.21.15.171:3300/0 conn(0x7fd48c0a6950 0x7fd48c15a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 295114054 0 0) 0x7fd48c152d10 con 0x7fd48c0734c0 2024-04-12T19:39:26.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd474003520 con 0x7fd48c0734c0 2024-04-12T19:39:26.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2343522449 0 0) 0x7fd474003520 con 0x7fd48c0734c0 2024-04-12T19:39:26.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 >> v2:172.21.15.171:3300/0 conn(0x7fd48c0a6950 msgr2=0x7fd48c15a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:26.836 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 --2- 172.21.15.131:0/55472579 >> v2:172.21.15.171:3300/0 conn(0x7fd48c0a6950 0x7fd48c15a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 >> v1:172.21.15.171:6789/0 conn(0x7fd48c0bdbc0 legacy=0x7fd48c0a6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48c0be850 con 0x7fd48c0734c0 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7fd480001670 con 0x7fd48c0734c0 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 >> v1:172.21.15.131:6789/0 conn(0x7fd48c0734c0 legacy=0x7fd48c1521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 --2- 172.21.15.131:0/55472579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 0x7fd474003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 --2- 172.21.15.131:0/55472579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd474004800 0x7fd474004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 --2- 172.21.15.131:0/55472579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd474005210 0x7fd47400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c0be320 con 0x7fd474003a00 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd47400c160 con 0x7fd474004800 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.835+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd47400c360 con 0x7fd474005210 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.836+0000 7fd491000640 1 --2- 172.21.15.131:0/55472579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 0x7fd474003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.836+0000 7fd48be00640 1 --2- 172.21.15.131:0/55472579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd474004800 0x7fd474004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.837 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.836+0000 7fd491a00640 1 --2- 172.21.15.131:0/55472579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd474005210 0x7fd47400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.836+0000 7fd491000640 1 -- 172.21.15.131:0/55472579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd474005210 msgr2=0x7fd47400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:26.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.836+0000 7fd491000640 1 --2- 172.21.15.131:0/55472579 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd474005210 0x7fd47400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.836+0000 7fd491000640 1 -- 172.21.15.131:0/55472579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd474004800 msgr2=0x7fd474004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:26.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.836+0000 7fd491000640 1 --2- 172.21.15.131:0/55472579 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd474004800 0x7fd474004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.836+0000 7fd491a00640 1 -- 172.21.15.131:0/55472579 reap_dead start 2024-04-12T19:39:26.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.836+0000 7fd491000640 1 -- 172.21.15.131:0/55472579 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd474003520 con 0x7fd474003a00 2024-04-12T19:39:26.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.838+0000 7fd491000640 1 --2- 172.21.15.131:0/55472579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 0x7fd474003e20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd480007fd0 tx=0x7fd474005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b624ea3d8e2453 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:26.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.838+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd480007c20 con 0x7fd474003a00 2024-04-12T19:39:26.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.838+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd480030070 con 0x7fd474003a00 2024-04-12T19:39:26.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.838+0000 7fd48b400640 1 -- 172.21.15.131:0/55472579 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd480005d70 con 0x7fd474003a00 2024-04-12T19:39:26.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.839+0000 7fd492400640 1 -- 172.21.15.131:0/55472579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 msgr2=0x7fd474003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.839+0000 7fd492400640 1 --2- 172.21.15.131:0/55472579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 0x7fd474003e20 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd480007fd0 tx=0x7fd474005830 comp rx=0 tx=0).stop 2024-04-12T19:39:26.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.839+0000 7fd492400640 1 -- 172.21.15.131:0/55472579 shutdown_connections 2024-04-12T19:39:26.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.839+0000 7fd492400640 1 --2- 172.21.15.131:0/55472579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 0x7fd474003e20 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.839+0000 7fd492400640 1 -- 172.21.15.131:0/55472579 >> 172.21.15.131:0/55472579 conn(0x7fd48c0c24d0 msgr2=0x7fd48c0c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:26.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.839+0000 7fd492400640 1 -- 172.21.15.131:0/55472579 shutdown_connections 2024-04-12T19:39:26.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.839+0000 7fd492400640 1 -- 172.21.15.131:0/55472579 wait complete. 2024-04-12T19:39:26.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.841+0000 7fd492400640 1 Processor -- start 2024-04-12T19:39:26.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.841+0000 7fd492400640 1 -- start start 2024-04-12T19:39:26.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.842+0000 7fd492400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 0x7fd48c146eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.842+0000 7fd492400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd48c14c110 0x7fd48c144300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.842+0000 7fd492400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd48c144840 0x7fd48c1ea210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.842+0000 7fd492400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c0738a0 con 0x7fd474003a00 2024-04-12T19:39:26.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.842+0000 7fd492400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd48c0a8320 con 0x7fd48c14c110 2024-04-12T19:39:26.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.842+0000 7fd492400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd48c0a7cd0 con 0x7fd48c144840 2024-04-12T19:39:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.842+0000 7fd491000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 0x7fd48c146eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.842+0000 7fd491000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 0x7fd48c146eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44676/0 (socket says 172.21.15.131:44676) 2024-04-12T19:39:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.842+0000 7fd491000640 1 -- 172.21.15.131:0/2433509310 learned_addr learned my addr 172.21.15.131:0/2433509310 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.842+0000 7fd48be00640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd48c14c110 0x7fd48c144300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd491a00640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd48c144840 0x7fd48c1ea210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd491000640 1 -- 172.21.15.131:0/2433509310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd48c144840 msgr2=0x7fd48c1ea210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd491000640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd48c144840 0x7fd48c1ea210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd491000640 1 -- 172.21.15.131:0/2433509310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd48c14c110 msgr2=0x7fd48c144300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd491000640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd48c14c110 0x7fd48c144300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd491000640 1 -- 172.21.15.131:0/2433509310 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48c1eae70 con 0x7fd474003a00 2024-04-12T19:39:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd491a00640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd48c144840 0x7fd48c1ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:26.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd491000640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 0x7fd48c146eb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd48000c1d0 tx=0x7fd48c0beb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:26.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd488c00640 1 -- 172.21.15.131:0/2433509310 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd480045070 con 0x7fd474003a00 2024-04-12T19:39:26.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd488c00640 1 -- 172.21.15.131:0/2433509310 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd480007280 con 0x7fd474003a00 2024-04-12T19:39:26.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd488c00640 1 -- 172.21.15.131:0/2433509310 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd480007c20 con 0x7fd474003a00 2024-04-12T19:39:26.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd492400640 1 -- 172.21.15.131:0/2433509310 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48c151430 con 0x7fd474003a00 2024-04-12T19:39:26.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.843+0000 7fd492400640 1 -- 172.21.15.131:0/2433509310 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd48c1519f0 con 0x7fd474003a00 2024-04-12T19:39:26.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.845+0000 7fd492400640 1 -- 172.21.15.131:0/2433509310 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd48c075c30 con 0x7fd474003a00 2024-04-12T19:39:26.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.846+0000 7fd488c00640 1 -- 172.21.15.131:0/2433509310 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd480048070 con 0x7fd474003a00 2024-04-12T19:39:26.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.846+0000 7fd488c00640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd47006c920 0x7fd47006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:26.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.847+0000 7fd488c00640 1 -- 172.21.15.131:0/2433509310 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd4800aca70 con 0x7fd474003a00 2024-04-12T19:39:26.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.847+0000 7fd48be00640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd47006c920 0x7fd47006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:26.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.847+0000 7fd48be00640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd47006c920 0x7fd47006ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd48c1dd390 tx=0x7fd47c009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:26.851 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:26.851+0000 7fd488c00640 1 -- 172.21.15.131:0/2433509310 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd48007ab80 con 0x7fd474003a00 2024-04-12T19:39:27.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.051+0000 7fd492400640 1 -- 172.21.15.131:0/2433509310 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd48c14c520 con 0x7fd474003a00 2024-04-12T19:39:27.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.053+0000 7fd488c00640 1 -- 172.21.15.131:0/2433509310 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7fd48007a480 con 0x7fd474003a00 2024-04-12T19:39:27.053 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:27.054 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":26,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:17.479662+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:27.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.056+0000 7fd492400640 1 -- 172.21.15.131:0/2433509310 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd47006c920 msgr2=0x7fd47006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.056+0000 7fd492400640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd47006c920 0x7fd47006ede0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fd48c1dd390 tx=0x7fd47c009040 comp rx=0 tx=0).stop 2024-04-12T19:39:27.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.056+0000 7fd492400640 1 -- 172.21.15.131:0/2433509310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 msgr2=0x7fd48c146eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.056+0000 7fd492400640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 0x7fd48c146eb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd48000c1d0 tx=0x7fd48c0beb30 comp rx=0 tx=0).stop 2024-04-12T19:39:27.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.056+0000 7fd492400640 1 -- 172.21.15.131:0/2433509310 shutdown_connections 2024-04-12T19:39:27.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.056+0000 7fd492400640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd47006c920 0x7fd47006ede0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.056+0000 7fd492400640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd48c14c110 0x7fd48c144300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.056+0000 7fd492400640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd48c144840 0x7fd48c1ea210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.056+0000 7fd492400640 1 --2- 172.21.15.131:0/2433509310 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd474003a00 0x7fd48c146eb0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.056+0000 7fd492400640 1 -- 172.21.15.131:0/2433509310 >> 172.21.15.131:0/2433509310 conn(0x7fd48c0c24d0 msgr2=0x7fd48c070ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:27.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.056+0000 7fd492400640 1 -- 172.21.15.131:0/2433509310 shutdown_connections 2024-04-12T19:39:27.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.056+0000 7fd492400640 1 -- 172.21.15.131:0/2433509310 wait complete. 2024-04-12T19:39:27.075 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T19:39:04.855067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-12T19:39:09.370965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-12T19:39:09.858079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-12T19:39:13.479306+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-12T19:39:27.076 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T19:39:27.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.288+0000 7faa18c00640 1 Processor -- start 2024-04-12T19:39:27.288 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.288+0000 7faa18c00640 1 -- start start 2024-04-12T19:39:27.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.290+0000 7faa18c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1414b370 0x7faa1406f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.290+0000 7faa18c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa1406f550 0x7faa14150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.290 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.290+0000 7faa18c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa14154fb0 con 0x7faa140be690 2024-04-12T19:39:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.290+0000 7faa18c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7faa140b8760 con 0x7faa1406f550 2024-04-12T19:39:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.290+0000 7faa18c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa14155250 con 0x7faa1414b370 2024-04-12T19:39:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.290+0000 7faa0aa00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa1406f550 0x7faa14150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.290+0000 7faa0aa00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa1406f550 0x7faa14150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44686/0 (socket says 172.21.15.131:44686) 2024-04-12T19:39:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.290+0000 7faa0aa00640 1 -- 172.21.15.131:0/2441625756 learned_addr learned my addr 172.21.15.131:0/2441625756 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.290+0000 7faa13e00640 1 --1- 172.21.15.131:0/2441625756 >> v1:172.21.15.131:6789/0 conn(0x7faa140be690 0x7faa140bcc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60124/0 (socket says 172.21.15.131:60124) 2024-04-12T19:39:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.290+0000 7faa13400640 1 --2- 172.21.15.131:0/2441625756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1414b370 0x7faa1406f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.291+0000 7faa0aa00640 1 -- 172.21.15.131:0/2441625756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1414b370 msgr2=0x7faa1406f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.291+0000 7faa0aa00640 1 --2- 172.21.15.131:0/2441625756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1414b370 0x7faa1406f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.291+0000 7faa0aa00640 1 -- 172.21.15.131:0/2441625756 >> v1:172.21.15.131:6789/0 conn(0x7faa140be690 legacy=0x7faa140bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.291 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.291+0000 7faa0aa00640 1 -- 172.21.15.131:0/2441625756 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa140b89b0 con 0x7faa1406f550 2024-04-12T19:39:27.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.292+0000 7faa0aa00640 1 --2- 172.21.15.131:0/2441625756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1406f550 0x7faa14150ff0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009870 tx=0x7fa9fc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abb6a64819e7b36 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:27.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.292+0000 7faa12a00640 1 -- 172.21.15.131:0/2441625756 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc035020 con 0x7faa1406f550 2024-04-12T19:39:27.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.292+0000 7faa12a00640 1 -- 172.21.15.131:0/2441625756 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9fc031640 con 0x7faa1406f550 2024-04-12T19:39:27.292 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.292+0000 7faa12a00640 1 -- 172.21.15.131:0/2441625756 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9fc02d040 con 0x7faa1406f550 2024-04-12T19:39:27.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.292+0000 7faa18c00640 1 -- 172.21.15.131:0/2441625756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1406f550 msgr2=0x7faa14150ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.292+0000 7faa18c00640 1 --2- 172.21.15.131:0/2441625756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1406f550 0x7faa14150ff0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fa9fc009870 tx=0x7fa9fc02b8f0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.293+0000 7faa18c00640 1 -- 172.21.15.131:0/2441625756 shutdown_connections 2024-04-12T19:39:27.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.293+0000 7faa18c00640 1 --2- 172.21.15.131:0/2441625756 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1406f550 0x7faa14150ff0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.293+0000 7faa18c00640 1 --2- 172.21.15.131:0/2441625756 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1414b370 0x7faa1406f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.293+0000 7faa18c00640 1 -- 172.21.15.131:0/2441625756 >> 172.21.15.131:0/2441625756 conn(0x7faa1406b9e0 msgr2=0x7faa1406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:27.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.293+0000 7faa18c00640 1 -- 172.21.15.131:0/2441625756 shutdown_connections 2024-04-12T19:39:27.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.293+0000 7faa18c00640 1 -- 172.21.15.131:0/2441625756 wait complete. 2024-04-12T19:39:27.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.294+0000 7faa18c00640 1 Processor -- start 2024-04-12T19:39:27.294 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.294+0000 7faa18c00640 1 -- start start 2024-04-12T19:39:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.295+0000 7faa18c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1406f550 0x7faa140bbd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.295+0000 7faa18c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa140be690 0x7faa140baf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.295+0000 7faa18c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1414b370 0x7faa14152fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.295+0000 7faa18c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa140bdf30 con 0x7faa1414b370 2024-04-12T19:39:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.295+0000 7faa18c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa1406c980 con 0x7faa140be690 2024-04-12T19:39:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.295+0000 7faa18c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa140be0b0 con 0x7faa1406f550 2024-04-12T19:39:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.296+0000 7faa13e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1414b370 0x7faa14152fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.296+0000 7faa13e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1414b370 0x7faa14152fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44692/0 (socket says 172.21.15.131:44692) 2024-04-12T19:39:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.296+0000 7faa13e00640 1 -- 172.21.15.131:0/1568550063 learned_addr learned my addr 172.21.15.131:0/1568550063 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.296+0000 7faa13400640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1406f550 0x7faa140bbd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.296+0000 7faa0aa00640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa140be690 0x7faa140baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.296+0000 7faa13e00640 1 -- 172.21.15.131:0/1568550063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1406f550 msgr2=0x7faa140bbd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.296+0000 7faa13e00640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1406f550 0x7faa140bbd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.296+0000 7faa13e00640 1 -- 172.21.15.131:0/1568550063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa140be690 msgr2=0x7faa140baf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.296+0000 7faa13e00640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa140be690 0x7faa140baf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.296+0000 7faa13e00640 1 -- 172.21.15.131:0/1568550063 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa140bc250 con 0x7faa1414b370 2024-04-12T19:39:27.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.296+0000 7faa0aa00640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa140be690 0x7faa140baf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:27.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.296+0000 7faa13e00640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1414b370 0x7faa14152fb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00c7b0 tx=0x7faa0c00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:27.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.297+0000 7faa0be00640 1 -- 172.21.15.131:0/1568550063 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c017070 con 0x7faa1414b370 2024-04-12T19:39:27.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.297+0000 7faa0be00640 1 -- 172.21.15.131:0/1568550063 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa0c00a640 con 0x7faa1414b370 2024-04-12T19:39:27.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.297+0000 7faa0be00640 1 -- 172.21.15.131:0/1568550063 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa0c00a9f0 con 0x7faa1414b370 2024-04-12T19:39:27.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.297+0000 7faa18c00640 1 -- 172.21.15.131:0/1568550063 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa140b9710 con 0x7faa1414b370 2024-04-12T19:39:27.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.297+0000 7faa18c00640 1 -- 172.21.15.131:0/1568550063 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa140b9430 con 0x7faa1414b370 2024-04-12T19:39:27.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.298+0000 7faa18c00640 1 -- 172.21.15.131:0/1568550063 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa1404fd50 con 0x7faa1414b370 2024-04-12T19:39:27.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.299+0000 7faa0be00640 1 -- 172.21.15.131:0/1568550063 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa0c01a070 con 0x7faa1414b370 2024-04-12T19:39:27.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.300+0000 7faa0be00640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa9f006c8f0 0x7fa9f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.300+0000 7faa0be00640 1 -- 172.21.15.131:0/1568550063 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7faa0c08b440 con 0x7faa1414b370 2024-04-12T19:39:27.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.300+0000 7faa13400640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa9f006c8f0 0x7fa9f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.301+0000 7faa13400640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa9f006c8f0 0x7fa9f006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faa04006fd0 tx=0x7faa04008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:27.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.305+0000 7faa0be00640 1 -- 172.21.15.131:0/1568550063 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa0c058ed0 con 0x7faa1414b370 2024-04-12T19:39:27.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.501+0000 7faa18c00640 1 -- 172.21.15.131:0/1568550063 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faa140a83b0 con 0x7faa1414b370 2024-04-12T19:39:27.501 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.502+0000 7faa0be00640 1 -- 172.21.15.131:0/1568550063 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7faa0c05d1d0 con 0x7faa1414b370 2024-04-12T19:39:27.502 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-12T19:39:27.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.504+0000 7faa18c00640 1 -- 172.21.15.131:0/1568550063 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa9f006c8f0 msgr2=0x7fa9f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.504+0000 7faa18c00640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa9f006c8f0 0x7fa9f006edb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faa04006fd0 tx=0x7faa04008040 comp rx=0 tx=0).stop 2024-04-12T19:39:27.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.504+0000 7faa18c00640 1 -- 172.21.15.131:0/1568550063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1414b370 msgr2=0x7faa14152fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.504+0000 7faa18c00640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1414b370 0x7faa14152fb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7faa0c00c7b0 tx=0x7faa0c00cc70 comp rx=0 tx=0).stop 2024-04-12T19:39:27.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.504+0000 7faa18c00640 1 -- 172.21.15.131:0/1568550063 shutdown_connections 2024-04-12T19:39:27.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.504+0000 7faa18c00640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa9f006c8f0 0x7fa9f006edb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.504+0000 7faa18c00640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa140be690 0x7faa140baf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.504+0000 7faa18c00640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa1414b370 0x7faa14152fb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.504+0000 7faa18c00640 1 --2- 172.21.15.131:0/1568550063 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa1406f550 0x7faa140bbd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.504+0000 7faa18c00640 1 -- 172.21.15.131:0/1568550063 >> 172.21.15.131:0/1568550063 conn(0x7faa1406b9e0 msgr2=0x7faa1414a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:27.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.505+0000 7faa18c00640 1 -- 172.21.15.131:0/1568550063 shutdown_connections 2024-04-12T19:39:27.505 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.505+0000 7faa18c00640 1 -- 172.21.15.131:0/1568550063 wait complete. 2024-04-12T19:39:27.523 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-12T19:39:27.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.729+0000 7f2adae00640 1 Processor -- start 2024-04-12T19:39:27.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.729+0000 7f2adae00640 1 -- start start 2024-04-12T19:39:27.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.730+0000 7f2adae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad40c1500 0x7f2ad414b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.731+0000 7f2adae00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2ad40c6060 0x7f2ad406dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.731+0000 7f2adae00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad4151e40 con 0x7f2ad414b5e0 2024-04-12T19:39:27.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.731+0000 7f2adae00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2ad40c05d0 con 0x7f2ad40c6060 2024-04-12T19:39:27.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.731+0000 7f2adae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2ad4151bf0 con 0x7f2ad40c1500 2024-04-12T19:39:27.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.731+0000 7f2ad3400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f2ad414b5e0 0x7f2ad40c5950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60132/0 (socket says 172.21.15.131:60132) 2024-04-12T19:39:27.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.731+0000 7f2ad3400640 1 -- 172.21.15.131:0/821238291 learned_addr learned my addr 172.21.15.131:0/821238291 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:27.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.731+0000 7f2ad3e00640 1 --2- 172.21.15.131:0/821238291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad40c1500 0x7f2ad414b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.731+0000 7f2ad8e00640 1 --2- 172.21.15.131:0/821238291 >> v2:172.21.15.171:3300/0 conn(0x7f2ad40c6060 0x7f2ad406dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.731+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2955219446 0 0) 0x7f2ad4151e40 con 0x7f2ad414b5e0 2024-04-12T19:39:27.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.731+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ab8003520 con 0x7f2ad414b5e0 2024-04-12T19:39:27.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3595266619 0 0) 0x7f2ab8003520 con 0x7f2ad414b5e0 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad40c1500 msgr2=0x7f2ad414b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 --2- 172.21.15.131:0/821238291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad40c1500 0x7f2ad414b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 >> v2:172.21.15.171:3300/0 conn(0x7f2ad40c6060 msgr2=0x7f2ad406dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 --2- 172.21.15.131:0/821238291 >> v2:172.21.15.171:3300/0 conn(0x7f2ad40c6060 0x7f2ad406dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad40c4e50 con 0x7f2ad414b5e0 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f2ac0001670 con 0x7f2ad414b5e0 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 >> v1:172.21.15.131:6789/0 conn(0x7f2ad414b5e0 legacy=0x7f2ad40c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 --2- 172.21.15.131:0/821238291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ab80039b0 0x7f2ab8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 --2- 172.21.15.131:0/821238291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad40c1500 0x7f2ab8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 --2- 172.21.15.131:0/821238291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab8004d40 0x7f2ab80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad40c05d0 con 0x7f2ab80039b0 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad4151bf0 con 0x7f2ab8004d40 2024-04-12T19:39:27.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2ab800b9c0 con 0x7f2ad40c1500 2024-04-12T19:39:27.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.732+0000 7f2ad3e00640 1 --2- 172.21.15.131:0/821238291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ab80039b0 0x7f2ab8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.733+0000 7f2ad3400640 1 --2- 172.21.15.131:0/821238291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad40c1500 0x7f2ab8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.733+0000 7f2ad3e00640 1 -- 172.21.15.131:0/821238291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad40c1500 msgr2=0x7f2ab8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:27.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.733+0000 7f2ad8e00640 1 --2- 172.21.15.131:0/821238291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab8004d40 0x7f2ab80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.733+0000 7f2ad3e00640 1 --2- 172.21.15.131:0/821238291 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad40c1500 0x7f2ab8004800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.733+0000 7f2ad3e00640 1 -- 172.21.15.131:0/821238291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab8004d40 msgr2=0x7f2ab80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:27.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.733+0000 7f2ad3e00640 1 --2- 172.21.15.131:0/821238291 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ab8004d40 0x7f2ab80051c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.733+0000 7f2ad3e00640 1 -- 172.21.15.131:0/821238291 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ab8003520 con 0x7f2ab80039b0 2024-04-12T19:39:27.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.734+0000 7f2ad3e00640 1 --2- 172.21.15.131:0/821238291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ab80039b0 0x7f2ab8003dd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009ac0 tx=0x7f2ab8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00ad769cf5ff259 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:27.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.734+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4039070 con 0x7f2ab80039b0 2024-04-12T19:39:27.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.734+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac402c6b0 con 0x7f2ab80039b0 2024-04-12T19:39:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.734+0000 7f2ad2a00640 1 -- 172.21.15.131:0/821238291 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4009690 con 0x7f2ab80039b0 2024-04-12T19:39:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.734+0000 7f2adae00640 1 -- 172.21.15.131:0/821238291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ab80039b0 msgr2=0x7f2ab8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.734+0000 7f2adae00640 1 --2- 172.21.15.131:0/821238291 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ab80039b0 0x7f2ab8003dd0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4009ac0 tx=0x7f2ab8005830 comp rx=0 tx=0).stop 2024-04-12T19:39:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.734+0000 7f2ad8e00640 1 -- 172.21.15.131:0/821238291 reap_dead start 2024-04-12T19:39:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.735+0000 7f2adae00640 1 -- 172.21.15.131:0/821238291 shutdown_connections 2024-04-12T19:39:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.735+0000 7f2adae00640 1 -- 172.21.15.131:0/821238291 >> 172.21.15.131:0/821238291 conn(0x7f2ad40a8400 msgr2=0x7f2ad40a8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.735+0000 7f2adae00640 1 -- 172.21.15.131:0/821238291 shutdown_connections 2024-04-12T19:39:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.735+0000 7f2adae00640 1 -- 172.21.15.131:0/821238291 wait complete. 2024-04-12T19:39:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.736+0000 7f2adae00640 1 Processor -- start 2024-04-12T19:39:27.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.736+0000 7f2adae00640 1 -- start start 2024-04-12T19:39:27.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.737+0000 7f2adae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ab80039b0 0x7f2ad406de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.737+0000 7f2adae00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad41e72f0 0x7f2ad40abab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.737+0000 7f2adae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad41e7750 0x7f2ad40abff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.737+0000 7f2adae00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad40c5410 con 0x7f2ab80039b0 2024-04-12T19:39:27.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.737+0000 7f2adae00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2ad4152120 con 0x7f2ad41e72f0 2024-04-12T19:39:27.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.737+0000 7f2adae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2ad40c0c10 con 0x7f2ad41e7750 2024-04-12T19:39:27.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.737+0000 7f2ad3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ab80039b0 0x7f2ad406de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.738+0000 7f2ad3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ab80039b0 0x7f2ad406de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44712/0 (socket says 172.21.15.131:44712) 2024-04-12T19:39:27.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.738+0000 7f2ad3e00640 1 -- 172.21.15.131:0/4158218813 learned_addr learned my addr 172.21.15.131:0/4158218813 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:27.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.738+0000 7f2ad3e00640 1 -- 172.21.15.131:0/4158218813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad41e7750 msgr2=0x7f2ad40abff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.738+0000 7f2ad3e00640 1 --2- 172.21.15.131:0/4158218813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad41e7750 0x7f2ad40abff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.738+0000 7f2ad3e00640 1 -- 172.21.15.131:0/4158218813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad41e72f0 msgr2=0x7f2ad40abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.738+0000 7f2ad3e00640 1 --2- 172.21.15.131:0/4158218813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad41e72f0 0x7f2ad40abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.738+0000 7f2ad3e00640 1 -- 172.21.15.131:0/4158218813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad406e3b0 con 0x7f2ab80039b0 2024-04-12T19:39:27.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.738+0000 7f2ad3e00640 1 --2- 172.21.15.131:0/4158218813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ab80039b0 0x7f2ad406de70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4000c00 tx=0x7f2ac4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:27.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.738+0000 7f2acbe00640 1 -- 172.21.15.131:0/4158218813 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4042020 con 0x7f2ab80039b0 2024-04-12T19:39:27.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.738+0000 7f2acbe00640 1 -- 172.21.15.131:0/4158218813 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2ac403a040 con 0x7f2ab80039b0 2024-04-12T19:39:27.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.738+0000 7f2adae00640 1 -- 172.21.15.131:0/4158218813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad40bcfb0 con 0x7f2ab80039b0 2024-04-12T19:39:27.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.738+0000 7f2acbe00640 1 -- 172.21.15.131:0/4158218813 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ac4039070 con 0x7f2ab80039b0 2024-04-12T19:39:27.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.739+0000 7f2adae00640 1 -- 172.21.15.131:0/4158218813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ad41ead90 con 0x7f2ab80039b0 2024-04-12T19:39:27.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.740+0000 7f2adae00640 1 -- 172.21.15.131:0/4158218813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ad4073570 con 0x7f2ab80039b0 2024-04-12T19:39:27.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.741+0000 7f2acbe00640 1 -- 172.21.15.131:0/4158218813 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2ac4045020 con 0x7f2ab80039b0 2024-04-12T19:39:27.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.741+0000 7f2acbe00640 1 --2- 172.21.15.131:0/4158218813 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2ab406c8f0 0x7f2ab406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:27.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.742+0000 7f2acbe00640 1 -- 172.21.15.131:0/4158218813 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2ac40acc90 con 0x7f2ab80039b0 2024-04-12T19:39:27.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.742+0000 7f2ad3400640 1 --2- 172.21.15.131:0/4158218813 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2ab406c8f0 0x7f2ab406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:27.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.742+0000 7f2ad3400640 1 --2- 172.21.15.131:0/4158218813 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2ab406c8f0 0x7f2ab406edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0000f60 tx=0x7f2ac0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:27.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.746+0000 7f2acbe00640 1 -- 172.21.15.131:0/4158218813 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2ad4073570 con 0x7f2ab80039b0 2024-04-12T19:39:27.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.970+0000 7f2adae00640 1 -- 172.21.15.131:0/4158218813 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2ad404fd50 con 0x7f2ab80039b0 2024-04-12T19:39:27.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.971+0000 7f2acbe00640 1 -- 172.21.15.131:0/4158218813 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f2ac407ad70 con 0x7f2ab80039b0 2024-04-12T19:39:27.971 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T19:39:27.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.973+0000 7f2adae00640 1 -- 172.21.15.131:0/4158218813 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2ab406c8f0 msgr2=0x7f2ab406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.973+0000 7f2adae00640 1 --2- 172.21.15.131:0/4158218813 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2ab406c8f0 0x7f2ab406edb0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2ac0000f60 tx=0x7f2ac0009040 comp rx=0 tx=0).stop 2024-04-12T19:39:27.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.973+0000 7f2adae00640 1 -- 172.21.15.131:0/4158218813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ab80039b0 msgr2=0x7f2ad406de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:27.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.973+0000 7f2adae00640 1 --2- 172.21.15.131:0/4158218813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ab80039b0 0x7f2ad406de70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2ac4000c00 tx=0x7f2ac4004730 comp rx=0 tx=0).stop 2024-04-12T19:39:27.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.973+0000 7f2adae00640 1 -- 172.21.15.131:0/4158218813 shutdown_connections 2024-04-12T19:39:27.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.973+0000 7f2adae00640 1 --2- 172.21.15.131:0/4158218813 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2ab406c8f0 0x7f2ab406edb0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.973+0000 7f2adae00640 1 --2- 172.21.15.131:0/4158218813 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2ad41e72f0 0x7f2ad40abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.973+0000 7f2adae00640 1 --2- 172.21.15.131:0/4158218813 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2ad41e7750 0x7f2ad40abff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.973+0000 7f2adae00640 1 --2- 172.21.15.131:0/4158218813 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2ab80039b0 0x7f2ad406de70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:27.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.973+0000 7f2adae00640 1 -- 172.21.15.131:0/4158218813 >> 172.21.15.131:0/4158218813 conn(0x7f2ad40a8400 msgr2=0x7f2ad414a5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:27.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.973+0000 7f2adae00640 1 -- 172.21.15.131:0/4158218813 shutdown_connections 2024-04-12T19:39:27.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:27.974+0000 7f2adae00640 1 -- 172.21.15.131:0/4158218813 wait complete. 2024-04-12T19:39:27.993 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-12T19:39:28.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.189+0000 7f0a0fe00640 1 Processor -- start 2024-04-12T19:39:28.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.189+0000 7f0a0fe00640 1 -- start start 2024-04-12T19:39:28.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.190+0000 7f0a0fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0a100be420 0x7f0a100be800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.190+0000 7f0a0fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a101546f0 0x7f0a100bd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.190+0000 7f0a0fe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0a100bf1c0 0x7f0a100bf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.190+0000 7f0a0fe00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f0a10155630 con 0x7f0a100be420 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.190+0000 7f0a0fe00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f0a100bed40 con 0x7f0a100bf1c0 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.190+0000 7f0a0fe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0a1006e3c0 con 0x7f0a101546f0 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.190+0000 7f0a0ea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0a100be420 0x7f0a100be800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.190+0000 7f0a0ea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f0a100be420 0x7f0a100be800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44718/0 (socket says 172.21.15.131:44718) 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.191+0000 7f0a0ea00640 1 -- 172.21.15.131:0/1733117669 learned_addr learned my addr 172.21.15.131:0/1733117669 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.191+0000 7f0a0e000640 1 --2- 172.21.15.131:0/1733117669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a101546f0 0x7f0a100bd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.191+0000 7f0a0f400640 1 --2- 172.21.15.131:0/1733117669 >> v2:172.21.15.171:3300/0 conn(0x7f0a100bf1c0 0x7f0a100bf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.191+0000 7f0a0ea00640 1 -- 172.21.15.131:0/1733117669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a101546f0 msgr2=0x7f0a100bd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.191+0000 7f0a0ea00640 1 --2- 172.21.15.131:0/1733117669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a101546f0 0x7f0a100bd2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.191+0000 7f0a0ea00640 1 -- 172.21.15.131:0/1733117669 >> v2:172.21.15.171:3300/0 conn(0x7f0a100bf1c0 msgr2=0x7f0a100bf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.191+0000 7f0a0ea00640 1 --2- 172.21.15.131:0/1733117669 >> v2:172.21.15.171:3300/0 conn(0x7f0a100bf1c0 0x7f0a100bf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.191+0000 7f0a0ea00640 1 -- 172.21.15.131:0/1733117669 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a1006e660 con 0x7f0a100be420 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.192+0000 7f0a0ea00640 1 --2- 172.21.15.131:0/1733117669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a100be420 0x7f0a100be800 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0a100a52d0 tx=0x7f0a0002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=925a7b3f1b3b3ee0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.192+0000 7f0a0d600640 1 -- 172.21.15.131:0/1733117669 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00038070 con 0x7f0a100be420 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.192+0000 7f0a0d600640 1 -- 172.21.15.131:0/1733117669 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a0002f050 con 0x7f0a100be420 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.192+0000 7f0a0d600640 1 -- 172.21.15.131:0/1733117669 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a00031970 con 0x7f0a100be420 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.193+0000 7f0a0fe00640 1 -- 172.21.15.131:0/1733117669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a100be420 msgr2=0x7f0a100be800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.193+0000 7f0a0fe00640 1 --2- 172.21.15.131:0/1733117669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a100be420 0x7f0a100be800 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0a100a52d0 tx=0x7f0a0002b7f0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.193+0000 7f0a0fe00640 1 -- 172.21.15.131:0/1733117669 shutdown_connections 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.193+0000 7f0a0fe00640 1 --2- 172.21.15.131:0/1733117669 >> v2:172.21.15.171:3300/0 conn(0x7f0a100bf1c0 0x7f0a100bf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.193+0000 7f0a0fe00640 1 --2- 172.21.15.131:0/1733117669 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a101546f0 0x7f0a100bd2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.193+0000 7f0a0fe00640 1 --2- 172.21.15.131:0/1733117669 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a100be420 0x7f0a100be800 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.193+0000 7f0a0fe00640 1 -- 172.21.15.131:0/1733117669 >> 172.21.15.131:0/1733117669 conn(0x7f0a1006bbc0 msgr2=0x7f0a1006bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.193+0000 7f0a0fe00640 1 -- 172.21.15.131:0/1733117669 shutdown_connections 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.193+0000 7f0a0fe00640 1 -- 172.21.15.131:0/1733117669 wait complete. 2024-04-12T19:39:28.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.195+0000 7f0a0fe00640 1 Processor -- start 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.195+0000 7f0a0fe00640 1 -- start start 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.196+0000 7f0a0fe00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a100be420 0x7f0a101520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.196+0000 7f0a0fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a100bf1c0 0x7f0a1014f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.196+0000 7f0a0fe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a101546f0 0x7f0a10152d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.196+0000 7f0a0fe00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1006f420 con 0x7f0a100bf1c0 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.196+0000 7f0a0fe00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0a1006ec20 con 0x7f0a100be420 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.196+0000 7f0a0fe00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0a100b92d0 con 0x7f0a101546f0 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.196+0000 7f0a0e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a100bf1c0 0x7f0a1014f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a0e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a100bf1c0 0x7f0a1014f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44726/0 (socket says 172.21.15.131:44726) 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a0e000640 1 -- 172.21.15.131:0/2308886429 learned_addr learned my addr 172.21.15.131:0/2308886429 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a0f400640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a101546f0 0x7f0a10152d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a0e000640 1 -- 172.21.15.131:0/2308886429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a101546f0 msgr2=0x7f0a10152d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a0e000640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a101546f0 0x7f0a10152d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a0e000640 1 -- 172.21.15.131:0/2308886429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a100be420 msgr2=0x7f0a101520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:28.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a0e000640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a100be420 0x7f0a101520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a0e000640 1 -- 172.21.15.131:0/2308886429 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a10072340 con 0x7f0a100bf1c0 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a0e000640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a100bf1c0 0x7f0a1014f870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f09f800c7f0 tx=0x7f09f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a06a00640 1 -- 172.21.15.131:0/2308886429 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f8015070 con 0x7f0a100bf1c0 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a06a00640 1 -- 172.21.15.131:0/2308886429 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09f8004240 con 0x7f0a100bf1c0 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a06a00640 1 -- 172.21.15.131:0/2308886429 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09f8007620 con 0x7f0a100bf1c0 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.197+0000 7f0a0fe00640 1 -- 172.21.15.131:0/2308886429 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a10072060 con 0x7f0a100bf1c0 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.198+0000 7f0a0fe00640 1 -- 172.21.15.131:0/2308886429 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a101eace0 con 0x7f0a100bf1c0 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.199+0000 7f0a0fe00640 1 -- 172.21.15.131:0/2308886429 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a1004fd50 con 0x7f0a100bf1c0 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.200+0000 7f0a06a00640 1 -- 172.21.15.131:0/2308886429 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f09f80079d0 con 0x7f0a100bf1c0 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.201+0000 7f0a06a00640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f09ec06c8f0 0x7f09ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.201+0000 7f0a06a00640 1 -- 172.21.15.131:0/2308886429 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f09f808c2c0 con 0x7f0a100bf1c0 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.201+0000 7f0a0ea00640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f09ec06c8f0 0x7f09ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.201+0000 7f0a0ea00640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f09ec06c8f0 0x7f09ec06edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a00035000 tx=0x7f0a00030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:28.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.205+0000 7f0a06a00640 1 -- 172.21.15.131:0/2308886429 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f09f805a3a0 con 0x7f0a100bf1c0 2024-04-12T19:39:28.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.408+0000 7f0a0fe00640 1 -- 172.21.15.131:0/2308886429 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f0a1006c1c0 con 0x7f0a100bf1c0 2024-04-12T19:39:28.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.409+0000 7f0a06a00640 1 -- 172.21.15.131:0/2308886429 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f09f8059ca0 con 0x7f0a100bf1c0 2024-04-12T19:39:28.409 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-12T19:39:28.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.411+0000 7f0a0fe00640 1 -- 172.21.15.131:0/2308886429 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f09ec06c8f0 msgr2=0x7f09ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:28.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.411+0000 7f0a0fe00640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f09ec06c8f0 0x7f09ec06edb0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0a00035000 tx=0x7f0a00030000 comp rx=0 tx=0).stop 2024-04-12T19:39:28.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.411+0000 7f0a0fe00640 1 -- 172.21.15.131:0/2308886429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a100bf1c0 msgr2=0x7f0a1014f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:28.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.411+0000 7f0a0fe00640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a100bf1c0 0x7f0a1014f870 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f09f800c7f0 tx=0x7f09f800ccb0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.411+0000 7f0a0fe00640 1 -- 172.21.15.131:0/2308886429 shutdown_connections 2024-04-12T19:39:28.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.411+0000 7f0a0fe00640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f09ec06c8f0 0x7f09ec06edb0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.411+0000 7f0a0fe00640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0a101546f0 0x7f0a10152d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.411+0000 7f0a0fe00640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0a100bf1c0 0x7f0a1014f870 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.411+0000 7f0a0fe00640 1 --2- 172.21.15.131:0/2308886429 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0a100be420 0x7f0a101520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.411+0000 7f0a0fe00640 1 -- 172.21.15.131:0/2308886429 >> 172.21.15.131:0/2308886429 conn(0x7f0a1006bbc0 msgr2=0x7f0a100b8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:28.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.411+0000 7f0a0fe00640 1 -- 172.21.15.131:0/2308886429 shutdown_connections 2024-04-12T19:39:28.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.412+0000 7f0a0fe00640 1 -- 172.21.15.131:0/2308886429 wait complete. 2024-04-12T19:39:28.430 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-12T19:39:28.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.623+0000 7f852d200640 1 Processor -- start 2024-04-12T19:39:28.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.624+0000 7f852d200640 1 -- start start 2024-04-12T19:39:28.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.625+0000 7f852d200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f852815a910 0x7f852815cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.625+0000 7f852d200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8528150f90 con 0x7f8528151d10 2024-04-12T19:39:28.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.625+0000 7f852d200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f852806fdb0 con 0x7f85280bf800 2024-04-12T19:39:28.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.625+0000 7f852d200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8528070090 con 0x7f852815a910 2024-04-12T19:39:28.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.625+0000 7f8527400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8528151d10 0x7f85280c06c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:60136/0 (socket says 172.21.15.131:60136) 2024-04-12T19:39:28.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.625+0000 7f8527400640 1 -- 172.21.15.131:0/3146469761 learned_addr learned my addr 172.21.15.131:0/3146469761 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:28.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4245778421 0 0) 0x7f8528150f90 con 0x7f8528151d10 2024-04-12T19:39:28.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f850c003520 con 0x7f8528151d10 2024-04-12T19:39:28.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8527e00640 1 --2- 172.21.15.131:0/3146469761 >> v2:172.21.15.171:3300/0 conn(0x7f852815a910 0x7f852815cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2213151915 0 0) 0x7f850c003520 con 0x7f8528151d10 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 >> v2:172.21.15.171:3300/0 conn(0x7f852815a910 msgr2=0x7f852815cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 --2- 172.21.15.131:0/3146469761 >> v2:172.21.15.171:3300/0 conn(0x7f852815a910 0x7f852815cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 >> v1:172.21.15.171:6789/0 conn(0x7f85280bf800 legacy=0x7f8528154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8528070370 con 0x7f8528151d10 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f8518001690 con 0x7f8528151d10 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 >> v1:172.21.15.131:6789/0 conn(0x7f8528151d10 legacy=0x7f85280c06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 --2- 172.21.15.131:0/3146469761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f850c0039b0 0x7f850c003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 --2- 172.21.15.131:0/3146469761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c004800 0x7f850c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 --2- 172.21.15.131:0/3146469761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f850c0053c0 0x7f850c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8528070090 con 0x7f850c0039b0 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f850c00c250 con 0x7f850c0053c0 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.626+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f850c00c450 con 0x7f850c004800 2024-04-12T19:39:28.630 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.627+0000 7f8527400640 1 --2- 172.21.15.131:0/3146469761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f850c0039b0 0x7f850c003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.627+0000 7f8527400640 1 -- 172.21.15.131:0/3146469761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c004800 msgr2=0x7f850c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.627+0000 7f8527e00640 1 --2- 172.21.15.131:0/3146469761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f850c0053c0 0x7f850c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.627+0000 7f8527400640 1 --2- 172.21.15.131:0/3146469761 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c004800 0x7f850c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.627+0000 7f8527400640 1 -- 172.21.15.131:0/3146469761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f850c0053c0 msgr2=0x7f850c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.627+0000 7f8527400640 1 --2- 172.21.15.131:0/3146469761 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f850c0053c0 0x7f850c00b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.627+0000 7f8527400640 1 -- 172.21.15.131:0/3146469761 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f850c003520 con 0x7f850c0039b0 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.627+0000 7f8527e00640 1 -- 172.21.15.131:0/3146469761 reap_dead start 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.628+0000 7f8527400640 1 --2- 172.21.15.131:0/3146469761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f850c0039b0 0x7f850c003dd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f851800c210 tx=0x7f850c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d0cbe264b22edb server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.628+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518007d10 con 0x7f850c0039b0 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.628+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8518030070 con 0x7f850c0039b0 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.628+0000 7f8526000640 1 -- 172.21.15.131:0/3146469761 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8518005d70 con 0x7f850c0039b0 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.629+0000 7f852d200640 1 -- 172.21.15.131:0/3146469761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f850c0039b0 msgr2=0x7f850c003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.629+0000 7f852d200640 1 --2- 172.21.15.131:0/3146469761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f850c0039b0 0x7f850c003dd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f851800c210 tx=0x7f850c005830 comp rx=0 tx=0).stop 2024-04-12T19:39:28.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.629+0000 7f852d200640 1 -- 172.21.15.131:0/3146469761 shutdown_connections 2024-04-12T19:39:28.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.629+0000 7f852d200640 1 --2- 172.21.15.131:0/3146469761 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f850c0039b0 0x7f850c003dd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.629+0000 7f852d200640 1 -- 172.21.15.131:0/3146469761 >> 172.21.15.131:0/3146469761 conn(0x7f85280c3b60 msgr2=0x7f85280bffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:28.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.629+0000 7f852d200640 1 -- 172.21.15.131:0/3146469761 shutdown_connections 2024-04-12T19:39:28.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.629+0000 7f852d200640 1 -- 172.21.15.131:0/3146469761 wait complete. 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.630+0000 7f852d200640 1 Processor -- start 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.631+0000 7f852d200640 1 -- start start 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.631+0000 7f852d200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c0039b0 0x7f85280b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.631+0000 7f852d200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8528144cf0 0x7f8528147ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.631+0000 7f852d200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85281ea050 0x7f85281ea4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.631+0000 7f852d200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f85280be030 con 0x7f8528144cf0 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.631+0000 7f852d200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f85280bdeb0 con 0x7f85281ea050 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.631+0000 7f852d200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8528072dd0 con 0x7f850c0039b0 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.632+0000 7f8526a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8528144cf0 0x7f8528147ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.632+0000 7f8526a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8528144cf0 0x7f8528147ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44734/0 (socket says 172.21.15.131:44734) 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.632+0000 7f8526a00640 1 -- 172.21.15.131:0/2668552644 learned_addr learned my addr 172.21.15.131:0/2668552644 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.632+0000 7f8526a00640 1 -- 172.21.15.131:0/2668552644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c0039b0 msgr2=0x7f85280b88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:28.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.632+0000 7f8526a00640 1 --2- 172.21.15.131:0/2668552644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c0039b0 0x7f85280b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.632+0000 7f8526a00640 1 -- 172.21.15.131:0/2668552644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85281ea050 msgr2=0x7f85281ea4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.632+0000 7f8526a00640 1 --2- 172.21.15.131:0/2668552644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85281ea050 0x7f85281ea4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.632+0000 7f8526a00640 1 -- 172.21.15.131:0/2668552644 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8528148220 con 0x7f8528144cf0 2024-04-12T19:39:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.632+0000 7f8526a00640 1 --2- 172.21.15.131:0/2668552644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8528144cf0 0x7f8528147ce0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f851400c3f0 tx=0x7f851400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.633+0000 7f851f400640 1 -- 172.21.15.131:0/2668552644 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514017070 con 0x7f8528144cf0 2024-04-12T19:39:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.633+0000 7f851f400640 1 -- 172.21.15.131:0/2668552644 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f85140052f0 con 0x7f8528144cf0 2024-04-12T19:39:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.633+0000 7f851f400640 1 -- 172.21.15.131:0/2668552644 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8514003830 con 0x7f8528144cf0 2024-04-12T19:39:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.633+0000 7f852d200640 1 -- 172.21.15.131:0/2668552644 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85281e7600 con 0x7f8528144cf0 2024-04-12T19:39:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.633+0000 7f852d200640 1 -- 172.21.15.131:0/2668552644 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85281488a0 con 0x7f8528144cf0 2024-04-12T19:39:28.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.634+0000 7f852d200640 1 -- 172.21.15.131:0/2668552644 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85280c2280 con 0x7f8528144cf0 2024-04-12T19:39:28.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.635+0000 7f851f400640 1 -- 172.21.15.131:0/2668552644 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f851401a070 con 0x7f8528144cf0 2024-04-12T19:39:28.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.636+0000 7f851f400640 1 --2- 172.21.15.131:0/2668552644 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f850806c8f0 0x7f850806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:28.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.636+0000 7f851f400640 1 -- 172.21.15.131:0/2668552644 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f851408b110 con 0x7f8528144cf0 2024-04-12T19:39:28.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.636+0000 7f8527400640 1 --2- 172.21.15.131:0/2668552644 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f850806c8f0 0x7f850806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:28.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.637+0000 7f8527400640 1 --2- 172.21.15.131:0/2668552644 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f850806c8f0 0x7f850806edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8518034000 tx=0x7f851802e000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:28.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.640+0000 7f851f400640 1 -- 172.21.15.131:0/2668552644 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f85280c2280 con 0x7f8528144cf0 2024-04-12T19:39:28.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.838+0000 7f852d200640 1 -- 172.21.15.131:0/2668552644 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f852804fd50 con 0x7f8528144cf0 2024-04-12T19:39:28.839 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.839+0000 7f851f400640 1 -- 172.21.15.131:0/2668552644 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f8514059350 con 0x7f8528144cf0 2024-04-12T19:39:28.839 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T19:39:28.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.842+0000 7f852d200640 1 -- 172.21.15.131:0/2668552644 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f850806c8f0 msgr2=0x7f850806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:28.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.842+0000 7f852d200640 1 --2- 172.21.15.131:0/2668552644 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f850806c8f0 0x7f850806edb0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8518034000 tx=0x7f851802e000 comp rx=0 tx=0).stop 2024-04-12T19:39:28.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.842+0000 7f852d200640 1 -- 172.21.15.131:0/2668552644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8528144cf0 msgr2=0x7f8528147ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:28.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.842+0000 7f852d200640 1 --2- 172.21.15.131:0/2668552644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8528144cf0 0x7f8528147ce0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f851400c3f0 tx=0x7f851400c8b0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.842+0000 7f852d200640 1 -- 172.21.15.131:0/2668552644 shutdown_connections 2024-04-12T19:39:28.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.842+0000 7f852d200640 1 --2- 172.21.15.131:0/2668552644 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f850806c8f0 0x7f850806edb0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.842+0000 7f852d200640 1 --2- 172.21.15.131:0/2668552644 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f85281ea050 0x7f85281ea4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.842+0000 7f852d200640 1 --2- 172.21.15.131:0/2668552644 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8528144cf0 0x7f8528147ce0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.842+0000 7f852d200640 1 --2- 172.21.15.131:0/2668552644 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f850c0039b0 0x7f85280b88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:28.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.842+0000 7f852d200640 1 -- 172.21.15.131:0/2668552644 >> 172.21.15.131:0/2668552644 conn(0x7f85280c3b60 msgr2=0x7f852806b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:28.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.842+0000 7f852d200640 1 -- 172.21.15.131:0/2668552644 shutdown_connections 2024-04-12T19:39:28.843 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:28.842+0000 7f852d200640 1 -- 172.21.15.131:0/2668552644 wait complete. 2024-04-12T19:39:28.861 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-12T19:39:29.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.055+0000 7ff38b000640 1 Processor -- start 2024-04-12T19:39:29.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.055+0000 7ff38b000640 1 -- start start 2024-04-12T19:39:29.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.057+0000 7ff38b000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff3840b8460 0x7ff384151910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:29.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.057+0000 7ff38b000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ff3840beb40 0x7ff384151e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:29.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.057+0000 7ff38b000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3840be300 con 0x7ff3840bf720 2024-04-12T19:39:29.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.057+0000 7ff38b000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ff3840b76e0 con 0x7ff3840b8460 2024-04-12T19:39:29.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.057+0000 7ff38b000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ff3840bd140 con 0x7ff3840beb40 2024-04-12T19:39:29.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.057+0000 7ff383400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff3840b8460 0x7ff384151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:29.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.057+0000 7ff383400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ff3840b8460 0x7ff384151910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44736/0 (socket says 172.21.15.131:44736) 2024-04-12T19:39:29.057 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.057+0000 7ff383400640 1 -- 172.21.15.131:0/2284969831 learned_addr learned my addr 172.21.15.131:0/2284969831 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:29.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.058+0000 7ff383400640 1 -- 172.21.15.131:0/2284969831 >> v2:172.21.15.171:3300/0 conn(0x7ff3840beb40 msgr2=0x7ff384151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:29.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.058+0000 7ff383400640 1 --2- 172.21.15.131:0/2284969831 >> v2:172.21.15.171:3300/0 conn(0x7ff3840beb40 0x7ff384151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:29.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.058+0000 7ff383400640 1 -- 172.21.15.131:0/2284969831 >> v1:172.21.15.171:6789/0 conn(0x7ff3840bf720 legacy=0x7ff38406e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:29.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.058+0000 7ff383400640 1 -- 172.21.15.131:0/2284969831 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3840b7980 con 0x7ff3840b8460 2024-04-12T19:39:29.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.059+0000 7ff383400640 1 --2- 172.21.15.131:0/2284969831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3840b8460 0x7ff384151910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff3841558a0 tx=0x7ff37002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f831d39ebdb559af server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:29.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.059+0000 7ff382a00640 1 -- 172.21.15.131:0/2284969831 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370035020 con 0x7ff3840b8460 2024-04-12T19:39:29.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.059+0000 7ff382a00640 1 -- 172.21.15.131:0/2284969831 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff370031870 con 0x7ff3840b8460 2024-04-12T19:39:29.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.059+0000 7ff382a00640 1 -- 172.21.15.131:0/2284969831 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff370031c40 con 0x7ff3840b8460 2024-04-12T19:39:29.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.060+0000 7ff38b000640 1 -- 172.21.15.131:0/2284969831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3840b8460 msgr2=0x7ff384151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:29.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.060+0000 7ff38b000640 1 --2- 172.21.15.131:0/2284969831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3840b8460 0x7ff384151910 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff3841558a0 tx=0x7ff37002b910 comp rx=0 tx=0).stop 2024-04-12T19:39:29.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.060+0000 7ff38b000640 1 -- 172.21.15.131:0/2284969831 shutdown_connections 2024-04-12T19:39:29.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.060+0000 7ff38b000640 1 --2- 172.21.15.131:0/2284969831 >> v2:172.21.15.171:3300/0 conn(0x7ff3840beb40 0x7ff384151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:29.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.060+0000 7ff38b000640 1 --2- 172.21.15.131:0/2284969831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3840b8460 0x7ff384151910 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:29.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.060+0000 7ff38b000640 1 -- 172.21.15.131:0/2284969831 >> 172.21.15.131:0/2284969831 conn(0x7ff38406be00 msgr2=0x7ff38406c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:29.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.060+0000 7ff38b000640 1 -- 172.21.15.131:0/2284969831 shutdown_connections 2024-04-12T19:39:29.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.060+0000 7ff38b000640 1 -- 172.21.15.131:0/2284969831 wait complete. 2024-04-12T19:39:29.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.061+0000 7ff38b000640 1 Processor -- start 2024-04-12T19:39:29.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.062+0000 7ff38b000640 1 -- start start 2024-04-12T19:39:29.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.062+0000 7ff38b000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3840b8460 0x7ff384148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:29.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.062+0000 7ff38b000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3840beb40 0x7ff38414d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:29.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.062+0000 7ff38b000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3840bf720 0x7ff38414dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:29.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.062+0000 7ff38b000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ff3840b92f0 con 0x7ff3840bf720 2024-04-12T19:39:29.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.062+0000 7ff38b000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ff3840b7f40 con 0x7ff3840beb40 2024-04-12T19:39:29.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.062+0000 7ff38b000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ff3840bdfd0 con 0x7ff3840b8460 2024-04-12T19:39:29.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.063+0000 7ff389000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3840bf720 0x7ff38414dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:29.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.063+0000 7ff389000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3840bf720 0x7ff38414dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:44746/0 (socket says 172.21.15.131:44746) 2024-04-12T19:39:29.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.063+0000 7ff389000640 1 -- 172.21.15.131:0/2344772244 learned_addr learned my addr 172.21.15.131:0/2344772244 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:29.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.063+0000 7ff383400640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3840beb40 0x7ff38414d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:29.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.063+0000 7ff389000640 1 -- 172.21.15.131:0/2344772244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3840b8460 msgr2=0x7ff384148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:29.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.063+0000 7ff389000640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3840b8460 0x7ff384148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:29.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.063+0000 7ff389000640 1 -- 172.21.15.131:0/2344772244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3840beb40 msgr2=0x7ff38414d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:29.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.063+0000 7ff389000640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3840beb40 0x7ff38414d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:29.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.063+0000 7ff389000640 1 -- 172.21.15.131:0/2344772244 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff384149050 con 0x7ff3840bf720 2024-04-12T19:39:29.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.063+0000 7ff389000640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3840bf720 0x7ff38414dc20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00b970 tx=0x7ff37c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:29.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.064+0000 7ff37be00640 1 -- 172.21.15.131:0/2344772244 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c019070 con 0x7ff3840bf720 2024-04-12T19:39:29.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.064+0000 7ff37be00640 1 -- 172.21.15.131:0/2344772244 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff37c00cb60 con 0x7ff3840bf720 2024-04-12T19:39:29.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.064+0000 7ff38b000640 1 -- 172.21.15.131:0/2344772244 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3841e7be0 con 0x7ff3840bf720 2024-04-12T19:39:29.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.064+0000 7ff37be00640 1 -- 172.21.15.131:0/2344772244 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c014440 con 0x7ff3840bf720 2024-04-12T19:39:29.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.064+0000 7ff38b000640 1 -- 172.21.15.131:0/2344772244 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff38414ab70 con 0x7ff3840bf720 2024-04-12T19:39:29.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.065+0000 7ff38b000640 1 -- 172.21.15.131:0/2344772244 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff38414ed20 con 0x7ff3840bf720 2024-04-12T19:39:29.065 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.066+0000 7ff37be00640 1 -- 172.21.15.131:0/2344772244 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ff37c01c070 con 0x7ff3840bf720 2024-04-12T19:39:29.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.067+0000 7ff37be00640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7ff36406c8f0 0x7ff36406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:29.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.067+0000 7ff37be00640 1 -- 172.21.15.131:0/2344772244 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ff37c08bc70 con 0x7ff3840bf720 2024-04-12T19:39:29.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.067+0000 7ff383e00640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7ff36406c8f0 0x7ff36406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:29.067 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.068+0000 7ff383e00640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7ff36406c8f0 0x7ff36406edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff374006fd0 tx=0x7ff374006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:29.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.071+0000 7ff37be00640 1 -- 172.21.15.131:0/2344772244 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ff37c059cc0 con 0x7ff3840bf720 2024-04-12T19:39:29.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.267+0000 7ff38b000640 1 -- 172.21.15.131:0/2344772244 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff38404fd50 con 0x7ff3840bf720 2024-04-12T19:39:29.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.267+0000 7ff37be00640 1 -- 172.21.15.131:0/2344772244 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7ff37c0595c0 con 0x7ff3840bf720 2024-04-12T19:39:29.267 INFO:teuthology.orchestra.run.smithi131.stderr:listed 0 entries 2024-04-12T19:39:29.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.270+0000 7ff38b000640 1 -- 172.21.15.131:0/2344772244 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7ff36406c8f0 msgr2=0x7ff36406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:29.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.270+0000 7ff38b000640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7ff36406c8f0 0x7ff36406edb0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff374006fd0 tx=0x7ff374006bc0 comp rx=0 tx=0).stop 2024-04-12T19:39:29.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.270+0000 7ff38b000640 1 -- 172.21.15.131:0/2344772244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3840bf720 msgr2=0x7ff38414dc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:29.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.270+0000 7ff38b000640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3840bf720 0x7ff38414dc20 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00b970 tx=0x7ff37c00be30 comp rx=0 tx=0).stop 2024-04-12T19:39:29.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.270+0000 7ff38b000640 1 -- 172.21.15.131:0/2344772244 shutdown_connections 2024-04-12T19:39:29.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.270+0000 7ff38b000640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7ff36406c8f0 0x7ff36406edb0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:29.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.270+0000 7ff38b000640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ff3840beb40 0x7ff38414d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:29.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.270+0000 7ff38b000640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff3840bf720 0x7ff38414dc20 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:29.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.270+0000 7ff38b000640 1 --2- 172.21.15.131:0/2344772244 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ff3840b8460 0x7ff384148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:29.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.270+0000 7ff38b000640 1 -- 172.21.15.131:0/2344772244 >> 172.21.15.131:0/2344772244 conn(0x7ff38406be00 msgr2=0x7ff384073250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:29.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.270+0000 7ff38b000640 1 -- 172.21.15.131:0/2344772244 shutdown_connections 2024-04-12T19:39:29.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:29.270+0000 7ff38b000640 1 -- 172.21.15.131:0/2344772244 wait complete. 2024-04-12T19:39:29.289 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi131.front.sepia.ceph.com... 2024-04-12T19:39:29.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:29.289 DEBUG:teuthology.orchestra.run.smithi131:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-12T19:39:29.375 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi131.stderr:ceph-fuse[42102]: fuse finished with error 0 and tester_r 0 2024-04-12T19:39:29.381 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T19:39:35.483 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T19:39:35.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:35.484 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-12T19:39:35.547 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:35.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.767+0000 7f325d000640 1 Processor -- start 2024-04-12T19:39:35.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.767+0000 7f325d000640 1 -- start start 2024-04-12T19:39:35.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.768+0000 7f325d000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32580a8120 0x7f32580728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:35.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.768+0000 7f325d000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f32580a4e60 0x7f3258159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:35.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.768+0000 7f325d000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32581531a0 con 0x7f32580a8500 2024-04-12T19:39:35.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.768+0000 7f325d000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f3258153680 con 0x7f32580a4e60 2024-04-12T19:39:35.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.768+0000 7f325d000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3258071df0 con 0x7f32580a8120 2024-04-12T19:39:35.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.768+0000 7f3256800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f32580a4e60 0x7f3258159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:35.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.769+0000 7f3256800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f32580a4e60 0x7f3258159a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55202/0 (socket says 172.21.15.131:55202) 2024-04-12T19:39:35.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.769+0000 7f3256800640 1 -- 172.21.15.131:0/2579517286 learned_addr learned my addr 172.21.15.131:0/2579517286 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:35.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.769+0000 7f3255e00640 1 --2- 172.21.15.131:0/2579517286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32580a8120 0x7f32580728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:35.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.769+0000 7f3256800640 1 -- 172.21.15.131:0/2579517286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32580a8120 msgr2=0x7f32580728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:35.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.769+0000 7f3256800640 1 --2- 172.21.15.131:0/2579517286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32580a8120 0x7f32580728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:35.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.769+0000 7f3256800640 1 -- 172.21.15.131:0/2579517286 >> v1:172.21.15.131:6789/0 conn(0x7f32580a8500 legacy=0x7f32581526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:35.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.769+0000 7f3256800640 1 -- 172.21.15.131:0/2579517286 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32580720d0 con 0x7f32580a4e60 2024-04-12T19:39:35.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.769+0000 7f3255e00640 1 --2- 172.21.15.131:0/2579517286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32580a8120 0x7f32580728d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:35.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.769+0000 7f3255400640 1 -- 172.21.15.131:0/2579517286 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481840944 0 0) 0x7f32581531a0 con 0x7f32580a8500 2024-04-12T19:39:35.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.770+0000 7f3256800640 1 --2- 172.21.15.131:0/2579517286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32580a4e60 0x7f3258159a80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3250009e50 tx=0x7f325002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cce96bbaad9cf616 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:35.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.770+0000 7f3255400640 1 -- 172.21.15.131:0/2579517286 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f325002cb00 con 0x7f32580a4e60 2024-04-12T19:39:35.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.771+0000 7f3255400640 1 -- 172.21.15.131:0/2579517286 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325002cca0 con 0x7f32580a4e60 2024-04-12T19:39:35.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.771+0000 7f3255400640 1 -- 172.21.15.131:0/2579517286 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3250034610 con 0x7f32580a4e60 2024-04-12T19:39:35.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.771+0000 7f325d000640 1 -- 172.21.15.131:0/2579517286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32580a4e60 msgr2=0x7f3258159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:35.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.771+0000 7f325d000640 1 --2- 172.21.15.131:0/2579517286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32580a4e60 0x7f3258159a80 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f3250009e50 tx=0x7f325002bf60 comp rx=0 tx=0).stop 2024-04-12T19:39:35.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.771+0000 7f325d000640 1 -- 172.21.15.131:0/2579517286 shutdown_connections 2024-04-12T19:39:35.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.771+0000 7f325d000640 1 --2- 172.21.15.131:0/2579517286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32580a4e60 0x7f3258159a80 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:35.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.771+0000 7f325d000640 1 --2- 172.21.15.131:0/2579517286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32580a8120 0x7f32580728d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:35.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.771+0000 7f325d000640 1 -- 172.21.15.131:0/2579517286 >> 172.21.15.131:0/2579517286 conn(0x7f32580c2590 msgr2=0x7f32580c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:35.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.771+0000 7f325d000640 1 -- 172.21.15.131:0/2579517286 shutdown_connections 2024-04-12T19:39:35.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.771+0000 7f325d000640 1 -- 172.21.15.131:0/2579517286 wait complete. 2024-04-12T19:39:35.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.773+0000 7f325d000640 1 Processor -- start 2024-04-12T19:39:35.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.773+0000 7f325d000640 1 -- start start 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.774+0000 7f325d000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32580a4e60 0x7f3258146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.774+0000 7f325d000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32580a8120 0x7f325814a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.774+0000 7f325d000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32580a8500 0x7f32581e8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.774+0000 7f325d000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f325806d970 con 0x7f32580a8120 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.774+0000 7f325d000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3258072e10 con 0x7f32580a4e60 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.774+0000 7f325d000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3258152e00 con 0x7f32580a8500 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.774+0000 7f324d400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32580a8120 0x7f325814a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.774+0000 7f324d400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32580a8120 0x7f325814a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55212/0 (socket says 172.21.15.131:55212) 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.774+0000 7f324d400640 1 -- 172.21.15.131:0/3414038907 learned_addr learned my addr 172.21.15.131:0/3414038907 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f3256800640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32580a8500 0x7f32581e8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f3255e00640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32580a4e60 0x7f3258146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f324d400640 1 -- 172.21.15.131:0/3414038907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32580a8500 msgr2=0x7f32581e8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f324d400640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32580a8500 0x7f32581e8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:35.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f324d400640 1 -- 172.21.15.131:0/3414038907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32580a4e60 msgr2=0x7f3258146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:35.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f324d400640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32580a4e60 0x7f3258146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:35.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f324d400640 1 -- 172.21.15.131:0/3414038907 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3258147060 con 0x7f32580a8120 2024-04-12T19:39:35.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f3256800640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32580a8500 0x7f32581e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:35.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f324d400640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32580a8120 0x7f325814a730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f324000c410 tx=0x7f324000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:35.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f324ea00640 1 -- 172.21.15.131:0/3414038907 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240017070 con 0x7f32580a8120 2024-04-12T19:39:35.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f324ea00640 1 -- 172.21.15.131:0/3414038907 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32400035f0 con 0x7f32580a8120 2024-04-12T19:39:35.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f325d000640 1 -- 172.21.15.131:0/3414038907 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32580bc790 con 0x7f32580a8120 2024-04-12T19:39:35.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.775+0000 7f324ea00640 1 -- 172.21.15.131:0/3414038907 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3240003a00 con 0x7f32580a8120 2024-04-12T19:39:35.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.776+0000 7f325d000640 1 -- 172.21.15.131:0/3414038907 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32580bc4b0 con 0x7f32580a8120 2024-04-12T19:39:35.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.777+0000 7f325d000640 1 -- 172.21.15.131:0/3414038907 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32580a8930 con 0x7f32580a8120 2024-04-12T19:39:35.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.777+0000 7f324ea00640 1 -- 172.21.15.131:0/3414038907 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f324001a070 con 0x7f32580a8120 2024-04-12T19:39:35.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.778+0000 7f324ea00640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f323406c920 0x7f323406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:35.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.778+0000 7f324ea00640 1 -- 172.21.15.131:0/3414038907 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f324008b2b0 con 0x7f32580a8120 2024-04-12T19:39:35.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.779+0000 7f3255e00640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f323406c920 0x7f323406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:35.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.779+0000 7f3255e00640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f323406c920 0x7f323406ede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f324800a990 tx=0x7f3248008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:35.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.783+0000 7f324ea00640 1 -- 172.21.15.131:0/3414038907 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f32580a8930 con 0x7f32580a8120 2024-04-12T19:39:35.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.987+0000 7f325d000640 1 -- 172.21.15.131:0/3414038907 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f32580bffa0 con 0x7f32580a8120 2024-04-12T19:39:35.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.991+0000 7f324ea00640 1 -- 172.21.15.131:0/3414038907 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f32580bffa0 con 0x7f32580a8120 2024-04-12T19:39:35.995 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:35.995 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":26,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:17.479662+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:35.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.994+0000 7f325d000640 1 -- 172.21.15.131:0/3414038907 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f323406c920 msgr2=0x7f323406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:35.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.994+0000 7f325d000640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f323406c920 0x7f323406ede0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f324800a990 tx=0x7f3248008040 comp rx=0 tx=0).stop 2024-04-12T19:39:35.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.994+0000 7f325d000640 1 -- 172.21.15.131:0/3414038907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32580a8120 msgr2=0x7f325814a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:35.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.994+0000 7f325d000640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32580a8120 0x7f325814a730 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f324000c410 tx=0x7f324000c8d0 comp rx=0 tx=0).stop 2024-04-12T19:39:35.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.994+0000 7f325d000640 1 -- 172.21.15.131:0/3414038907 shutdown_connections 2024-04-12T19:39:35.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.994+0000 7f325d000640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f323406c920 0x7f323406ede0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:35.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.994+0000 7f325d000640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32580a8500 0x7f32581e8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:35.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.994+0000 7f325d000640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32580a8120 0x7f325814a730 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:35.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.994+0000 7f325d000640 1 --2- 172.21.15.131:0/3414038907 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32580a4e60 0x7f3258146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:35.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.994+0000 7f325d000640 1 -- 172.21.15.131:0/3414038907 >> 172.21.15.131:0/3414038907 conn(0x7f32580c2590 msgr2=0x7f3258148a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:35.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.994+0000 7f325d000640 1 -- 172.21.15.131:0/3414038907 shutdown_connections 2024-04-12T19:39:35.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:35.994+0000 7f325d000640 1 -- 172.21.15.131:0/3414038907 wait complete. 2024-04-12T19:39:36.015 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:36.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.224+0000 7feeeee00640 1 Processor -- start 2024-04-12T19:39:36.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.224+0000 7feeeee00640 1 -- start start 2024-04-12T19:39:36.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.225+0000 7feeeee00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a8120 0x7feee80728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.225+0000 7feeeee00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7feee80a4e60 0x7feee8159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.225+0000 7feeeee00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee81531a0 con 0x7feee80a8500 2024-04-12T19:39:36.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.225+0000 7feeeee00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7feee8153680 con 0x7feee80a4e60 2024-04-12T19:39:36.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.225+0000 7feeeee00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feee8071df0 con 0x7feee80a8120 2024-04-12T19:39:36.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feedf400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7feee80a8500 0x7feee81526f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39380/0 (socket says 172.21.15.131:39380) 2024-04-12T19:39:36.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feedf400640 1 -- 172.21.15.131:0/319163188 learned_addr learned my addr 172.21.15.131:0/319163188 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:36.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feee7e00640 1 --2- 172.21.15.131:0/319163188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a8120 0x7feee80728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feeece00640 1 --2- 172.21.15.131:0/319163188 >> v2:172.21.15.171:3300/0 conn(0x7feee80a4e60 0x7feee8159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2112814958 0 0) 0x7feee81531a0 con 0x7feee80a8500 2024-04-12T19:39:36.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feecc003520 con 0x7feee80a8500 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3674881423 0 0) 0x7feecc003520 con 0x7feee80a8500 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a8120 msgr2=0x7feee80728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feee7400640 1 --2- 172.21.15.131:0/319163188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a8120 0x7feee80728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 >> v2:172.21.15.171:3300/0 conn(0x7feee80a4e60 msgr2=0x7feee8159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feee7400640 1 --2- 172.21.15.131:0/319163188 >> v2:172.21.15.171:3300/0 conn(0x7feee80a4e60 0x7feee8159a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee80720d0 con 0x7feee80a8500 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7feed0001670 con 0x7feee80a8500 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feeece00640 1 --2- 172.21.15.131:0/319163188 >> v2:172.21.15.171:3300/0 conn(0x7feee80a4e60 0x7feee8159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.226+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 >> v1:172.21.15.131:6789/0 conn(0x7feee80a8500 legacy=0x7feee81526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.227+0000 7feee7400640 1 --2- 172.21.15.131:0/319163188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feecc0039b0 0x7feecc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.227+0000 7feee7400640 1 --2- 172.21.15.131:0/319163188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a8120 0x7feecc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.227+0000 7feee7400640 1 --2- 172.21.15.131:0/319163188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feecc004d40 0x7feecc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.227+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feee8153680 con 0x7feecc004d40 2024-04-12T19:39:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.227+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feee8071df0 con 0x7feecc0039b0 2024-04-12T19:39:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.227+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feecc00b9c0 con 0x7feee80a8120 2024-04-12T19:39:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.227+0000 7feeece00640 1 --2- 172.21.15.131:0/319163188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feecc004d40 0x7feecc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.227+0000 7feedf400640 1 --2- 172.21.15.131:0/319163188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a8120 0x7feecc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.227+0000 7feee7e00640 1 --2- 172.21.15.131:0/319163188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feecc0039b0 0x7feecc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.227+0000 7feeece00640 1 -- 172.21.15.131:0/319163188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a8120 msgr2=0x7feecc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.227+0000 7feeece00640 1 --2- 172.21.15.131:0/319163188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a8120 0x7feecc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.228+0000 7feeece00640 1 -- 172.21.15.131:0/319163188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feecc0039b0 msgr2=0x7feecc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.228+0000 7feeece00640 1 --2- 172.21.15.131:0/319163188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feecc0039b0 0x7feecc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.228+0000 7feeece00640 1 -- 172.21.15.131:0/319163188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feecc003520 con 0x7feecc004d40 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.229+0000 7feeece00640 1 --2- 172.21.15.131:0/319163188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feecc004d40 0x7feecc0051c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feee00073e0 tx=0x7feecc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29332870967bef94 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.229+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0039070 con 0x7feecc004d40 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.229+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee002cd70 con 0x7feecc004d40 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.229+0000 7feee7400640 1 -- 172.21.15.131:0/319163188 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0009c80 con 0x7feecc004d40 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.229+0000 7feeeee00640 1 -- 172.21.15.131:0/319163188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feecc004d40 msgr2=0x7feecc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.229+0000 7feeeee00640 1 --2- 172.21.15.131:0/319163188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feecc004d40 0x7feecc0051c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7feee00073e0 tx=0x7feecc005830 comp rx=0 tx=0).stop 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.229+0000 7feeece00640 1 -- 172.21.15.131:0/319163188 reap_dead start 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.230+0000 7feeeee00640 1 -- 172.21.15.131:0/319163188 shutdown_connections 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.230+0000 7feeeee00640 1 -- 172.21.15.131:0/319163188 >> 172.21.15.131:0/319163188 conn(0x7feee80c2590 msgr2=0x7feee80c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.230+0000 7feeeee00640 1 -- 172.21.15.131:0/319163188 shutdown_connections 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.230+0000 7feeeee00640 1 -- 172.21.15.131:0/319163188 wait complete. 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.231+0000 7feeeee00640 1 Processor -- start 2024-04-12T19:39:36.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.232+0000 7feeeee00640 1 -- start start 2024-04-12T19:39:36.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.232+0000 7feeeee00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a6c40 0x7feee8147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.232+0000 7feeeee00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feee80ba050 0x7feee80ba4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.232+0000 7feeeee00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee8144370 0x7feee81447f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.232+0000 7feeeee00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feee8152e00 con 0x7feee8144370 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.232+0000 7feeeee00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feee806d970 con 0x7feee80ba050 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.232+0000 7feeeee00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feee8152f80 con 0x7feee80a6c40 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.233+0000 7feeece00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee8144370 0x7feee81447f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.233+0000 7feeece00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee8144370 0x7feee81447f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55234/0 (socket says 172.21.15.131:55234) 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.233+0000 7feeece00640 1 -- 172.21.15.131:0/2078553790 learned_addr learned my addr 172.21.15.131:0/2078553790 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.233+0000 7feee7e00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a6c40 0x7feee8147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.233+0000 7feedf400640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feee80ba050 0x7feee80ba4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.233+0000 7feeece00640 1 -- 172.21.15.131:0/2078553790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a6c40 msgr2=0x7feee8147c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.233+0000 7feeece00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a6c40 0x7feee8147c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.233+0000 7feeece00640 1 -- 172.21.15.131:0/2078553790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feee80ba050 msgr2=0x7feee80ba4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:36.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.233+0000 7feeece00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feee80ba050 0x7feee80ba4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.233+0000 7feeece00640 1 -- 172.21.15.131:0/2078553790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee8144d30 con 0x7feee8144370 2024-04-12T19:39:36.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.233+0000 7feedf400640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feee80ba050 0x7feee80ba4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:36.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.234+0000 7feeece00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee8144370 0x7feee81447f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feee0007500 tx=0x7feee0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:36.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.234+0000 7feee4c00640 1 -- 172.21.15.131:0/2078553790 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0039070 con 0x7feee8144370 2024-04-12T19:39:36.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.234+0000 7feee4c00640 1 -- 172.21.15.131:0/2078553790 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feee0044070 con 0x7feee8144370 2024-04-12T19:39:36.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.234+0000 7feeeee00640 1 -- 172.21.15.131:0/2078553790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee81e75a0 con 0x7feee8144370 2024-04-12T19:39:36.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.234+0000 7feee4c00640 1 -- 172.21.15.131:0/2078553790 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feee0009c80 con 0x7feee8144370 2024-04-12T19:39:36.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.234+0000 7feeeee00640 1 -- 172.21.15.131:0/2078553790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee80b9b30 con 0x7feee8144370 2024-04-12T19:39:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.235+0000 7feeeee00640 1 -- 172.21.15.131:0/2078553790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee80bffa0 con 0x7feee8144370 2024-04-12T19:39:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.236+0000 7feee4c00640 1 -- 172.21.15.131:0/2078553790 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feee003e830 con 0x7feee8144370 2024-04-12T19:39:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.237+0000 7feee4c00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7feec406c8f0 0x7feec406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.237+0000 7feee4c00640 1 -- 172.21.15.131:0/2078553790 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7feee00adea0 con 0x7feee8144370 2024-04-12T19:39:36.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.237+0000 7feee7e00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7feec406c8f0 0x7feec406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.238+0000 7feee7e00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7feec406c8f0 0x7feec406edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feee8149130 tx=0x7feed8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:36.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.242+0000 7feee4c00640 1 -- 172.21.15.131:0/2078553790 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7feee80bffa0 con 0x7feee8144370 2024-04-12T19:39:36.443 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.443+0000 7feeeee00640 1 -- 172.21.15.131:0/2078553790 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feee804fd50 con 0x7feee8144370 2024-04-12T19:39:36.444 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.445+0000 7feee4c00640 1 -- 172.21.15.131:0/2078553790 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7feee007b970 con 0x7feee8144370 2024-04-12T19:39:36.445 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:36.445 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":26,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:17.479662+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:36.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.447+0000 7feeeee00640 1 -- 172.21.15.131:0/2078553790 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7feec406c8f0 msgr2=0x7feec406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:36.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.447+0000 7feeeee00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7feec406c8f0 0x7feec406edb0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7feee8149130 tx=0x7feed8008040 comp rx=0 tx=0).stop 2024-04-12T19:39:36.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.447+0000 7feeeee00640 1 -- 172.21.15.131:0/2078553790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee8144370 msgr2=0x7feee81447f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:36.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.447+0000 7feeeee00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee8144370 0x7feee81447f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feee0007500 tx=0x7feee0004ab0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.447+0000 7feeeee00640 1 -- 172.21.15.131:0/2078553790 shutdown_connections 2024-04-12T19:39:36.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.447+0000 7feeeee00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7feec406c8f0 0x7feec406edb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.447+0000 7feeeee00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feee80ba050 0x7feee80ba4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.447+0000 7feeeee00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feee8144370 0x7feee81447f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.447+0000 7feeeee00640 1 --2- 172.21.15.131:0/2078553790 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feee80a6c40 0x7feee8147c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.448+0000 7feeeee00640 1 -- 172.21.15.131:0/2078553790 >> 172.21.15.131:0/2078553790 conn(0x7feee80c2590 msgr2=0x7feee80c1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:36.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.448+0000 7feeeee00640 1 -- 172.21.15.131:0/2078553790 shutdown_connections 2024-04-12T19:39:36.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.448+0000 7feeeee00640 1 -- 172.21.15.131:0/2078553790 wait complete. 2024-04-12T19:39:36.467 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-12T19:39:36.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.683+0000 7fe140a00640 1 Processor -- start 2024-04-12T19:39:36.683 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.684+0000 7fe140a00640 1 -- start start 2024-04-12T19:39:36.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.685+0000 7fe140a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe13c0c17a0 0x7fe13c0c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.685+0000 7fe140a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe13c1511e0 0x7fe13c0c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.685+0000 7fe140a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe13c0c5e80 con 0x7fe13c151670 2024-04-12T19:39:36.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.685+0000 7fe140a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe13c0c59f0 con 0x7fe13c0c17a0 2024-04-12T19:39:36.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.685+0000 7fe140a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe13c0c4020 con 0x7fe13c1511e0 2024-04-12T19:39:36.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.685+0000 7fe139e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe13c0c17a0 0x7fe13c0c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.685+0000 7fe139e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe13c0c17a0 0x7fe13c0c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55238/0 (socket says 172.21.15.131:55238) 2024-04-12T19:39:36.685 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.685+0000 7fe139e00640 1 -- 172.21.15.131:0/631233364 learned_addr learned my addr 172.21.15.131:0/631233364 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:36.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.685+0000 7fe139e00640 1 -- 172.21.15.131:0/631233364 >> v2:172.21.15.171:3300/0 conn(0x7fe13c1511e0 msgr2=0x7fe13c0c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:36.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.685+0000 7fe139e00640 1 --2- 172.21.15.131:0/631233364 >> v2:172.21.15.171:3300/0 conn(0x7fe13c1511e0 0x7fe13c0c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.685+0000 7fe139e00640 1 -- 172.21.15.131:0/631233364 >> v1:172.21.15.171:6789/0 conn(0x7fe13c151670 legacy=0x7fe13c154750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:36.686 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.685+0000 7fe139e00640 1 -- 172.21.15.131:0/631233364 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c0c6260 con 0x7fe13c0c17a0 2024-04-12T19:39:36.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.687+0000 7fe139e00640 1 --2- 172.21.15.131:0/631233364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe13c0c17a0 0x7fe13c0c28c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe13c152310 tx=0x7fe12c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=621543dfbbe2a9f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:36.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.687+0000 7fe138a00640 1 -- 172.21.15.131:0/631233364 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c035020 con 0x7fe13c0c17a0 2024-04-12T19:39:36.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.687+0000 7fe138a00640 1 -- 172.21.15.131:0/631233364 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe12c031870 con 0x7fe13c0c17a0 2024-04-12T19:39:36.687 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.687+0000 7fe138a00640 1 -- 172.21.15.131:0/631233364 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c031c40 con 0x7fe13c0c17a0 2024-04-12T19:39:36.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.688+0000 7fe140a00640 1 -- 172.21.15.131:0/631233364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe13c0c17a0 msgr2=0x7fe13c0c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:36.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.688+0000 7fe140a00640 1 --2- 172.21.15.131:0/631233364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe13c0c17a0 0x7fe13c0c28c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fe13c152310 tx=0x7fe12c02b910 comp rx=0 tx=0).stop 2024-04-12T19:39:36.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.688+0000 7fe140a00640 1 -- 172.21.15.131:0/631233364 shutdown_connections 2024-04-12T19:39:36.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.688+0000 7fe140a00640 1 --2- 172.21.15.131:0/631233364 >> v2:172.21.15.171:3300/0 conn(0x7fe13c1511e0 0x7fe13c0c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.688+0000 7fe140a00640 1 --2- 172.21.15.131:0/631233364 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe13c0c17a0 0x7fe13c0c28c0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.688+0000 7fe140a00640 1 -- 172.21.15.131:0/631233364 >> 172.21.15.131:0/631233364 conn(0x7fe13c0a8490 msgr2=0x7fe13c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:36.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.688+0000 7fe140a00640 1 -- 172.21.15.131:0/631233364 shutdown_connections 2024-04-12T19:39:36.688 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.688+0000 7fe140a00640 1 -- 172.21.15.131:0/631233364 wait complete. 2024-04-12T19:39:36.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.689+0000 7fe140a00640 1 Processor -- start 2024-04-12T19:39:36.689 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.690+0000 7fe140a00640 1 -- start start 2024-04-12T19:39:36.690 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.690+0000 7fe140a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe13c0c17a0 0x7fe13c0ba4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.690+0000 7fe140a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe13c1511e0 0x7fe13c0ba9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.690+0000 7fe140a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe13c151670 0x7fe13c0bbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.690+0000 7fe140a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c0c48e0 con 0x7fe13c0c17a0 2024-04-12T19:39:36.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.690+0000 7fe140a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe13c0c4760 con 0x7fe13c1511e0 2024-04-12T19:39:36.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.690+0000 7fe140a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe13c0c1b80 con 0x7fe13c151670 2024-04-12T19:39:36.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.691+0000 7fe139e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe13c0c17a0 0x7fe13c0ba4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.691+0000 7fe139e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe13c0c17a0 0x7fe13c0ba4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55246/0 (socket says 172.21.15.131:55246) 2024-04-12T19:39:36.691 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.691+0000 7fe139e00640 1 -- 172.21.15.131:0/3976802045 learned_addr learned my addr 172.21.15.131:0/3976802045 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:36.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.691+0000 7fe13a800640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe13c151670 0x7fe13c0bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.691+0000 7fe139400640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe13c1511e0 0x7fe13c0ba9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.692 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.691+0000 7fe139e00640 1 -- 172.21.15.131:0/3976802045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe13c151670 msgr2=0x7fe13c0bbdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:36.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.691+0000 7fe139e00640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe13c151670 0x7fe13c0bbdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.691+0000 7fe139e00640 1 -- 172.21.15.131:0/3976802045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe13c1511e0 msgr2=0x7fe13c0ba9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:36.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.691+0000 7fe139e00640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe13c1511e0 0x7fe13c0ba9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:36.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.691+0000 7fe139e00640 1 -- 172.21.15.131:0/3976802045 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe13c1dcde0 con 0x7fe13c0c17a0 2024-04-12T19:39:36.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.691+0000 7fe139400640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe13c1511e0 0x7fe13c0ba9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:36.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.692+0000 7fe139e00640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe13c0c17a0 0x7fe13c0ba4b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe12c000c00 tx=0x7fe12c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:36.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.692+0000 7fe132000640 1 -- 172.21.15.131:0/3976802045 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c03ad60 con 0x7fe13c0c17a0 2024-04-12T19:39:36.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.692+0000 7fe132000640 1 -- 172.21.15.131:0/3976802045 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe12c0443f0 con 0x7fe13c0c17a0 2024-04-12T19:39:36.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.692+0000 7fe132000640 1 -- 172.21.15.131:0/3976802045 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe12c0447e0 con 0x7fe13c0c17a0 2024-04-12T19:39:36.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.692+0000 7fe140a00640 1 -- 172.21.15.131:0/3976802045 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe13c14a8b0 con 0x7fe13c0c17a0 2024-04-12T19:39:36.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.692+0000 7fe140a00640 1 -- 172.21.15.131:0/3976802045 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe13c0b9dd0 con 0x7fe13c0c17a0 2024-04-12T19:39:36.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.693+0000 7fe140a00640 1 -- 172.21.15.131:0/3976802045 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe13c1e7580 con 0x7fe13c0c17a0 2024-04-12T19:39:36.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.694+0000 7fe132000640 1 -- 172.21.15.131:0/3976802045 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe12c038020 con 0x7fe13c0c17a0 2024-04-12T19:39:36.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.695+0000 7fe132000640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe11c06c8f0 0x7fe11c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:36.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.695+0000 7fe132000640 1 -- 172.21.15.131:0/3976802045 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fe12c0ae0f0 con 0x7fe13c0c17a0 2024-04-12T19:39:36.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.695+0000 7fe139400640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe11c06c8f0 0x7fe11c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:36.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.696+0000 7fe139400640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe11c06c8f0 0x7fe11c06edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe13c1495b0 tx=0x7fe1280073c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:36.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.700+0000 7fe132000640 1 -- 172.21.15.131:0/3976802045 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe12c03f070 con 0x7fe13c0c17a0 2024-04-12T19:39:36.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:36.946+0000 7fe140a00640 1 -- 172.21.15.131:0/3976802045 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe13c04fd50 con 0x7fe13c0c17a0 2024-04-12T19:39:37.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.056+0000 7fe132000640 1 -- 172.21.15.131:0/3976802045 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7fe12c07c270 con 0x7fe13c0c17a0 2024-04-12T19:39:37.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.059+0000 7fe140a00640 1 -- 172.21.15.131:0/3976802045 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe11c06c8f0 msgr2=0x7fe11c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:37.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.059+0000 7fe140a00640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe11c06c8f0 0x7fe11c06edb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe13c1495b0 tx=0x7fe1280073c0 comp rx=0 tx=0).stop 2024-04-12T19:39:37.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.059+0000 7fe140a00640 1 -- 172.21.15.131:0/3976802045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe13c0c17a0 msgr2=0x7fe13c0ba4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:37.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.059+0000 7fe140a00640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe13c0c17a0 0x7fe13c0ba4b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe12c000c00 tx=0x7fe12c0046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:37.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.060+0000 7fe140a00640 1 -- 172.21.15.131:0/3976802045 shutdown_connections 2024-04-12T19:39:37.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.060+0000 7fe140a00640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe11c06c8f0 0x7fe11c06edb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:37.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.060+0000 7fe140a00640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe13c1511e0 0x7fe13c0ba9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:37.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.060+0000 7fe140a00640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe13c151670 0x7fe13c0bbdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:37.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.060+0000 7fe140a00640 1 --2- 172.21.15.131:0/3976802045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe13c0c17a0 0x7fe13c0ba4b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:37.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.060+0000 7fe140a00640 1 -- 172.21.15.131:0/3976802045 >> 172.21.15.131:0/3976802045 conn(0x7fe13c0a8490 msgr2=0x7fe13c0be6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:37.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.060+0000 7fe140a00640 1 -- 172.21.15.131:0/3976802045 shutdown_connections 2024-04-12T19:39:37.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.060+0000 7fe140a00640 1 -- 172.21.15.131:0/3976802045 wait complete. 2024-04-12T19:39:37.081 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2024-04-12T19:39:37.081 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-12T19:39:37.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.299+0000 7f19e0600640 1 Processor -- start 2024-04-12T19:39:37.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.300+0000 7f19e0600640 1 -- start start 2024-04-12T19:39:37.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.301+0000 7f19e0600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f19d80c1500 0x7f19d814b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:37.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.301+0000 7f19e0600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f19d80c6060 0x7f19d806dde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:37.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.301+0000 7f19e0600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19d8151e40 con 0x7f19d814b5e0 2024-04-12T19:39:37.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.301+0000 7f19e0600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f19d80c05d0 con 0x7f19d80c1500 2024-04-12T19:39:37.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.301+0000 7f19e0600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f19d8151bf0 con 0x7f19d80c6060 2024-04-12T19:39:37.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.301+0000 7f19ddc00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f19d80c1500 0x7f19d814b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:37.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.301+0000 7f19dd200640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f19d814b5e0 0x7f19d80c5950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39382/0 (socket says 172.21.15.131:39382) 2024-04-12T19:39:37.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.301+0000 7f19dd200640 1 -- 172.21.15.131:0/3527420817 learned_addr learned my addr 172.21.15.131:0/3527420817 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:37.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.302+0000 7f19de600640 1 --2- 172.21.15.131:0/3527420817 >> v2:172.21.15.171:3300/0 conn(0x7f19d80c6060 0x7f19d806dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:37.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.302+0000 7f19ddc00640 1 -- 172.21.15.131:0/3527420817 >> v2:172.21.15.171:3300/0 conn(0x7f19d80c6060 msgr2=0x7f19d806dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:37.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.302+0000 7f19ddc00640 1 --2- 172.21.15.131:0/3527420817 >> v2:172.21.15.171:3300/0 conn(0x7f19d80c6060 0x7f19d806dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:37.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.302+0000 7f19ddc00640 1 -- 172.21.15.131:0/3527420817 >> v1:172.21.15.131:6789/0 conn(0x7f19d814b5e0 legacy=0x7f19d80c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:37.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.302+0000 7f19ddc00640 1 -- 172.21.15.131:0/3527420817 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d80c4e50 con 0x7f19d80c1500 2024-04-12T19:39:37.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.302+0000 7f19de600640 1 --2- 172.21.15.131:0/3527420817 >> v2:172.21.15.171:3300/0 conn(0x7f19d80c6060 0x7f19d806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:37.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.303+0000 7f19ddc00640 1 --2- 172.21.15.131:0/3527420817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d80c1500 0x7f19d814b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f19d80a9450 tx=0x7f19cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca918e2809d4efd6 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:37.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.303+0000 7f19d7e00640 1 -- 172.21.15.131:0/3527420817 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc035020 con 0x7f19d80c1500 2024-04-12T19:39:37.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.303+0000 7f19d7e00640 1 -- 172.21.15.131:0/3527420817 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19cc031830 con 0x7f19d80c1500 2024-04-12T19:39:37.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.303+0000 7f19d7e00640 1 -- 172.21.15.131:0/3527420817 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc031c00 con 0x7f19d80c1500 2024-04-12T19:39:37.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.304+0000 7f19e0600640 1 -- 172.21.15.131:0/3527420817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d80c1500 msgr2=0x7f19d814b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:37.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.304+0000 7f19e0600640 1 --2- 172.21.15.131:0/3527420817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d80c1500 0x7f19d814b0a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f19d80a9450 tx=0x7f19cc02b8d0 comp rx=0 tx=0).stop 2024-04-12T19:39:37.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.304+0000 7f19e0600640 1 -- 172.21.15.131:0/3527420817 shutdown_connections 2024-04-12T19:39:37.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.304+0000 7f19e0600640 1 --2- 172.21.15.131:0/3527420817 >> v2:172.21.15.171:3300/0 conn(0x7f19d80c6060 0x7f19d806dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:37.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.304+0000 7f19e0600640 1 --2- 172.21.15.131:0/3527420817 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d80c1500 0x7f19d814b0a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:37.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.304+0000 7f19e0600640 1 -- 172.21.15.131:0/3527420817 >> 172.21.15.131:0/3527420817 conn(0x7f19d80a8400 msgr2=0x7f19d80a8810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:37.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.304+0000 7f19e0600640 1 -- 172.21.15.131:0/3527420817 shutdown_connections 2024-04-12T19:39:37.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.304+0000 7f19e0600640 1 -- 172.21.15.131:0/3527420817 wait complete. 2024-04-12T19:39:37.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.306+0000 7f19e0600640 1 Processor -- start 2024-04-12T19:39:37.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.306+0000 7f19e0600640 1 -- start start 2024-04-12T19:39:37.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19e0600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d80c1500 0x7f19d8154f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:37.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19e0600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d80c6060 0x7f19d8149720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:37.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19e0600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19d814b5e0 0x7f19d81e6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:37.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19e0600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f19d80c5410 con 0x7f19d80c1500 2024-04-12T19:39:37.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19e0600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8152120 con 0x7f19d80c6060 2024-04-12T19:39:37.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19e0600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f19d80c0c10 con 0x7f19d814b5e0 2024-04-12T19:39:37.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19ddc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d80c1500 0x7f19d8154f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:37.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19ddc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d80c1500 0x7f19d8154f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55262/0 (socket says 172.21.15.131:55262) 2024-04-12T19:39:37.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19ddc00640 1 -- 172.21.15.131:0/4132469467 learned_addr learned my addr 172.21.15.131:0/4132469467 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:37.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19dd200640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d80c6060 0x7f19d8149720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:37.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19de600640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19d814b5e0 0x7f19d81e6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:37.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19ddc00640 1 -- 172.21.15.131:0/4132469467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19d814b5e0 msgr2=0x7f19d81e6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:37.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19ddc00640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19d814b5e0 0x7f19d81e6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:37.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19ddc00640 1 -- 172.21.15.131:0/4132469467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d80c6060 msgr2=0x7f19d8149720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:37.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19ddc00640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d80c6060 0x7f19d8149720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:37.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.307+0000 7f19ddc00640 1 -- 172.21.15.131:0/4132469467 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d8150fd0 con 0x7f19d80c1500 2024-04-12T19:39:37.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.308+0000 7f19dd200640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d80c6060 0x7f19d8149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:37.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.308+0000 7f19ddc00640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d80c1500 0x7f19d8154f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f19cc02bee0 tx=0x7f19cc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:37.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.308+0000 7f19d5600640 1 -- 172.21.15.131:0/4132469467 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc041070 con 0x7f19d80c1500 2024-04-12T19:39:37.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.308+0000 7f19d5600640 1 -- 172.21.15.131:0/4132469467 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19cc03aa30 con 0x7f19d80c1500 2024-04-12T19:39:37.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.308+0000 7f19d5600640 1 -- 172.21.15.131:0/4132469467 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19cc035040 con 0x7f19d80c1500 2024-04-12T19:39:37.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.308+0000 7f19e0600640 1 -- 172.21.15.131:0/4132469467 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d81ea320 con 0x7f19d80c1500 2024-04-12T19:39:37.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.308+0000 7f19e0600640 1 -- 172.21.15.131:0/4132469467 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d81ea8e0 con 0x7f19d80c1500 2024-04-12T19:39:37.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.309+0000 7f19e0600640 1 -- 172.21.15.131:0/4132469467 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d8069500 con 0x7f19d80c1500 2024-04-12T19:39:37.310 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.310+0000 7f19d5600640 1 -- 172.21.15.131:0/4132469467 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f19cc038020 con 0x7f19d80c1500 2024-04-12T19:39:37.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.311+0000 7f19d5600640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f19b806c920 0x7f19b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:37.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.311+0000 7f19d5600640 1 -- 172.21.15.131:0/4132469467 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f19cc0ad610 con 0x7f19d80c1500 2024-04-12T19:39:37.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.311+0000 7f19dd200640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f19b806c920 0x7f19b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:37.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.312+0000 7f19dd200640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f19b806c920 0x7f19b806ede0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19d80c4ad0 tx=0x7f19c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:37.316 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.316+0000 7f19d5600640 1 -- 172.21.15.131:0/4132469467 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f19d8069500 con 0x7f19d80c1500 2024-04-12T19:39:37.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:37.560+0000 7f19e0600640 1 -- 172.21.15.131:0/4132469467 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f19d804fd50 con 0x7f19d80c1500 2024-04-12T19:39:38.071 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.071+0000 7f19d5600640 1 -- 172.21.15.131:0/4132469467 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) ==== 122+0+0 (secure 0 0 0) 0x7f19cc07b6f0 con 0x7f19d80c1500 2024-04-12T19:39:38.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.075+0000 7f19e0600640 1 -- 172.21.15.131:0/4132469467 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f19b806c920 msgr2=0x7f19b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:38.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.075+0000 7f19e0600640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f19b806c920 0x7f19b806ede0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f19d80c4ad0 tx=0x7f19c4009040 comp rx=0 tx=0).stop 2024-04-12T19:39:38.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.075+0000 7f19e0600640 1 -- 172.21.15.131:0/4132469467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d80c1500 msgr2=0x7f19d8154f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:38.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.075+0000 7f19e0600640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d80c1500 0x7f19d8154f20 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f19cc02bee0 tx=0x7f19cc0046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.075+0000 7f19e0600640 1 -- 172.21.15.131:0/4132469467 shutdown_connections 2024-04-12T19:39:38.075 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.075+0000 7f19e0600640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f19b806c920 0x7f19b806ede0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.075+0000 7f19e0600640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f19d80c6060 0x7f19d8149720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.075+0000 7f19e0600640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f19d814b5e0 0x7f19d81e6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.075+0000 7f19e0600640 1 --2- 172.21.15.131:0/4132469467 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f19d80c1500 0x7f19d8154f20 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.075+0000 7f19e0600640 1 -- 172.21.15.131:0/4132469467 >> 172.21.15.131:0/4132469467 conn(0x7f19d80a8400 msgr2=0x7f19d81507f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:38.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.075+0000 7f19e0600640 1 -- 172.21.15.131:0/4132469467 shutdown_connections 2024-04-12T19:39:38.076 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.075+0000 7f19e0600640 1 -- 172.21.15.131:0/4132469467 wait complete. 2024-04-12T19:39:38.097 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-12T19:39:38.097 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-12T19:39:38.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.308+0000 7f36adc00640 1 Processor -- start 2024-04-12T19:39:38.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.308+0000 7f36adc00640 1 -- start start 2024-04-12T19:39:38.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.310+0000 7f36adc00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f36a80734c0 0x7f36a81521f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.310+0000 7f36adc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a80bdbc0 0x7f36a8152730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.310+0000 7f36adc00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f36a80a6240 0x7f36a80a66b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.310+0000 7f36adc00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f36a80be320 con 0x7f36a80734c0 2024-04-12T19:39:38.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.310+0000 7f36adc00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f36a80a6bf0 con 0x7f36a80a6240 2024-04-12T19:39:38.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.310+0000 7f36adc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f36a8152d10 con 0x7f36a80bdbc0 2024-04-12T19:39:38.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.310+0000 7f36a7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f36a80734c0 0x7f36a81521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.310+0000 7f36a7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f36a80734c0 0x7f36a81521f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55268/0 (socket says 172.21.15.131:55268) 2024-04-12T19:39:38.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.310+0000 7f36a7e00640 1 -- 172.21.15.131:0/765145804 learned_addr learned my addr 172.21.15.131:0/765145804 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:38.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.311+0000 7f36a7400640 1 --2- 172.21.15.131:0/765145804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a80bdbc0 0x7f36a8152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.311+0000 7f36ad200640 1 --2- 172.21.15.131:0/765145804 >> v2:172.21.15.171:3300/0 conn(0x7f36a80a6240 0x7f36a80a66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.311 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.311+0000 7f36a7e00640 1 -- 172.21.15.131:0/765145804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a80bdbc0 msgr2=0x7f36a8152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:38.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.311+0000 7f36a7e00640 1 --2- 172.21.15.131:0/765145804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a80bdbc0 0x7f36a8152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.311+0000 7f36a7e00640 1 -- 172.21.15.131:0/765145804 >> v2:172.21.15.171:3300/0 conn(0x7f36a80a6240 msgr2=0x7f36a80a66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:38.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.311+0000 7f36a7e00640 1 --2- 172.21.15.131:0/765145804 >> v2:172.21.15.171:3300/0 conn(0x7f36a80a6240 0x7f36a80a66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.311+0000 7f36a7e00640 1 -- 172.21.15.131:0/765145804 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a80be570 con 0x7f36a80734c0 2024-04-12T19:39:38.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.311+0000 7f36ad200640 1 --2- 172.21.15.131:0/765145804 >> v2:172.21.15.171:3300/0 conn(0x7f36a80a6240 0x7f36a80a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:38.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.311+0000 7f36a7400640 1 --2- 172.21.15.131:0/765145804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a80bdbc0 0x7f36a8152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:38.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.312+0000 7f36a7e00640 1 --2- 172.21.15.131:0/765145804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a80734c0 0x7f36a81521f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f36a80c2280 tx=0x7f369802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d84bb0c4415914a8 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:38.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.312+0000 7f36a6a00640 1 -- 172.21.15.131:0/765145804 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f369802e070 con 0x7f36a80734c0 2024-04-12T19:39:38.313 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.312+0000 7f36a6a00640 1 -- 172.21.15.131:0/765145804 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3698037070 con 0x7f36a80734c0 2024-04-12T19:39:38.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.312+0000 7f36a6a00640 1 -- 172.21.15.131:0/765145804 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698031a00 con 0x7f36a80734c0 2024-04-12T19:39:38.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.313+0000 7f36adc00640 1 -- 172.21.15.131:0/765145804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a80734c0 msgr2=0x7f36a81521f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:38.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.313+0000 7f36adc00640 1 --2- 172.21.15.131:0/765145804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a80734c0 0x7f36a81521f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f36a80c2280 tx=0x7f369802b880 comp rx=0 tx=0).stop 2024-04-12T19:39:38.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.313+0000 7f36adc00640 1 -- 172.21.15.131:0/765145804 shutdown_connections 2024-04-12T19:39:38.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.313+0000 7f36adc00640 1 --2- 172.21.15.131:0/765145804 >> v2:172.21.15.171:3300/0 conn(0x7f36a80a6240 0x7f36a80a66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.313+0000 7f36adc00640 1 --2- 172.21.15.131:0/765145804 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a80bdbc0 0x7f36a8152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.313+0000 7f36adc00640 1 --2- 172.21.15.131:0/765145804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a80734c0 0x7f36a81521f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.313+0000 7f36adc00640 1 -- 172.21.15.131:0/765145804 >> 172.21.15.131:0/765145804 conn(0x7f36a80c24d0 msgr2=0x7f36a80c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:38.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.313+0000 7f36adc00640 1 -- 172.21.15.131:0/765145804 shutdown_connections 2024-04-12T19:39:38.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.313+0000 7f36adc00640 1 -- 172.21.15.131:0/765145804 wait complete. 2024-04-12T19:39:38.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.315+0000 7f36adc00640 1 Processor -- start 2024-04-12T19:39:38.315 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.315+0000 7f36adc00640 1 -- start start 2024-04-12T19:39:38.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.316+0000 7f36adc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a80734c0 0x7f36a81da510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.316+0000 7f36adc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a80a6240 0x7f36a814a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.316+0000 7f36adc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36a80bdbc0 0x7f36a81e6e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.316+0000 7f36adc00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80a8320 con 0x7f36a80734c0 2024-04-12T19:39:38.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.316+0000 7f36adc00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f36a80bd740 con 0x7f36a80bdbc0 2024-04-12T19:39:38.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.316+0000 7f36adc00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f36a80738a0 con 0x7f36a80a6240 2024-04-12T19:39:38.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.317+0000 7f36a7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a80734c0 0x7f36a81da510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.317+0000 7f36a7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a80734c0 0x7f36a81da510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55280/0 (socket says 172.21.15.131:55280) 2024-04-12T19:39:38.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.317+0000 7f36a7e00640 1 -- 172.21.15.131:0/3189490900 learned_addr learned my addr 172.21.15.131:0/3189490900 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:38.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.317+0000 7f36ad200640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36a80bdbc0 0x7f36a81e6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.317+0000 7f36a7400640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a80a6240 0x7f36a814a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.317+0000 7f36a7e00640 1 -- 172.21.15.131:0/3189490900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a80a6240 msgr2=0x7f36a814a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:38.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.317+0000 7f36a7e00640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a80a6240 0x7f36a814a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.317+0000 7f36a7e00640 1 -- 172.21.15.131:0/3189490900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36a80bdbc0 msgr2=0x7f36a81e6e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:38.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.317+0000 7f36a7e00640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36a80bdbc0 0x7f36a81e6e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.317+0000 7f36a7e00640 1 -- 172.21.15.131:0/3189490900 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36a8144730 con 0x7f36a80734c0 2024-04-12T19:39:38.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.317+0000 7f36ad200640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36a80bdbc0 0x7f36a81e6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:38.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.317+0000 7f36a7e00640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a80734c0 0x7f36a81da510 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f369802b8c0 tx=0x7f36980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:38.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.318+0000 7f369fe00640 1 -- 172.21.15.131:0/3189490900 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698032880 con 0x7f36a80734c0 2024-04-12T19:39:38.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.318+0000 7f369fe00640 1 -- 172.21.15.131:0/3189490900 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3698032a20 con 0x7f36a80734c0 2024-04-12T19:39:38.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.318+0000 7f369fe00640 1 -- 172.21.15.131:0/3189490900 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3698032e10 con 0x7f36a80734c0 2024-04-12T19:39:38.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.318+0000 7f36adc00640 1 -- 172.21.15.131:0/3189490900 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36a81daa50 con 0x7f36a80734c0 2024-04-12T19:39:38.319 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.318+0000 7f36adc00640 1 -- 172.21.15.131:0/3189490900 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36a81e6730 con 0x7f36a80734c0 2024-04-12T19:39:38.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.319+0000 7f36adc00640 1 -- 172.21.15.131:0/3189490900 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36a8075c30 con 0x7f36a80734c0 2024-04-12T19:39:38.320 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.320+0000 7f369fe00640 1 -- 172.21.15.131:0/3189490900 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f369804c060 con 0x7f36a80734c0 2024-04-12T19:39:38.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.321+0000 7f369fe00640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f368406c8f0 0x7f368406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.321+0000 7f369fe00640 1 -- 172.21.15.131:0/3189490900 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f36980add10 con 0x7f36a80734c0 2024-04-12T19:39:38.321 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.321+0000 7f36a7400640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f368406c8f0 0x7f368406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.322 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.322+0000 7f36a7400640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f368406c8f0 0x7f368406edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f36a80a5d60 tx=0x7f3690008470 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:38.325 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.326+0000 7f369fe00640 1 -- 172.21.15.131:0/3189490900 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f36980b3020 con 0x7f36a80734c0 2024-04-12T19:39:38.568 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.568+0000 7f36adc00640 1 -- 172.21.15.131:0/3189490900 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f36a80bc720 con 0x7f36a80734c0 2024-04-12T19:39:38.569 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.569+0000 7f369fe00640 1 -- 172.21.15.131:0/3189490900 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5186 (secure 0 0 0) 0x7f3698040070 con 0x7f36a80734c0 2024-04-12T19:39:38.570 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:38.570 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3941197710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3941197710},{"type":"v1","addr":"172.21.15.131:6836","nonce":3941197710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2898590457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2898590457},{"type":"v1","addr":"172.21.15.131:6837","nonce":2898590457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/373698102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":373698102},{"type":"v1","addr":"172.21.15.171:6835","nonce":373698102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T19:39:10.876760+0000","modified":"2024-04-12T19:39:37.561387+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6834/1013642393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1013642393},{"type":"v1","addr":"172.21.15.171:6834","nonce":1013642393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4257,"qdb_cluster":[4257]},"id":1}]} 2024-04-12T19:39:38.570 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-04-12T19:39:38.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.572+0000 7f36adc00640 1 -- 172.21.15.131:0/3189490900 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f368406c8f0 msgr2=0x7f368406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:38.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.572+0000 7f36adc00640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f368406c8f0 0x7f368406edb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f36a80a5d60 tx=0x7f3690008470 comp rx=0 tx=0).stop 2024-04-12T19:39:38.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.572+0000 7f36adc00640 1 -- 172.21.15.131:0/3189490900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a80734c0 msgr2=0x7f36a81da510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:38.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.572+0000 7f36adc00640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a80734c0 0x7f36a81da510 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f369802b8c0 tx=0x7f36980046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.572+0000 7f36adc00640 1 -- 172.21.15.131:0/3189490900 shutdown_connections 2024-04-12T19:39:38.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.572+0000 7f36adc00640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f368406c8f0 0x7f368406edb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.572+0000 7f36adc00640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36a80bdbc0 0x7f36a81e6e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.572+0000 7f36adc00640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36a80a6240 0x7f36a814a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.572+0000 7f36adc00640 1 --2- 172.21.15.131:0/3189490900 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36a80734c0 0x7f36a81da510 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.572+0000 7f36adc00640 1 -- 172.21.15.131:0/3189490900 >> 172.21.15.131:0/3189490900 conn(0x7f36a80c24d0 msgr2=0x7f36a80c0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:38.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.572+0000 7f36adc00640 1 -- 172.21.15.131:0/3189490900 shutdown_connections 2024-04-12T19:39:38.573 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.572+0000 7f36adc00640 1 -- 172.21.15.131:0/3189490900 wait complete. 2024-04-12T19:39:38.593 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:38.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.793+0000 7f5c4ca00640 1 Processor -- start 2024-04-12T19:39:38.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.794+0000 7f5c4ca00640 1 -- start start 2024-04-12T19:39:38.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.795+0000 7f5c4ca00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f5c4814b530 0x7f5c480bd750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.795+0000 7f5c4ca00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c48067ae0 0x7f5c4815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.795+0000 7f5c4ca00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c481510d0 con 0x7f5c48151e70 2024-04-12T19:39:38.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.795+0000 7f5c4ca00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5c48154860 con 0x7f5c4814b530 2024-04-12T19:39:38.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.795+0000 7f5c4ca00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5c48151390 con 0x7f5c48067ae0 2024-04-12T19:39:38.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.796+0000 7f5c46800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c48067ae0 0x7f5c4815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.796+0000 7f5c45400640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f5c48151e70 0x7f5c480b8f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.131:44356/0 (socket says 172.21.15.131:44356) 2024-04-12T19:39:38.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.796+0000 7f5c45400640 1 -- 172.21.15.131:0/1309162017 learned_addr learned my addr 172.21.15.131:0/1309162017 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:38.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.796+0000 7f5c45e00640 1 --2- 172.21.15.131:0/1309162017 >> v2:172.21.15.171:3300/0 conn(0x7f5c4814b530 0x7f5c480bd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.797+0000 7f5c45e00640 1 -- 172.21.15.131:0/1309162017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c48067ae0 msgr2=0x7f5c4815ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:38.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.797+0000 7f5c45e00640 1 --2- 172.21.15.131:0/1309162017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c48067ae0 0x7f5c4815ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.797+0000 7f5c45e00640 1 -- 172.21.15.131:0/1309162017 >> v1:172.21.15.171:6789/0 conn(0x7f5c48151e70 legacy=0x7f5c480b8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:38.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.797+0000 7f5c45e00640 1 -- 172.21.15.131:0/1309162017 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c48151670 con 0x7f5c4814b530 2024-04-12T19:39:38.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.797+0000 7f5c46800640 1 --2- 172.21.15.131:0/1309162017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c48067ae0 0x7f5c4815ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:39:38.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.798+0000 7f5c45e00640 1 --2- 172.21.15.131:0/1309162017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c4814b530 0x7f5c480bd750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5c380097a0 tx=0x7f5c3802b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55afd2d4bdb74f10 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:38.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.798+0000 7f5c44a00640 1 -- 172.21.15.131:0/1309162017 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c38031780 con 0x7f5c4814b530 2024-04-12T19:39:38.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.798+0000 7f5c44a00640 1 -- 172.21.15.131:0/1309162017 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c38037070 con 0x7f5c4814b530 2024-04-12T19:39:38.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.798+0000 7f5c44a00640 1 -- 172.21.15.131:0/1309162017 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c38031b40 con 0x7f5c4814b530 2024-04-12T19:39:38.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.799+0000 7f5c4ca00640 1 -- 172.21.15.131:0/1309162017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c4814b530 msgr2=0x7f5c480bd750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:38.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.799+0000 7f5c4ca00640 1 --2- 172.21.15.131:0/1309162017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c4814b530 0x7f5c480bd750 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5c380097a0 tx=0x7f5c3802b820 comp rx=0 tx=0).stop 2024-04-12T19:39:38.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.799+0000 7f5c4ca00640 1 -- 172.21.15.131:0/1309162017 shutdown_connections 2024-04-12T19:39:38.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.799+0000 7f5c4ca00640 1 --2- 172.21.15.131:0/1309162017 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c48067ae0 0x7f5c4815ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.799+0000 7f5c4ca00640 1 --2- 172.21.15.131:0/1309162017 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c4814b530 0x7f5c480bd750 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.799+0000 7f5c4ca00640 1 -- 172.21.15.131:0/1309162017 >> 172.21.15.131:0/1309162017 conn(0x7f5c4806c920 msgr2=0x7f5c48071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:38.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.799+0000 7f5c4ca00640 1 -- 172.21.15.131:0/1309162017 shutdown_connections 2024-04-12T19:39:38.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.799+0000 7f5c4ca00640 1 -- 172.21.15.131:0/1309162017 wait complete. 2024-04-12T19:39:38.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.801+0000 7f5c4ca00640 1 Processor -- start 2024-04-12T19:39:38.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.801+0000 7f5c4ca00640 1 -- start start 2024-04-12T19:39:38.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.802+0000 7f5c4ca00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c48067ae0 0x7f5c48144740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.802+0000 7f5c4ca00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c4814b530 0x7f5c481e6fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.802+0000 7f5c4ca00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c48151e70 0x7f5c48145e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.802+0000 7f5c4ca00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5c480b9620 con 0x7f5c48151e70 2024-04-12T19:39:38.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.802+0000 7f5c4ca00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5c480bdc90 con 0x7f5c48067ae0 2024-04-12T19:39:38.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.802+0000 7f5c4ca00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5c4806de60 con 0x7f5c4814b530 2024-04-12T19:39:38.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.803+0000 7f5c46800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c48151e70 0x7f5c48145e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.803+0000 7f5c46800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c48151e70 0x7f5c48145e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55292/0 (socket says 172.21.15.131:55292) 2024-04-12T19:39:38.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.803+0000 7f5c46800640 1 -- 172.21.15.131:0/2324243154 learned_addr learned my addr 172.21.15.131:0/2324243154 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:38.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.803+0000 7f5c45400640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c4814b530 0x7f5c481e6fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.803+0000 7f5c45e00640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c48067ae0 0x7f5c48144740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.803+0000 7f5c46800640 1 -- 172.21.15.131:0/2324243154 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c4814b530 msgr2=0x7f5c481e6fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:38.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.803+0000 7f5c46800640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c4814b530 0x7f5c481e6fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.804+0000 7f5c46800640 1 -- 172.21.15.131:0/2324243154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c48067ae0 msgr2=0x7f5c48144740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:38.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.804+0000 7f5c46800640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c48067ae0 0x7f5c48144740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:38.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.804+0000 7f5c46800640 1 -- 172.21.15.131:0/2324243154 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c48144c80 con 0x7f5c48151e70 2024-04-12T19:39:38.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.804+0000 7f5c46800640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c48151e70 0x7f5c48145e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000efc0 tx=0x7f5c40009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:38.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.804+0000 7f5c3e000640 1 -- 172.21.15.131:0/2324243154 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40018030 con 0x7f5c48151e70 2024-04-12T19:39:38.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.804+0000 7f5c3e000640 1 -- 172.21.15.131:0/2324243154 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c4000cde0 con 0x7f5c48151e70 2024-04-12T19:39:38.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.804+0000 7f5c3e000640 1 -- 172.21.15.131:0/2324243154 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c40003bb0 con 0x7f5c48151e70 2024-04-12T19:39:38.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.804+0000 7f5c4ca00640 1 -- 172.21.15.131:0/2324243154 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c48145950 con 0x7f5c48151e70 2024-04-12T19:39:38.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.805+0000 7f5c4ca00640 1 -- 172.21.15.131:0/2324243154 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c481ea800 con 0x7f5c48151e70 2024-04-12T19:39:38.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.806+0000 7f5c4ca00640 1 -- 172.21.15.131:0/2324243154 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c48067f10 con 0x7f5c48151e70 2024-04-12T19:39:38.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.808+0000 7f5c3e000640 1 -- 172.21.15.131:0/2324243154 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5c40005d10 con 0x7f5c48151e70 2024-04-12T19:39:38.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.809+0000 7f5c3e000640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5c2806c8f0 0x7f5c2806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:38.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.809+0000 7f5c3e000640 1 -- 172.21.15.131:0/2324243154 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5c4008c7c0 con 0x7f5c48151e70 2024-04-12T19:39:38.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.809+0000 7f5c45e00640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5c2806c8f0 0x7f5c2806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:38.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.810+0000 7f5c45e00640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5c2806c8f0 0x7f5c2806edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5c38036000 tx=0x7f5c3803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:38.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:38.814+0000 7f5c3e000640 1 -- 172.21.15.131:0/2324243154 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5c40022070 con 0x7f5c48151e70 2024-04-12T19:39:39.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.023+0000 7f5c4ca00640 1 -- 172.21.15.131:0/2324243154 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5c4804fd50 con 0x7f5c48151e70 2024-04-12T19:39:39.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.026+0000 7f5c3e000640 1 -- 172.21.15.131:0/2324243154 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f5c40010040 con 0x7f5c48151e70 2024-04-12T19:39:39.026 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:39.027 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":26,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:17.479662+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:39.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.028+0000 7f5c4ca00640 1 -- 172.21.15.131:0/2324243154 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5c2806c8f0 msgr2=0x7f5c2806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.028+0000 7f5c4ca00640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5c2806c8f0 0x7f5c2806edb0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f5c38036000 tx=0x7f5c3803d040 comp rx=0 tx=0).stop 2024-04-12T19:39:39.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.028+0000 7f5c4ca00640 1 -- 172.21.15.131:0/2324243154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c48151e70 msgr2=0x7f5c48145e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.028+0000 7f5c4ca00640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c48151e70 0x7f5c48145e10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5c4000efc0 tx=0x7f5c40009f90 comp rx=0 tx=0).stop 2024-04-12T19:39:39.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.028+0000 7f5c4ca00640 1 -- 172.21.15.131:0/2324243154 shutdown_connections 2024-04-12T19:39:39.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.028+0000 7f5c4ca00640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5c2806c8f0 0x7f5c2806edb0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.028+0000 7f5c4ca00640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5c48151e70 0x7f5c48145e10 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.028+0000 7f5c4ca00640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5c4814b530 0x7f5c481e6fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.028+0000 7f5c4ca00640 1 --2- 172.21.15.131:0/2324243154 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5c48067ae0 0x7f5c48144740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.028+0000 7f5c4ca00640 1 -- 172.21.15.131:0/2324243154 >> 172.21.15.131:0/2324243154 conn(0x7f5c4806c920 msgr2=0x7f5c480bea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:39.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.029+0000 7f5c4ca00640 1 -- 172.21.15.131:0/2324243154 shutdown_connections 2024-04-12T19:39:39.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.029+0000 7f5c4ca00640 1 -- 172.21.15.131:0/2324243154 wait complete. 2024-04-12T19:39:39.039 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:39:39.046 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:39:39.048 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-12T19:39:39.048 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-12T19:39:39.262 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.263+0000 7fed18800640 1 Processor -- start 2024-04-12T19:39:39.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.263+0000 7fed18800640 1 -- start start 2024-04-12T19:39:39.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.264+0000 7fed18800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fed100b9fd0 0x7fed1014e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.264+0000 7fed18800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed100c3090 con 0x7fed1006d010 2024-04-12T19:39:39.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.264+0000 7fed18800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed100c1e60 con 0x7fed1014ec50 2024-04-12T19:39:39.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.264+0000 7fed18800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fed100c2280 con 0x7fed100b9fd0 2024-04-12T19:39:39.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.264+0000 7fed15e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fed1006d010 0x7fed1006c0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:39398/0 (socket says 172.21.15.131:39398) 2024-04-12T19:39:39.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.264+0000 7fed15e00640 1 -- 172.21.15.131:0/1598136718 learned_addr learned my addr 172.21.15.131:0/1598136718 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.264+0000 7fed15400640 1 --2- 172.21.15.131:0/1598136718 >> v2:172.21.15.171:3300/0 conn(0x7fed100b9fd0 0x7fed1014e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201432820 0 0) 0x7fed100c3090 con 0x7fed1006d010 2024-04-12T19:39:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecf8003520 con 0x7fed1006d010 2024-04-12T19:39:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3561232193 0 0) 0x7fecf8003520 con 0x7fed1006d010 2024-04-12T19:39:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 >> v2:172.21.15.171:3300/0 conn(0x7fed100b9fd0 msgr2=0x7fed1014e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 --2- 172.21.15.131:0/1598136718 >> v2:172.21.15.171:3300/0 conn(0x7fed100b9fd0 0x7fed1014e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 >> v1:172.21.15.171:6789/0 conn(0x7fed1014ec50 legacy=0x7fed1015bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed100c2db0 con 0x7fed1006d010 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7fed04001670 con 0x7fed1006d010 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 >> v1:172.21.15.131:6789/0 conn(0x7fed1006d010 legacy=0x7fed1006c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 --2- 172.21.15.131:0/1598136718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecf80039b0 0x7fecf8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 --2- 172.21.15.131:0/1598136718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecf8004800 0x7fecf8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 --2- 172.21.15.131:0/1598136718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecf80053c0 0x7fecf800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fed100c2280 con 0x7fecf80053c0 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fecf800c250 con 0x7fecf8004800 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fecf800c450 con 0x7fecf80039b0 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.265+0000 7fed16800640 1 --2- 172.21.15.131:0/1598136718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecf80053c0 0x7fecf800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.266+0000 7fed15400640 1 --2- 172.21.15.131:0/1598136718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecf8004800 0x7fecf8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.266+0000 7fed15e00640 1 --2- 172.21.15.131:0/1598136718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecf80039b0 0x7fecf8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.266+0000 7fed16800640 1 -- 172.21.15.131:0/1598136718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecf80039b0 msgr2=0x7fecf8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.266+0000 7fed16800640 1 --2- 172.21.15.131:0/1598136718 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fecf80039b0 0x7fecf8003dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.266+0000 7fed16800640 1 -- 172.21.15.131:0/1598136718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecf8004800 msgr2=0x7fecf8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:39.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.266+0000 7fed16800640 1 --2- 172.21.15.131:0/1598136718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecf8004800 0x7fecf8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.266+0000 7fed16800640 1 -- 172.21.15.131:0/1598136718 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf8003520 con 0x7fecf80053c0 2024-04-12T19:39:39.268 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.266+0000 7fed15400640 1 --2- 172.21.15.131:0/1598136718 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecf8004800 0x7fecf8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.267+0000 7fed16800640 1 -- 172.21.15.131:0/1598136718 reap_dead start 2024-04-12T19:39:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.267+0000 7fed16800640 1 --2- 172.21.15.131:0/1598136718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecf80053c0 0x7fecf800b9c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fed0c001e50 tx=0x7fecf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb04677d5078a95 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.267+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c001a70 con 0x7fecf80053c0 2024-04-12T19:39:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.267+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0c003b90 con 0x7fecf80053c0 2024-04-12T19:39:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.267+0000 7fed14a00640 1 -- 172.21.15.131:0/1598136718 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c0050d0 con 0x7fecf80053c0 2024-04-12T19:39:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.268+0000 7fed18800640 1 -- 172.21.15.131:0/1598136718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecf80053c0 msgr2=0x7fecf800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.268+0000 7fed18800640 1 --2- 172.21.15.131:0/1598136718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecf80053c0 0x7fecf800b9c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fed0c001e50 tx=0x7fecf8005830 comp rx=0 tx=0).stop 2024-04-12T19:39:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.268+0000 7fed18800640 1 -- 172.21.15.131:0/1598136718 shutdown_connections 2024-04-12T19:39:39.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.268+0000 7fed18800640 1 --2- 172.21.15.131:0/1598136718 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fecf80053c0 0x7fecf800b9c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.268+0000 7fed18800640 1 -- 172.21.15.131:0/1598136718 >> 172.21.15.131:0/1598136718 conn(0x7fed100c68d0 msgr2=0x7fed100c6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:39.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.268+0000 7fed18800640 1 -- 172.21.15.131:0/1598136718 shutdown_connections 2024-04-12T19:39:39.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.268+0000 7fed18800640 1 -- 172.21.15.131:0/1598136718 wait complete. 2024-04-12T19:39:39.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.269+0000 7fed18800640 1 Processor -- start 2024-04-12T19:39:39.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.269+0000 7fed18800640 1 -- start start 2024-04-12T19:39:39.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.270+0000 7fed18800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecf80053c0 0x7fed100c0010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.270+0000 7fed18800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed10155240 0x7fed1014a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.270+0000 7fed18800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed101545f0 0x7fed101e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.270+0000 7fed18800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fed1006d3f0 con 0x7fed101545f0 2024-04-12T19:39:39.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.270+0000 7fed18800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fed100c24d0 con 0x7fecf80053c0 2024-04-12T19:39:39.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.270+0000 7fed18800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fed1006d570 con 0x7fed10155240 2024-04-12T19:39:39.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.271+0000 7fed16800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed101545f0 0x7fed101e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.271+0000 7fed16800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed101545f0 0x7fed101e9c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55308/0 (socket says 172.21.15.131:55308) 2024-04-12T19:39:39.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.271+0000 7fed16800640 1 -- 172.21.15.131:0/868537769 learned_addr learned my addr 172.21.15.131:0/868537769 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.271+0000 7fed15400640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed10155240 0x7fed1014a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.271+0000 7fed15e00640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecf80053c0 0x7fed100c0010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.271+0000 7fed16800640 1 -- 172.21.15.131:0/868537769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed10155240 msgr2=0x7fed1014a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.271+0000 7fed16800640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed10155240 0x7fed1014a1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.271+0000 7fed16800640 1 -- 172.21.15.131:0/868537769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecf80053c0 msgr2=0x7fed100c0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.271+0000 7fed16800640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecf80053c0 0x7fed100c0010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.271+0000 7fed16800640 1 -- 172.21.15.131:0/868537769 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed100c0550 con 0x7fed101545f0 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.271+0000 7fed16800640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed101545f0 0x7fed101e9c90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed0c02c060 tx=0x7fed0c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.272+0000 7fed0a000640 1 -- 172.21.15.131:0/868537769 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c006d50 con 0x7fed101545f0 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.272+0000 7fed0a000640 1 -- 172.21.15.131:0/868537769 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed0c039480 con 0x7fed101545f0 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.272+0000 7fed18800640 1 -- 172.21.15.131:0/868537769 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed1014afa0 con 0x7fed101545f0 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.272+0000 7fed0a000640 1 -- 172.21.15.131:0/868537769 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed0c039870 con 0x7fed101545f0 2024-04-12T19:39:39.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.272+0000 7fed18800640 1 -- 172.21.15.131:0/868537769 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed10149050 con 0x7fed101545f0 2024-04-12T19:39:39.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.273+0000 7fed18800640 1 -- 172.21.15.131:0/868537769 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed1004fd50 con 0x7fed101545f0 2024-04-12T19:39:39.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.274+0000 7fed0a000640 1 -- 172.21.15.131:0/868537769 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fed0c039a10 con 0x7fed101545f0 2024-04-12T19:39:39.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.275+0000 7fed0a000640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fecf406c8f0 0x7fecf406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.275+0000 7fed0a000640 1 -- 172.21.15.131:0/868537769 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fed0c0ade60 con 0x7fed101545f0 2024-04-12T19:39:39.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.275+0000 7fed15e00640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fecf406c8f0 0x7fecf406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.276 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.276+0000 7fed15e00640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fecf406c8f0 0x7fecf406edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed100c0890 tx=0x7fed04009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:39.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.280+0000 7fed0a000640 1 -- 172.21.15.131:0/868537769 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fed0c033030 con 0x7fed101545f0 2024-04-12T19:39:39.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.468+0000 7fed18800640 1 -- 172.21.15.131:0/868537769 --> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fed100c0d00 con 0x7fecf406c8f0 2024-04-12T19:39:39.490 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.490+0000 7fed0a000640 1 -- 172.21.15.131:0/868537769 <== mgr.4101 v2:172.21.15.131:6832/873500205 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332650 (secure 0 0 0) 0x7fed100c0d00 con 0x7fecf406c8f0 2024-04-12T19:39:39.495 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:39.497 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-12T19:39:39.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.497+0000 7fed18800640 1 -- 172.21.15.131:0/868537769 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fecf406c8f0 msgr2=0x7fecf406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.497+0000 7fed18800640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fecf406c8f0 0x7fecf406edb0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fed100c0890 tx=0x7fed04009040 comp rx=0 tx=0).stop 2024-04-12T19:39:39.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.497+0000 7fed18800640 1 -- 172.21.15.131:0/868537769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed101545f0 msgr2=0x7fed101e9c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.497+0000 7fed18800640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed101545f0 0x7fed101e9c90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fed0c02c060 tx=0x7fed0c0014a0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.497+0000 7fed18800640 1 -- 172.21.15.131:0/868537769 shutdown_connections 2024-04-12T19:39:39.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.497+0000 7fed18800640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fecf406c8f0 0x7fecf406edb0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.497+0000 7fed18800640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed101545f0 0x7fed101e9c90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.497+0000 7fed18800640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fed10155240 0x7fed1014a1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.497+0000 7fed18800640 1 --2- 172.21.15.131:0/868537769 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fecf80053c0 0x7fed100c0010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.497+0000 7fed18800640 1 -- 172.21.15.131:0/868537769 >> 172.21.15.131:0/868537769 conn(0x7fed100c68d0 msgr2=0x7fed100c56f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:39.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.497+0000 7fed18800640 1 -- 172.21.15.131:0/868537769 shutdown_connections 2024-04-12T19:39:39.499 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.497+0000 7fed18800640 1 -- 172.21.15.131:0/868537769 wait complete. 2024-04-12T19:39:39.516 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-12T19:39:38.828538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218532,"kb_used_data":2368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756188,"statfs":{"total":773094113280,"available":772870336512,"internally_reserved":0,"allocated":2424832,"data_stored":2086528,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004787"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585758+0000","last_change":"2024-04-12T19:39:10.436376+0000","last_active":"2024-04-12T19:39:18.585758+0000","last_peered":"2024-04-12T19:39:18.585758+0000","last_clean":"2024-04-12T19:39:18.585758+0000","last_became_active":"2024-04-12T19:39:10.436052+0000","last_became_peered":"2024-04-12T19:39:10.436052+0000","last_unstale":"2024-04-12T19:39:18.585758+0000","last_undegraded":"2024-04-12T19:39:18.585758+0000","last_fullsized":"2024-04-12T19:39:18.585758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:25:54.417979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489106+0000","last_change":"2024-04-12T19:39:11.476500+0000","last_active":"2024-04-12T19:39:17.489106+0000","last_peered":"2024-04-12T19:39:17.489106+0000","last_clean":"2024-04-12T19:39:17.489106+0000","last_became_active":"2024-04-12T19:39:11.476227+0000","last_became_peered":"2024-04-12T19:39:11.476227+0000","last_unstale":"2024-04-12T19:39:17.489106+0000","last_undegraded":"2024-04-12T19:39:17.489106+0000","last_fullsized":"2024-04-12T19:39:17.489106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:10:23.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488071+0000","last_change":"2024-04-12T19:39:16.130127+0000","last_active":"2024-04-12T19:39:17.488071+0000","last_peered":"2024-04-12T19:39:17.488071+0000","last_clean":"2024-04-12T19:39:17.488071+0000","last_became_active":"2024-04-12T19:39:16.128965+0000","last_became_peered":"2024-04-12T19:39:16.128965+0000","last_unstale":"2024-04-12T19:39:17.488071+0000","last_undegraded":"2024-04-12T19:39:17.488071+0000","last_fullsized":"2024-04-12T19:39:17.488071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:05:40.753433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489202+0000","last_change":"2024-04-12T19:39:10.434713+0000","last_active":"2024-04-12T19:39:17.489202+0000","last_peered":"2024-04-12T19:39:17.489202+0000","last_clean":"2024-04-12T19:39:17.489202+0000","last_became_active":"2024-04-12T19:39:10.434206+0000","last_became_peered":"2024-04-12T19:39:10.434206+0000","last_unstale":"2024-04-12T19:39:17.489202+0000","last_undegraded":"2024-04-12T19:39:17.489202+0000","last_fullsized":"2024-04-12T19:39:17.489202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:35:32.075423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585573+0000","last_change":"2024-04-12T19:39:11.468967+0000","last_active":"2024-04-12T19:39:18.585573+0000","last_peered":"2024-04-12T19:39:18.585573+0000","last_clean":"2024-04-12T19:39:18.585573+0000","last_became_active":"2024-04-12T19:39:11.468506+0000","last_became_peered":"2024-04-12T19:39:11.468506+0000","last_unstale":"2024-04-12T19:39:18.585573+0000","last_undegraded":"2024-04-12T19:39:18.585573+0000","last_fullsized":"2024-04-12T19:39:18.585573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:34:33.700728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490493+0000","last_change":"2024-04-12T19:39:15.514844+0000","last_active":"2024-04-12T19:39:17.490493+0000","last_peered":"2024-04-12T19:39:17.490493+0000","last_clean":"2024-04-12T19:39:17.490493+0000","last_became_active":"2024-04-12T19:39:15.514389+0000","last_became_peered":"2024-04-12T19:39:15.514389+0000","last_unstale":"2024-04-12T19:39:17.490493+0000","last_undegraded":"2024-04-12T19:39:17.490493+0000","last_fullsized":"2024-04-12T19:39:17.490493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:13.334480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493030+0000","last_change":"2024-04-12T19:39:10.449208+0000","last_active":"2024-04-12T19:39:18.493030+0000","last_peered":"2024-04-12T19:39:18.493030+0000","last_clean":"2024-04-12T19:39:18.493030+0000","last_became_active":"2024-04-12T19:39:10.447087+0000","last_became_peered":"2024-04-12T19:39:10.447087+0000","last_unstale":"2024-04-12T19:39:18.493030+0000","last_undegraded":"2024-04-12T19:39:18.493030+0000","last_fullsized":"2024-04-12T19:39:18.493030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:15.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493393+0000","last_change":"2024-04-12T19:39:11.453798+0000","last_active":"2024-04-12T19:39:17.493393+0000","last_peered":"2024-04-12T19:39:17.493393+0000","last_clean":"2024-04-12T19:39:17.493393+0000","last_became_active":"2024-04-12T19:39:11.451146+0000","last_became_peered":"2024-04-12T19:39:11.451146+0000","last_unstale":"2024-04-12T19:39:17.493393+0000","last_undegraded":"2024-04-12T19:39:17.493393+0000","last_fullsized":"2024-04-12T19:39:17.493393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:21:53.745025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491302+0000","last_change":"2024-04-12T19:39:15.516232+0000","last_active":"2024-04-12T19:39:17.491302+0000","last_peered":"2024-04-12T19:39:17.491302+0000","last_clean":"2024-04-12T19:39:17.491302+0000","last_became_active":"2024-04-12T19:39:15.515675+0000","last_became_peered":"2024-04-12T19:39:15.515675+0000","last_unstale":"2024-04-12T19:39:17.491302+0000","last_undegraded":"2024-04-12T19:39:17.491302+0000","last_fullsized":"2024-04-12T19:39:17.491302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:39:36.033443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.492973+0000","last_change":"2024-04-12T19:39:10.448666+0000","last_active":"2024-04-12T19:39:18.492973+0000","last_peered":"2024-04-12T19:39:18.492973+0000","last_clean":"2024-04-12T19:39:18.492973+0000","last_became_active":"2024-04-12T19:39:10.447506+0000","last_became_peered":"2024-04-12T19:39:10.447506+0000","last_unstale":"2024-04-12T19:39:18.492973+0000","last_undegraded":"2024-04-12T19:39:18.492973+0000","last_fullsized":"2024-04-12T19:39:18.492973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493463+0000","last_change":"2024-04-12T19:39:11.444311+0000","last_active":"2024-04-12T19:39:17.493463+0000","last_peered":"2024-04-12T19:39:17.493463+0000","last_clean":"2024-04-12T19:39:17.493463+0000","last_became_active":"2024-04-12T19:39:11.443691+0000","last_became_peered":"2024-04-12T19:39:11.443691+0000","last_unstale":"2024-04-12T19:39:17.493463+0000","last_undegraded":"2024-04-12T19:39:17.493463+0000","last_fullsized":"2024-04-12T19:39:17.493463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:37.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491425+0000","last_change":"2024-04-12T19:39:15.512394+0000","last_active":"2024-04-12T19:39:17.491425+0000","last_peered":"2024-04-12T19:39:17.491425+0000","last_clean":"2024-04-12T19:39:17.491425+0000","last_became_active":"2024-04-12T19:39:15.511995+0000","last_became_peered":"2024-04-12T19:39:15.511995+0000","last_unstale":"2024-04-12T19:39:17.491425+0000","last_undegraded":"2024-04-12T19:39:17.491425+0000","last_fullsized":"2024-04-12T19:39:17.491425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:25:21.809067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.173497+0000","last_change":"2024-04-12T19:39:11.466978+0000","last_active":"2024-04-12T19:39:18.173497+0000","last_peered":"2024-04-12T19:39:18.173497+0000","last_clean":"2024-04-12T19:39:18.173497+0000","last_became_active":"2024-04-12T19:39:11.462526+0000","last_became_peered":"2024-04-12T19:39:11.462526+0000","last_unstale":"2024-04-12T19:39:18.173497+0000","last_undegraded":"2024-04-12T19:39:18.173497+0000","last_fullsized":"2024-04-12T19:39:18.173497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493020+0000","last_change":"2024-04-12T19:39:10.449545+0000","last_active":"2024-04-12T19:39:18.493020+0000","last_peered":"2024-04-12T19:39:18.493020+0000","last_clean":"2024-04-12T19:39:18.493020+0000","last_became_active":"2024-04-12T19:39:10.449218+0000","last_became_peered":"2024-04-12T19:39:10.449218+0000","last_unstale":"2024-04-12T19:39:18.493020+0000","last_undegraded":"2024-04-12T19:39:18.493020+0000","last_fullsized":"2024-04-12T19:39:18.493020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:51.431359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492072+0000","last_change":"2024-04-12T19:39:15.520316+0000","last_active":"2024-04-12T19:39:17.492072+0000","last_peered":"2024-04-12T19:39:17.492072+0000","last_clean":"2024-04-12T19:39:17.492072+0000","last_became_active":"2024-04-12T19:39:15.519733+0000","last_became_peered":"2024-04-12T19:39:15.519733+0000","last_unstale":"2024-04-12T19:39:17.492072+0000","last_undegraded":"2024-04-12T19:39:17.492072+0000","last_fullsized":"2024-04-12T19:39:17.492072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:45:30.872970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488363+0000","last_change":"2024-04-12T19:39:11.468457+0000","last_active":"2024-04-12T19:39:17.488363+0000","last_peered":"2024-04-12T19:39:17.488363+0000","last_clean":"2024-04-12T19:39:17.488363+0000","last_became_active":"2024-04-12T19:39:11.467315+0000","last_became_peered":"2024-04-12T19:39:11.467315+0000","last_unstale":"2024-04-12T19:39:17.488363+0000","last_undegraded":"2024-04-12T19:39:17.488363+0000","last_fullsized":"2024-04-12T19:39:17.488363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103926+0000","last_change":"2024-04-12T19:39:10.440820+0000","last_active":"2024-04-12T19:39:18.103926+0000","last_peered":"2024-04-12T19:39:18.103926+0000","last_clean":"2024-04-12T19:39:18.103926+0000","last_became_active":"2024-04-12T19:39:10.440389+0000","last_became_peered":"2024-04-12T19:39:10.440389+0000","last_unstale":"2024-04-12T19:39:18.103926+0000","last_undegraded":"2024-04-12T19:39:18.103926+0000","last_fullsized":"2024-04-12T19:39:18.103926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490713+0000","last_change":"2024-04-12T19:39:15.512849+0000","last_active":"2024-04-12T19:39:17.490713+0000","last_peered":"2024-04-12T19:39:17.490713+0000","last_clean":"2024-04-12T19:39:17.490713+0000","last_became_active":"2024-04-12T19:39:15.512484+0000","last_became_peered":"2024-04-12T19:39:15.512484+0000","last_unstale":"2024-04-12T19:39:17.490713+0000","last_undegraded":"2024-04-12T19:39:17.490713+0000","last_fullsized":"2024-04-12T19:39:17.490713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:41.709345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487788+0000","last_change":"2024-04-12T19:39:11.467478+0000","last_active":"2024-04-12T19:39:17.487788+0000","last_peered":"2024-04-12T19:39:17.487788+0000","last_clean":"2024-04-12T19:39:17.487788+0000","last_became_active":"2024-04-12T19:39:11.467119+0000","last_became_peered":"2024-04-12T19:39:11.467119+0000","last_unstale":"2024-04-12T19:39:17.487788+0000","last_undegraded":"2024-04-12T19:39:17.487788+0000","last_fullsized":"2024-04-12T19:39:17.487788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103760+0000","last_change":"2024-04-12T19:39:10.445133+0000","last_active":"2024-04-12T19:39:18.103760+0000","last_peered":"2024-04-12T19:39:18.103760+0000","last_clean":"2024-04-12T19:39:18.103760+0000","last_became_active":"2024-04-12T19:39:10.444813+0000","last_became_peered":"2024-04-12T19:39:10.444813+0000","last_unstale":"2024-04-12T19:39:18.103760+0000","last_undegraded":"2024-04-12T19:39:18.103760+0000","last_fullsized":"2024-04-12T19:39:18.103760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:28:58.315840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104936+0000","last_change":"2024-04-12T19:39:16.128749+0000","last_active":"2024-04-12T19:39:18.104936+0000","last_peered":"2024-04-12T19:39:18.104936+0000","last_clean":"2024-04-12T19:39:18.104936+0000","last_became_active":"2024-04-12T19:39:16.127560+0000","last_became_peered":"2024-04-12T19:39:16.127560+0000","last_unstale":"2024-04-12T19:39:18.104936+0000","last_undegraded":"2024-04-12T19:39:18.104936+0000","last_fullsized":"2024-04-12T19:39:18.104936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:27:00.174133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491573+0000","last_change":"2024-04-12T19:39:11.460532+0000","last_active":"2024-04-12T19:39:17.491573+0000","last_peered":"2024-04-12T19:39:17.491573+0000","last_clean":"2024-04-12T19:39:17.491573+0000","last_became_active":"2024-04-12T19:39:11.460027+0000","last_became_peered":"2024-04-12T19:39:11.460027+0000","last_unstale":"2024-04-12T19:39:17.491573+0000","last_undegraded":"2024-04-12T19:39:17.491573+0000","last_fullsized":"2024-04-12T19:39:17.491573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:16.676989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493544+0000","last_change":"2024-04-12T19:39:10.447746+0000","last_active":"2024-04-12T19:39:18.493544+0000","last_peered":"2024-04-12T19:39:18.493544+0000","last_clean":"2024-04-12T19:39:18.493544+0000","last_became_active":"2024-04-12T19:39:10.446264+0000","last_became_peered":"2024-04-12T19:39:10.446264+0000","last_unstale":"2024-04-12T19:39:18.493544+0000","last_undegraded":"2024-04-12T19:39:18.493544+0000","last_fullsized":"2024-04-12T19:39:18.493544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492578+0000","last_change":"2024-04-12T19:39:15.514854+0000","last_active":"2024-04-12T19:39:17.492578+0000","last_peered":"2024-04-12T19:39:17.492578+0000","last_clean":"2024-04-12T19:39:17.492578+0000","last_became_active":"2024-04-12T19:39:15.514469+0000","last_became_peered":"2024-04-12T19:39:15.514469+0000","last_unstale":"2024-04-12T19:39:17.492578+0000","last_undegraded":"2024-04-12T19:39:17.492578+0000","last_fullsized":"2024-04-12T19:39:17.492578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:02:18.119234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.586125+0000","last_change":"2024-04-12T19:39:11.455415+0000","last_active":"2024-04-12T19:39:18.586125+0000","last_peered":"2024-04-12T19:39:18.586125+0000","last_clean":"2024-04-12T19:39:18.586125+0000","last_became_active":"2024-04-12T19:39:11.455042+0000","last_became_peered":"2024-04-12T19:39:11.455042+0000","last_unstale":"2024-04-12T19:39:18.586125+0000","last_undegraded":"2024-04-12T19:39:18.586125+0000","last_fullsized":"2024-04-12T19:39:18.586125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175136+0000","last_change":"2024-04-12T19:39:10.447580+0000","last_active":"2024-04-12T19:39:18.175136+0000","last_peered":"2024-04-12T19:39:18.175136+0000","last_clean":"2024-04-12T19:39:18.175136+0000","last_became_active":"2024-04-12T19:39:10.447234+0000","last_became_peered":"2024-04-12T19:39:10.447234+0000","last_unstale":"2024-04-12T19:39:18.175136+0000","last_undegraded":"2024-04-12T19:39:18.175136+0000","last_fullsized":"2024-04-12T19:39:18.175136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490950+0000","last_change":"2024-04-12T19:39:16.129529+0000","last_active":"2024-04-12T19:39:17.490950+0000","last_peered":"2024-04-12T19:39:17.490950+0000","last_clean":"2024-04-12T19:39:17.490950+0000","last_became_active":"2024-04-12T19:39:16.128296+0000","last_became_peered":"2024-04-12T19:39:16.128296+0000","last_unstale":"2024-04-12T19:39:17.490950+0000","last_undegraded":"2024-04-12T19:39:17.490950+0000","last_fullsized":"2024-04-12T19:39:17.490950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:30.579330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489090+0000","last_change":"2024-04-12T19:39:11.474331+0000","last_active":"2024-04-12T19:39:17.489090+0000","last_peered":"2024-04-12T19:39:17.489090+0000","last_clean":"2024-04-12T19:39:17.489090+0000","last_became_active":"2024-04-12T19:39:11.474034+0000","last_became_peered":"2024-04-12T19:39:11.474034+0000","last_unstale":"2024-04-12T19:39:17.489090+0000","last_undegraded":"2024-04-12T19:39:17.489090+0000","last_fullsized":"2024-04-12T19:39:17.489090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104698+0000","last_change":"2024-04-12T19:39:10.441909+0000","last_active":"2024-04-12T19:39:18.104698+0000","last_peered":"2024-04-12T19:39:18.104698+0000","last_clean":"2024-04-12T19:39:18.104698+0000","last_became_active":"2024-04-12T19:39:10.441461+0000","last_became_peered":"2024-04-12T19:39:10.441461+0000","last_unstale":"2024-04-12T19:39:18.104698+0000","last_undegraded":"2024-04-12T19:39:18.104698+0000","last_fullsized":"2024-04-12T19:39:18.104698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487914+0000","last_change":"2024-04-12T19:39:16.121582+0000","last_active":"2024-04-12T19:39:17.487914+0000","last_peered":"2024-04-12T19:39:17.487914+0000","last_clean":"2024-04-12T19:39:17.487914+0000","last_became_active":"2024-04-12T19:39:16.120301+0000","last_became_peered":"2024-04-12T19:39:16.120301+0000","last_unstale":"2024-04-12T19:39:17.487914+0000","last_undegraded":"2024-04-12T19:39:17.487914+0000","last_fullsized":"2024-04-12T19:39:17.487914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:08:52.349202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104233+0000","last_change":"2024-04-12T19:39:11.454547+0000","last_active":"2024-04-12T19:39:18.104233+0000","last_peered":"2024-04-12T19:39:18.104233+0000","last_clean":"2024-04-12T19:39:18.104233+0000","last_became_active":"2024-04-12T19:39:11.454183+0000","last_became_peered":"2024-04-12T19:39:11.454183+0000","last_unstale":"2024-04-12T19:39:18.104233+0000","last_undegraded":"2024-04-12T19:39:18.104233+0000","last_fullsized":"2024-04-12T19:39:18.104233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495290+0000","last_change":"2024-04-12T19:39:10.450615+0000","last_active":"2024-04-12T19:39:18.495290+0000","last_peered":"2024-04-12T19:39:18.495290+0000","last_clean":"2024-04-12T19:39:18.495290+0000","last_became_active":"2024-04-12T19:39:10.450161+0000","last_became_peered":"2024-04-12T19:39:10.450161+0000","last_unstale":"2024-04-12T19:39:18.495290+0000","last_undegraded":"2024-04-12T19:39:18.495290+0000","last_fullsized":"2024-04-12T19:39:18.495290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:28:58.315840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585091+0000","last_change":"2024-04-12T19:39:16.130720+0000","last_active":"2024-04-12T19:39:18.585091+0000","last_peered":"2024-04-12T19:39:18.585091+0000","last_clean":"2024-04-12T19:39:18.585091+0000","last_became_active":"2024-04-12T19:39:16.127733+0000","last_became_peered":"2024-04-12T19:39:16.127733+0000","last_unstale":"2024-04-12T19:39:18.585091+0000","last_undegraded":"2024-04-12T19:39:18.585091+0000","last_fullsized":"2024-04-12T19:39:18.585091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:25:21.809067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493689+0000","last_change":"2024-04-12T19:39:11.478915+0000","last_active":"2024-04-12T19:39:17.493689+0000","last_peered":"2024-04-12T19:39:17.493689+0000","last_clean":"2024-04-12T19:39:17.493689+0000","last_became_active":"2024-04-12T19:39:11.478570+0000","last_became_peered":"2024-04-12T19:39:11.478570+0000","last_unstale":"2024-04-12T19:39:17.493689+0000","last_undegraded":"2024-04-12T19:39:17.493689+0000","last_fullsized":"2024-04-12T19:39:17.493689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:26.512414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104346+0000","last_change":"2024-04-12T19:39:10.430117+0000","last_active":"2024-04-12T19:39:18.104346+0000","last_peered":"2024-04-12T19:39:18.104346+0000","last_clean":"2024-04-12T19:39:18.104346+0000","last_became_active":"2024-04-12T19:39:10.429533+0000","last_became_peered":"2024-04-12T19:39:10.429533+0000","last_unstale":"2024-04-12T19:39:18.104346+0000","last_undegraded":"2024-04-12T19:39:18.104346+0000","last_fullsized":"2024-04-12T19:39:18.104346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103455+0000","last_change":"2024-04-12T19:39:15.516618+0000","last_active":"2024-04-12T19:39:18.103455+0000","last_peered":"2024-04-12T19:39:18.103455+0000","last_clean":"2024-04-12T19:39:18.103455+0000","last_became_active":"2024-04-12T19:39:15.516233+0000","last_became_peered":"2024-04-12T19:39:15.516233+0000","last_unstale":"2024-04-12T19:39:18.103455+0000","last_undegraded":"2024-04-12T19:39:18.103455+0000","last_fullsized":"2024-04-12T19:39:18.103455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:45:30.872970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491846+0000","last_change":"2024-04-12T19:39:11.459045+0000","last_active":"2024-04-12T19:39:17.491846+0000","last_peered":"2024-04-12T19:39:17.491846+0000","last_clean":"2024-04-12T19:39:17.491846+0000","last_became_active":"2024-04-12T19:39:11.458714+0000","last_became_peered":"2024-04-12T19:39:11.458714+0000","last_unstale":"2024-04-12T19:39:17.491846+0000","last_undegraded":"2024-04-12T19:39:17.491846+0000","last_fullsized":"2024-04-12T19:39:17.491846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:33.845598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491628+0000","last_change":"2024-04-12T19:39:10.437425+0000","last_active":"2024-04-12T19:39:17.491628+0000","last_peered":"2024-04-12T19:39:17.491628+0000","last_clean":"2024-04-12T19:39:17.491628+0000","last_became_active":"2024-04-12T19:39:10.437004+0000","last_became_peered":"2024-04-12T19:39:10.437004+0000","last_unstale":"2024-04-12T19:39:17.491628+0000","last_undegraded":"2024-04-12T19:39:17.491628+0000","last_fullsized":"2024-04-12T19:39:17.491628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104281+0000","last_change":"2024-04-12T19:39:15.523251+0000","last_active":"2024-04-12T19:39:18.104281+0000","last_peered":"2024-04-12T19:39:18.104281+0000","last_clean":"2024-04-12T19:39:18.104281+0000","last_became_active":"2024-04-12T19:39:15.519488+0000","last_became_peered":"2024-04-12T19:39:15.519488+0000","last_unstale":"2024-04-12T19:39:18.104281+0000","last_undegraded":"2024-04-12T19:39:18.104281+0000","last_fullsized":"2024-04-12T19:39:18.104281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:12:45.261630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103426+0000","last_change":"2024-04-12T19:39:11.452969+0000","last_active":"2024-04-12T19:39:18.103426+0000","last_peered":"2024-04-12T19:39:18.103426+0000","last_clean":"2024-04-12T19:39:18.103426+0000","last_became_active":"2024-04-12T19:39:11.452699+0000","last_became_peered":"2024-04-12T19:39:11.452699+0000","last_unstale":"2024-04-12T19:39:18.103426+0000","last_undegraded":"2024-04-12T19:39:18.103426+0000","last_fullsized":"2024-04-12T19:39:18.103426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962166+0000","last_change":"2024-04-12T19:39:10.435670+0000","last_active":"2024-04-12T19:39:18.962166+0000","last_peered":"2024-04-12T19:39:18.962166+0000","last_clean":"2024-04-12T19:39:18.962166+0000","last_became_active":"2024-04-12T19:39:10.435317+0000","last_became_peered":"2024-04-12T19:39:10.435317+0000","last_unstale":"2024-04-12T19:39:18.962166+0000","last_undegraded":"2024-04-12T19:39:18.962166+0000","last_fullsized":"2024-04-12T19:39:18.962166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104855+0000","last_change":"2024-04-12T19:39:15.517258+0000","last_active":"2024-04-12T19:39:18.104855+0000","last_peered":"2024-04-12T19:39:18.104855+0000","last_clean":"2024-04-12T19:39:18.104855+0000","last_became_active":"2024-04-12T19:39:15.516843+0000","last_became_peered":"2024-04-12T19:39:15.516843+0000","last_unstale":"2024-04-12T19:39:18.104855+0000","last_undegraded":"2024-04-12T19:39:18.104855+0000","last_fullsized":"2024-04-12T19:39:18.104855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:56:53.325064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.584621+0000","last_change":"2024-04-12T19:39:11.458719+0000","last_active":"2024-04-12T19:39:18.584621+0000","last_peered":"2024-04-12T19:39:18.584621+0000","last_clean":"2024-04-12T19:39:18.584621+0000","last_became_active":"2024-04-12T19:39:11.457787+0000","last_became_peered":"2024-04-12T19:39:11.457787+0000","last_unstale":"2024-04-12T19:39:18.584621+0000","last_undegraded":"2024-04-12T19:39:18.584621+0000","last_fullsized":"2024-04-12T19:39:18.584621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.492948+0000","last_change":"2024-04-12T19:39:10.450200+0000","last_active":"2024-04-12T19:39:18.492948+0000","last_peered":"2024-04-12T19:39:18.492948+0000","last_clean":"2024-04-12T19:39:18.492948+0000","last_became_active":"2024-04-12T19:39:10.449871+0000","last_became_peered":"2024-04-12T19:39:10.449871+0000","last_unstale":"2024-04-12T19:39:18.492948+0000","last_undegraded":"2024-04-12T19:39:18.492948+0000","last_fullsized":"2024-04-12T19:39:18.492948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.586171+0000","last_change":"2024-04-12T19:39:16.134794+0000","last_active":"2024-04-12T19:39:18.586171+0000","last_peered":"2024-04-12T19:39:18.586171+0000","last_clean":"2024-04-12T19:39:18.586171+0000","last_became_active":"2024-04-12T19:39:16.131743+0000","last_became_peered":"2024-04-12T19:39:16.131743+0000","last_unstale":"2024-04-12T19:39:18.586171+0000","last_undegraded":"2024-04-12T19:39:18.586171+0000","last_fullsized":"2024-04-12T19:39:18.586171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:56:53.325064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488155+0000","last_change":"2024-04-12T19:39:11.474413+0000","last_active":"2024-04-12T19:39:17.488155+0000","last_peered":"2024-04-12T19:39:17.488155+0000","last_clean":"2024-04-12T19:39:17.488155+0000","last_became_active":"2024-04-12T19:39:11.473738+0000","last_became_peered":"2024-04-12T19:39:11.473738+0000","last_unstale":"2024-04-12T19:39:17.488155+0000","last_undegraded":"2024-04-12T19:39:17.488155+0000","last_fullsized":"2024-04-12T19:39:17.488155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:13:56.992995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492770+0000","last_change":"2024-04-12T19:39:10.426342+0000","last_active":"2024-04-12T19:39:17.492770+0000","last_peered":"2024-04-12T19:39:17.492770+0000","last_clean":"2024-04-12T19:39:17.492770+0000","last_became_active":"2024-04-12T19:39:10.426074+0000","last_became_peered":"2024-04-12T19:39:10.426074+0000","last_unstale":"2024-04-12T19:39:17.492770+0000","last_undegraded":"2024-04-12T19:39:17.492770+0000","last_fullsized":"2024-04-12T19:39:17.492770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:19:09.670101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493775+0000","last_change":"2024-04-12T19:39:06.612396+0000","last_active":"2024-04-12T19:39:18.493775+0000","last_peered":"2024-04-12T19:39:18.493775+0000","last_clean":"2024-04-12T19:39:18.493775+0000","last_became_active":"2024-04-12T19:39:06.610032+0000","last_became_peered":"2024-04-12T19:39:06.610032+0000","last_unstale":"2024-04-12T19:39:18.493775+0000","last_undegraded":"2024-04-12T19:39:18.493775+0000","last_fullsized":"2024-04-12T19:39:18.493775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:05.335186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:05.335186+0000","last_clean_scrub_stamp":"2024-04-12T19:39:05.335186+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:31:00.943120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174520+0000","last_change":"2024-04-12T19:39:16.129683+0000","last_active":"2024-04-12T19:39:18.174520+0000","last_peered":"2024-04-12T19:39:18.174520+0000","last_clean":"2024-04-12T19:39:18.174520+0000","last_became_active":"2024-04-12T19:39:16.128384+0000","last_became_peered":"2024-04-12T19:39:16.128384+0000","last_unstale":"2024-04-12T19:39:18.174520+0000","last_undegraded":"2024-04-12T19:39:18.174520+0000","last_fullsized":"2024-04-12T19:39:18.174520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:13.334480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494857+0000","last_change":"2024-04-12T19:39:11.464853+0000","last_active":"2024-04-12T19:39:18.494857+0000","last_peered":"2024-04-12T19:39:18.494857+0000","last_clean":"2024-04-12T19:39:18.494857+0000","last_became_active":"2024-04-12T19:39:11.464583+0000","last_became_peered":"2024-04-12T19:39:11.464583+0000","last_unstale":"2024-04-12T19:39:18.494857+0000","last_undegraded":"2024-04-12T19:39:18.494857+0000","last_fullsized":"2024-04-12T19:39:18.494857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:10:23.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962230+0000","last_change":"2024-04-12T19:39:10.437434+0000","last_active":"2024-04-12T19:39:18.962230+0000","last_peered":"2024-04-12T19:39:18.962230+0000","last_clean":"2024-04-12T19:39:18.962230+0000","last_became_active":"2024-04-12T19:39:10.437000+0000","last_became_peered":"2024-04-12T19:39:10.437000+0000","last_unstale":"2024-04-12T19:39:18.962230+0000","last_undegraded":"2024-04-12T19:39:18.962230+0000","last_fullsized":"2024-04-12T19:39:18.962230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:19:09.670101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175055+0000","last_change":"2024-04-12T19:39:16.122002+0000","last_active":"2024-04-12T19:39:18.175055+0000","last_peered":"2024-04-12T19:39:18.175055+0000","last_clean":"2024-04-12T19:39:18.175055+0000","last_became_active":"2024-04-12T19:39:16.120822+0000","last_became_peered":"2024-04-12T19:39:16.120822+0000","last_unstale":"2024-04-12T19:39:18.175055+0000","last_undegraded":"2024-04-12T19:39:18.175055+0000","last_fullsized":"2024-04-12T19:39:18.175055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:30.579330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.495013+0000","last_change":"2024-04-12T19:39:11.480018+0000","last_active":"2024-04-12T19:39:17.495013+0000","last_peered":"2024-04-12T19:39:17.495013+0000","last_clean":"2024-04-12T19:39:17.495013+0000","last_became_active":"2024-04-12T19:39:11.479672+0000","last_became_peered":"2024-04-12T19:39:11.479672+0000","last_unstale":"2024-04-12T19:39:17.495013+0000","last_undegraded":"2024-04-12T19:39:17.495013+0000","last_fullsized":"2024-04-12T19:39:17.495013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:09.267564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104503+0000","last_change":"2024-04-12T19:39:10.439233+0000","last_active":"2024-04-12T19:39:18.104503+0000","last_peered":"2024-04-12T19:39:18.104503+0000","last_clean":"2024-04-12T19:39:18.104503+0000","last_became_active":"2024-04-12T19:39:10.438816+0000","last_became_peered":"2024-04-12T19:39:10.438816+0000","last_unstale":"2024-04-12T19:39:18.104503+0000","last_undegraded":"2024-04-12T19:39:18.104503+0000","last_fullsized":"2024-04-12T19:39:18.104503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:15.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585297+0000","last_change":"2024-04-12T19:39:15.520784+0000","last_active":"2024-04-12T19:39:18.585297+0000","last_peered":"2024-04-12T19:39:18.585297+0000","last_clean":"2024-04-12T19:39:18.585297+0000","last_became_active":"2024-04-12T19:39:15.520270+0000","last_became_peered":"2024-04-12T19:39:15.520270+0000","last_unstale":"2024-04-12T19:39:18.585297+0000","last_undegraded":"2024-04-12T19:39:18.585297+0000","last_fullsized":"2024-04-12T19:39:18.585297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:45:30.872970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495368+0000","last_change":"2024-04-12T19:39:11.472989+0000","last_active":"2024-04-12T19:39:18.495368+0000","last_peered":"2024-04-12T19:39:18.495368+0000","last_clean":"2024-04-12T19:39:18.495368+0000","last_became_active":"2024-04-12T19:39:11.472677+0000","last_became_peered":"2024-04-12T19:39:11.472677+0000","last_unstale":"2024-04-12T19:39:18.495368+0000","last_undegraded":"2024-04-12T19:39:18.495368+0000","last_fullsized":"2024-04-12T19:39:18.495368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:37.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962266+0000","last_change":"2024-04-12T19:39:10.438486+0000","last_active":"2024-04-12T19:39:18.962266+0000","last_peered":"2024-04-12T19:39:18.962266+0000","last_clean":"2024-04-12T19:39:18.962266+0000","last_became_active":"2024-04-12T19:39:10.438219+0000","last_became_peered":"2024-04-12T19:39:10.438219+0000","last_unstale":"2024-04-12T19:39:18.962266+0000","last_undegraded":"2024-04-12T19:39:18.962266+0000","last_fullsized":"2024-04-12T19:39:18.962266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:11:49.476183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489727+0000","last_change":"2024-04-12T19:39:16.137131+0000","last_active":"2024-04-12T19:39:17.489727+0000","last_peered":"2024-04-12T19:39:17.489727+0000","last_clean":"2024-04-12T19:39:17.489727+0000","last_became_active":"2024-04-12T19:39:16.136171+0000","last_became_peered":"2024-04-12T19:39:16.136171+0000","last_unstale":"2024-04-12T19:39:17.489727+0000","last_undegraded":"2024-04-12T19:39:17.489727+0000","last_fullsized":"2024-04-12T19:39:17.489727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:56:53.325064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495120+0000","last_change":"2024-04-12T19:39:11.476364+0000","last_active":"2024-04-12T19:39:18.495120+0000","last_peered":"2024-04-12T19:39:18.495120+0000","last_clean":"2024-04-12T19:39:18.495120+0000","last_became_active":"2024-04-12T19:39:11.476024+0000","last_became_peered":"2024-04-12T19:39:11.476024+0000","last_unstale":"2024-04-12T19:39:18.495120+0000","last_undegraded":"2024-04-12T19:39:18.495120+0000","last_fullsized":"2024-04-12T19:39:18.495120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:45:10.487944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492470+0000","last_change":"2024-04-12T19:39:10.433299+0000","last_active":"2024-04-12T19:39:17.492470+0000","last_peered":"2024-04-12T19:39:17.492470+0000","last_clean":"2024-04-12T19:39:17.492470+0000","last_became_active":"2024-04-12T19:39:10.432858+0000","last_became_peered":"2024-04-12T19:39:10.432858+0000","last_unstale":"2024-04-12T19:39:17.492470+0000","last_undegraded":"2024-04-12T19:39:17.492470+0000","last_fullsized":"2024-04-12T19:39:17.492470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:00:24.899000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490231+0000","last_change":"2024-04-12T19:39:15.520112+0000","last_active":"2024-04-12T19:39:17.490231+0000","last_peered":"2024-04-12T19:39:17.490231+0000","last_clean":"2024-04-12T19:39:17.490231+0000","last_became_active":"2024-04-12T19:39:15.519631+0000","last_became_peered":"2024-04-12T19:39:15.519631+0000","last_unstale":"2024-04-12T19:39:17.490231+0000","last_undegraded":"2024-04-12T19:39:17.490231+0000","last_fullsized":"2024-04-12T19:39:17.490231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:45:14.554860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494051+0000","last_change":"2024-04-12T19:39:11.472849+0000","last_active":"2024-04-12T19:39:18.494051+0000","last_peered":"2024-04-12T19:39:18.494051+0000","last_clean":"2024-04-12T19:39:18.494051+0000","last_became_active":"2024-04-12T19:39:11.472506+0000","last_became_peered":"2024-04-12T19:39:11.472506+0000","last_unstale":"2024-04-12T19:39:18.494051+0000","last_undegraded":"2024-04-12T19:39:18.494051+0000","last_fullsized":"2024-04-12T19:39:18.494051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:21:53.745025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962167+0000","last_change":"2024-04-12T19:39:10.434547+0000","last_active":"2024-04-12T19:39:18.962167+0000","last_peered":"2024-04-12T19:39:18.962167+0000","last_clean":"2024-04-12T19:39:18.962167+0000","last_became_active":"2024-04-12T19:39:10.433054+0000","last_became_peered":"2024-04-12T19:39:10.433054+0000","last_unstale":"2024-04-12T19:39:18.962167+0000","last_undegraded":"2024-04-12T19:39:18.962167+0000","last_fullsized":"2024-04-12T19:39:18.962167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:35:32.075423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585816+0000","last_change":"2024-04-12T19:39:15.516082+0000","last_active":"2024-04-12T19:39:18.585816+0000","last_peered":"2024-04-12T19:39:18.585816+0000","last_clean":"2024-04-12T19:39:18.585816+0000","last_became_active":"2024-04-12T19:39:15.515321+0000","last_became_peered":"2024-04-12T19:39:15.515321+0000","last_unstale":"2024-04-12T19:39:18.585816+0000","last_undegraded":"2024-04-12T19:39:18.585816+0000","last_fullsized":"2024-04-12T19:39:18.585816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:12:45.261630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174564+0000","last_change":"2024-04-12T19:39:11.468548+0000","last_active":"2024-04-12T19:39:18.174564+0000","last_peered":"2024-04-12T19:39:18.174564+0000","last_clean":"2024-04-12T19:39:18.174564+0000","last_became_active":"2024-04-12T19:39:11.468141+0000","last_became_peered":"2024-04-12T19:39:11.468141+0000","last_unstale":"2024-04-12T19:39:18.174564+0000","last_undegraded":"2024-04-12T19:39:18.174564+0000","last_fullsized":"2024-04-12T19:39:18.174564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174038+0000","last_change":"2024-04-12T19:39:10.444137+0000","last_active":"2024-04-12T19:39:18.174038+0000","last_peered":"2024-04-12T19:39:18.174038+0000","last_clean":"2024-04-12T19:39:18.174038+0000","last_became_active":"2024-04-12T19:39:10.442731+0000","last_became_peered":"2024-04-12T19:39:10.442731+0000","last_unstale":"2024-04-12T19:39:18.174038+0000","last_undegraded":"2024-04-12T19:39:18.174038+0000","last_fullsized":"2024-04-12T19:39:18.174038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:19:09.670101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489001+0000","last_change":"2024-04-12T19:39:16.126978+0000","last_active":"2024-04-12T19:39:17.489001+0000","last_peered":"2024-04-12T19:39:17.489001+0000","last_clean":"2024-04-12T19:39:17.489001+0000","last_became_active":"2024-04-12T19:39:16.125687+0000","last_became_peered":"2024-04-12T19:39:16.125687+0000","last_unstale":"2024-04-12T19:39:17.489001+0000","last_undegraded":"2024-04-12T19:39:17.489001+0000","last_fullsized":"2024-04-12T19:39:17.489001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:07:45.787032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493681+0000","last_change":"2024-04-12T19:39:11.478082+0000","last_active":"2024-04-12T19:39:18.493681+0000","last_peered":"2024-04-12T19:39:18.493681+0000","last_clean":"2024-04-12T19:39:18.493681+0000","last_became_active":"2024-04-12T19:39:11.471563+0000","last_became_peered":"2024-04-12T19:39:11.471563+0000","last_unstale":"2024-04-12T19:39:18.493681+0000","last_undegraded":"2024-04-12T19:39:18.493681+0000","last_fullsized":"2024-04-12T19:39:18.493681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:05:52.600930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491596+0000","last_change":"2024-04-12T19:39:10.443036+0000","last_active":"2024-04-12T19:39:17.491596+0000","last_peered":"2024-04-12T19:39:17.491596+0000","last_clean":"2024-04-12T19:39:17.491596+0000","last_became_active":"2024-04-12T19:39:10.442763+0000","last_became_peered":"2024-04-12T19:39:10.442763+0000","last_unstale":"2024-04-12T19:39:17.491596+0000","last_undegraded":"2024-04-12T19:39:17.491596+0000","last_fullsized":"2024-04-12T19:39:17.491596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488661+0000","last_change":"2024-04-12T19:39:16.123073+0000","last_active":"2024-04-12T19:39:17.488661+0000","last_peered":"2024-04-12T19:39:17.488661+0000","last_clean":"2024-04-12T19:39:17.488661+0000","last_became_active":"2024-04-12T19:39:16.120993+0000","last_became_peered":"2024-04-12T19:39:16.120993+0000","last_unstale":"2024-04-12T19:39:17.488661+0000","last_undegraded":"2024-04-12T19:39:17.488661+0000","last_fullsized":"2024-04-12T19:39:17.488661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:44:14.241958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585081+0000","last_change":"2024-04-12T19:39:11.466277+0000","last_active":"2024-04-12T19:39:18.585081+0000","last_peered":"2024-04-12T19:39:18.585081+0000","last_clean":"2024-04-12T19:39:18.585081+0000","last_became_active":"2024-04-12T19:39:11.465998+0000","last_became_peered":"2024-04-12T19:39:11.465998+0000","last_unstale":"2024-04-12T19:39:18.585081+0000","last_undegraded":"2024-04-12T19:39:18.585081+0000","last_fullsized":"2024-04-12T19:39:18.585081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.583818+0000","last_change":"2024-04-12T19:39:10.430339+0000","last_active":"2024-04-12T19:39:18.583818+0000","last_peered":"2024-04-12T19:39:18.583818+0000","last_clean":"2024-04-12T19:39:18.583818+0000","last_became_active":"2024-04-12T19:39:10.430059+0000","last_became_peered":"2024-04-12T19:39:10.430059+0000","last_unstale":"2024-04-12T19:39:18.583818+0000","last_undegraded":"2024-04-12T19:39:18.583818+0000","last_fullsized":"2024-04-12T19:39:18.583818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:59:25.400930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493660+0000","last_change":"2024-04-12T19:39:16.129872+0000","last_active":"2024-04-12T19:39:17.493660+0000","last_peered":"2024-04-12T19:39:17.493660+0000","last_clean":"2024-04-12T19:39:17.493660+0000","last_became_active":"2024-04-12T19:39:16.127095+0000","last_became_peered":"2024-04-12T19:39:16.127095+0000","last_unstale":"2024-04-12T19:39:17.493660+0000","last_undegraded":"2024-04-12T19:39:17.493660+0000","last_fullsized":"2024-04-12T19:39:17.493660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:27:00.174133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494610+0000","last_change":"2024-04-12T19:39:11.479072+0000","last_active":"2024-04-12T19:39:18.494610+0000","last_peered":"2024-04-12T19:39:18.494610+0000","last_clean":"2024-04-12T19:39:18.494610+0000","last_became_active":"2024-04-12T19:39:11.478779+0000","last_became_peered":"2024-04-12T19:39:11.478779+0000","last_unstale":"2024-04-12T19:39:18.494610+0000","last_undegraded":"2024-04-12T19:39:18.494610+0000","last_fullsized":"2024-04-12T19:39:18.494610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:29.380470+0000","last_change":"2024-04-12T19:39:10.443760+0000","last_active":"2024-04-12T19:39:29.380470+0000","last_peered":"2024-04-12T19:39:29.380470+0000","last_clean":"2024-04-12T19:39:29.380470+0000","last_became_active":"2024-04-12T19:39:10.443031+0000","last_became_peered":"2024-04-12T19:39:10.443031+0000","last_unstale":"2024-04-12T19:39:29.380470+0000","last_undegraded":"2024-04-12T19:39:29.380470+0000","last_fullsized":"2024-04-12T19:39:29.380470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103735+0000","last_change":"2024-04-12T19:39:15.521287+0000","last_active":"2024-04-12T19:39:18.103735+0000","last_peered":"2024-04-12T19:39:18.103735+0000","last_clean":"2024-04-12T19:39:18.103735+0000","last_became_active":"2024-04-12T19:39:15.519545+0000","last_became_peered":"2024-04-12T19:39:15.519545+0000","last_unstale":"2024-04-12T19:39:18.103735+0000","last_undegraded":"2024-04-12T19:39:18.103735+0000","last_fullsized":"2024-04-12T19:39:18.103735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:02:18.119234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491496+0000","last_change":"2024-04-12T19:39:11.467693+0000","last_active":"2024-04-12T19:39:17.491496+0000","last_peered":"2024-04-12T19:39:17.491496+0000","last_clean":"2024-04-12T19:39:17.491496+0000","last_became_active":"2024-04-12T19:39:11.467283+0000","last_became_peered":"2024-04-12T19:39:11.467283+0000","last_unstale":"2024-04-12T19:39:17.491496+0000","last_undegraded":"2024-04-12T19:39:17.491496+0000","last_fullsized":"2024-04-12T19:39:17.491496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:52.447954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104456+0000","last_change":"2024-04-12T19:39:10.440386+0000","last_active":"2024-04-12T19:39:18.104456+0000","last_peered":"2024-04-12T19:39:18.104456+0000","last_clean":"2024-04-12T19:39:18.104456+0000","last_became_active":"2024-04-12T19:39:10.439567+0000","last_became_peered":"2024-04-12T19:39:10.439567+0000","last_unstale":"2024-04-12T19:39:18.104456+0000","last_undegraded":"2024-04-12T19:39:18.104456+0000","last_fullsized":"2024-04-12T19:39:18.104456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:51.431359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493139+0000","last_change":"2024-04-12T19:39:15.511609+0000","last_active":"2024-04-12T19:39:17.493139+0000","last_peered":"2024-04-12T19:39:17.493139+0000","last_clean":"2024-04-12T19:39:17.493139+0000","last_became_active":"2024-04-12T19:39:15.511178+0000","last_became_peered":"2024-04-12T19:39:15.511178+0000","last_unstale":"2024-04-12T19:39:17.493139+0000","last_undegraded":"2024-04-12T19:39:17.493139+0000","last_fullsized":"2024-04-12T19:39:17.493139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:12:45.261630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585669+0000","last_change":"2024-04-12T19:39:11.468760+0000","last_active":"2024-04-12T19:39:18.585669+0000","last_peered":"2024-04-12T19:39:18.585669+0000","last_clean":"2024-04-12T19:39:18.585669+0000","last_became_active":"2024-04-12T19:39:11.468126+0000","last_became_peered":"2024-04-12T19:39:11.468126+0000","last_unstale":"2024-04-12T19:39:18.585669+0000","last_undegraded":"2024-04-12T19:39:18.585669+0000","last_fullsized":"2024-04-12T19:39:18.585669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:18:45.626616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493459+0000","last_change":"2024-04-12T19:39:10.440768+0000","last_active":"2024-04-12T19:39:17.493459+0000","last_peered":"2024-04-12T19:39:17.493459+0000","last_clean":"2024-04-12T19:39:17.493459+0000","last_became_active":"2024-04-12T19:39:10.440480+0000","last_became_peered":"2024-04-12T19:39:10.440480+0000","last_unstale":"2024-04-12T19:39:17.493459+0000","last_undegraded":"2024-04-12T19:39:17.493459+0000","last_fullsized":"2024-04-12T19:39:17.493459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:51.431359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487735+0000","last_change":"2024-04-12T19:39:15.509729+0000","last_active":"2024-04-12T19:39:17.487735+0000","last_peered":"2024-04-12T19:39:17.487735+0000","last_clean":"2024-04-12T19:39:17.487735+0000","last_became_active":"2024-04-12T19:39:15.509283+0000","last_became_peered":"2024-04-12T19:39:15.509283+0000","last_unstale":"2024-04-12T19:39:17.487735+0000","last_undegraded":"2024-04-12T19:39:17.487735+0000","last_fullsized":"2024-04-12T19:39:17.487735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:26:05.519893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493270+0000","last_change":"2024-04-12T19:39:11.460136+0000","last_active":"2024-04-12T19:39:17.493270+0000","last_peered":"2024-04-12T19:39:17.493270+0000","last_clean":"2024-04-12T19:39:17.493270+0000","last_became_active":"2024-04-12T19:39:11.459732+0000","last_became_peered":"2024-04-12T19:39:11.459732+0000","last_unstale":"2024-04-12T19:39:17.493270+0000","last_undegraded":"2024-04-12T19:39:17.493270+0000","last_fullsized":"2024-04-12T19:39:17.493270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:40:00.108398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174891+0000","last_change":"2024-04-12T19:39:10.445173+0000","last_active":"2024-04-12T19:39:18.174891+0000","last_peered":"2024-04-12T19:39:18.174891+0000","last_clean":"2024-04-12T19:39:18.174891+0000","last_became_active":"2024-04-12T19:39:10.444515+0000","last_became_peered":"2024-04-12T19:39:10.444515+0000","last_unstale":"2024-04-12T19:39:18.174891+0000","last_undegraded":"2024-04-12T19:39:18.174891+0000","last_fullsized":"2024-04-12T19:39:18.174891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:11:49.476183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487760+0000","last_change":"2024-04-12T19:39:16.127728+0000","last_active":"2024-04-12T19:39:17.487760+0000","last_peered":"2024-04-12T19:39:17.487760+0000","last_clean":"2024-04-12T19:39:17.487760+0000","last_became_active":"2024-04-12T19:39:16.125486+0000","last_became_peered":"2024-04-12T19:39:16.125486+0000","last_unstale":"2024-04-12T19:39:17.487760+0000","last_undegraded":"2024-04-12T19:39:17.487760+0000","last_fullsized":"2024-04-12T19:39:17.487760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:28:14.853197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585755+0000","last_change":"2024-04-12T19:39:16.133052+0000","last_active":"2024-04-12T19:39:18.585755+0000","last_peered":"2024-04-12T19:39:18.585755+0000","last_clean":"2024-04-12T19:39:18.585755+0000","last_became_active":"2024-04-12T19:39:16.130388+0000","last_became_peered":"2024-04-12T19:39:16.130388+0000","last_unstale":"2024-04-12T19:39:18.585755+0000","last_undegraded":"2024-04-12T19:39:18.585755+0000","last_fullsized":"2024-04-12T19:39:18.585755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:02:18.119234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103422+0000","last_change":"2024-04-12T19:39:11.461191+0000","last_active":"2024-04-12T19:39:18.103422+0000","last_peered":"2024-04-12T19:39:18.103422+0000","last_clean":"2024-04-12T19:39:18.103422+0000","last_became_active":"2024-04-12T19:39:11.460841+0000","last_became_peered":"2024-04-12T19:39:11.460841+0000","last_unstale":"2024-04-12T19:39:18.103422+0000","last_undegraded":"2024-04-12T19:39:18.103422+0000","last_fullsized":"2024-04-12T19:39:18.103422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489885+0000","last_change":"2024-04-12T19:39:10.430054+0000","last_active":"2024-04-12T19:39:17.489885+0000","last_peered":"2024-04-12T19:39:17.489885+0000","last_clean":"2024-04-12T19:39:17.489885+0000","last_became_active":"2024-04-12T19:39:10.429693+0000","last_became_peered":"2024-04-12T19:39:10.429693+0000","last_unstale":"2024-04-12T19:39:17.489885+0000","last_undegraded":"2024-04-12T19:39:17.489885+0000","last_fullsized":"2024-04-12T19:39:17.489885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174774+0000","last_change":"2024-04-12T19:39:15.521261+0000","last_active":"2024-04-12T19:39:18.174774+0000","last_peered":"2024-04-12T19:39:18.174774+0000","last_clean":"2024-04-12T19:39:18.174774+0000","last_became_active":"2024-04-12T19:39:15.520618+0000","last_became_peered":"2024-04-12T19:39:15.520618+0000","last_unstale":"2024-04-12T19:39:18.174774+0000","last_undegraded":"2024-04-12T19:39:18.174774+0000","last_fullsized":"2024-04-12T19:39:18.174774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:41.709345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487629+0000","last_change":"2024-04-12T19:39:11.470231+0000","last_active":"2024-04-12T19:39:17.487629+0000","last_peered":"2024-04-12T19:39:17.487629+0000","last_clean":"2024-04-12T19:39:17.487629+0000","last_became_active":"2024-04-12T19:39:11.469814+0000","last_became_peered":"2024-04-12T19:39:11.469814+0000","last_unstale":"2024-04-12T19:39:17.487629+0000","last_undegraded":"2024-04-12T19:39:17.487629+0000","last_fullsized":"2024-04-12T19:39:17.487629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488012+0000","last_change":"2024-04-12T19:39:10.441115+0000","last_active":"2024-04-12T19:39:17.488012+0000","last_peered":"2024-04-12T19:39:17.488012+0000","last_clean":"2024-04-12T19:39:17.488012+0000","last_became_active":"2024-04-12T19:39:10.440755+0000","last_became_peered":"2024-04-12T19:39:10.440755+0000","last_unstale":"2024-04-12T19:39:17.488012+0000","last_undegraded":"2024-04-12T19:39:17.488012+0000","last_fullsized":"2024-04-12T19:39:17.488012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:25:54.417979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174166+0000","last_change":"2024-04-12T19:39:10.441520+0000","last_active":"2024-04-12T19:39:18.174166+0000","last_peered":"2024-04-12T19:39:18.174166+0000","last_clean":"2024-04-12T19:39:18.174166+0000","last_became_active":"2024-04-12T19:39:10.441219+0000","last_became_peered":"2024-04-12T19:39:10.441219+0000","last_unstale":"2024-04-12T19:39:18.174166+0000","last_undegraded":"2024-04-12T19:39:18.174166+0000","last_fullsized":"2024-04-12T19:39:18.174166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585328+0000","last_change":"2024-04-12T19:39:11.460915+0000","last_active":"2024-04-12T19:39:18.585328+0000","last_peered":"2024-04-12T19:39:18.585328+0000","last_clean":"2024-04-12T19:39:18.585328+0000","last_became_active":"2024-04-12T19:39:11.460672+0000","last_became_peered":"2024-04-12T19:39:11.460672+0000","last_unstale":"2024-04-12T19:39:18.585328+0000","last_undegraded":"2024-04-12T19:39:18.585328+0000","last_fullsized":"2024-04-12T19:39:18.585328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:10:44.776087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.963253+0000","last_change":"2024-04-12T19:39:15.512665+0000","last_active":"2024-04-12T19:39:18.963253+0000","last_peered":"2024-04-12T19:39:18.963253+0000","last_clean":"2024-04-12T19:39:18.963253+0000","last_became_active":"2024-04-12T19:39:15.512224+0000","last_became_peered":"2024-04-12T19:39:15.512224+0000","last_unstale":"2024-04-12T19:39:18.963253+0000","last_undegraded":"2024-04-12T19:39:18.963253+0000","last_fullsized":"2024-04-12T19:39:18.963253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:18:49.693531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488497+0000","last_change":"2024-04-12T19:39:10.446078+0000","last_active":"2024-04-12T19:39:17.488497+0000","last_peered":"2024-04-12T19:39:17.488497+0000","last_clean":"2024-04-12T19:39:17.488497+0000","last_became_active":"2024-04-12T19:39:10.445778+0000","last_became_peered":"2024-04-12T19:39:10.445778+0000","last_unstale":"2024-04-12T19:39:17.488497+0000","last_undegraded":"2024-04-12T19:39:17.488497+0000","last_fullsized":"2024-04-12T19:39:17.488497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:59:25.400930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492269+0000","last_change":"2024-04-12T19:39:11.455047+0000","last_active":"2024-04-12T19:39:17.492269+0000","last_peered":"2024-04-12T19:39:17.492269+0000","last_clean":"2024-04-12T19:39:17.492269+0000","last_became_active":"2024-04-12T19:39:11.454646+0000","last_became_peered":"2024-04-12T19:39:11.454646+0000","last_unstale":"2024-04-12T19:39:17.492269+0000","last_undegraded":"2024-04-12T19:39:17.492269+0000","last_fullsized":"2024-04-12T19:39:17.492269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:52.478867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488924+0000","last_change":"2024-04-12T19:39:15.513691+0000","last_active":"2024-04-12T19:39:17.488924+0000","last_peered":"2024-04-12T19:39:17.488924+0000","last_clean":"2024-04-12T19:39:17.488924+0000","last_became_active":"2024-04-12T19:39:15.513269+0000","last_became_peered":"2024-04-12T19:39:15.513269+0000","last_unstale":"2024-04-12T19:39:17.488924+0000","last_undegraded":"2024-04-12T19:39:17.488924+0000","last_fullsized":"2024-04-12T19:39:17.488924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:40:26.732234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.173537+0000","last_change":"2024-04-12T19:39:11.468368+0000","last_active":"2024-04-12T19:39:18.173537+0000","last_peered":"2024-04-12T19:39:18.173537+0000","last_clean":"2024-04-12T19:39:18.173537+0000","last_became_active":"2024-04-12T19:39:11.467807+0000","last_became_peered":"2024-04-12T19:39:11.467807+0000","last_unstale":"2024-04-12T19:39:18.173537+0000","last_undegraded":"2024-04-12T19:39:18.173537+0000","last_fullsized":"2024-04-12T19:39:18.173537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:55:09.781797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962714+0000","last_change":"2024-04-12T19:39:11.464628+0000","last_active":"2024-04-12T19:39:18.962714+0000","last_peered":"2024-04-12T19:39:18.962714+0000","last_clean":"2024-04-12T19:39:18.962714+0000","last_became_active":"2024-04-12T19:39:11.464333+0000","last_became_peered":"2024-04-12T19:39:11.464333+0000","last_unstale":"2024-04-12T19:39:18.962714+0000","last_undegraded":"2024-04-12T19:39:18.962714+0000","last_fullsized":"2024-04-12T19:39:18.962714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:52.447954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491395+0000","last_change":"2024-04-12T19:39:11.480027+0000","last_active":"2024-04-12T19:39:17.491395+0000","last_peered":"2024-04-12T19:39:17.491395+0000","last_clean":"2024-04-12T19:39:17.491395+0000","last_became_active":"2024-04-12T19:39:11.479816+0000","last_became_peered":"2024-04-12T19:39:11.479816+0000","last_unstale":"2024-04-12T19:39:17.491395+0000","last_undegraded":"2024-04-12T19:39:17.491395+0000","last_fullsized":"2024-04-12T19:39:17.491395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:45:10.487944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585208+0000","last_change":"2024-04-12T19:39:11.475058+0000","last_active":"2024-04-12T19:39:18.585208+0000","last_peered":"2024-04-12T19:39:18.585208+0000","last_clean":"2024-04-12T19:39:18.585208+0000","last_became_active":"2024-04-12T19:39:11.474706+0000","last_became_peered":"2024-04-12T19:39:11.474706+0000","last_unstale":"2024-04-12T19:39:18.585208+0000","last_undegraded":"2024-04-12T19:39:18.585208+0000","last_fullsized":"2024-04-12T19:39:18.585208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:55:09.781797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488726+0000","last_change":"2024-04-12T19:39:11.476138+0000","last_active":"2024-04-12T19:39:17.488726+0000","last_peered":"2024-04-12T19:39:17.488726+0000","last_clean":"2024-04-12T19:39:17.488726+0000","last_became_active":"2024-04-12T19:39:11.473857+0000","last_became_peered":"2024-04-12T19:39:11.473857+0000","last_unstale":"2024-04-12T19:39:17.488726+0000","last_undegraded":"2024-04-12T19:39:17.488726+0000","last_fullsized":"2024-04-12T19:39:17.488726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:40:00.108398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104371+0000","last_change":"2024-04-12T19:39:11.471824+0000","last_active":"2024-04-12T19:39:18.104371+0000","last_peered":"2024-04-12T19:39:18.104371+0000","last_clean":"2024-04-12T19:39:18.104371+0000","last_became_active":"2024-04-12T19:39:11.471316+0000","last_became_peered":"2024-04-12T19:39:11.471316+0000","last_unstale":"2024-04-12T19:39:18.104371+0000","last_undegraded":"2024-04-12T19:39:18.104371+0000","last_fullsized":"2024-04-12T19:39:18.104371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175088+0000","last_change":"2024-04-12T19:39:11.477664+0000","last_active":"2024-04-12T19:39:18.175088+0000","last_peered":"2024-04-12T19:39:18.175088+0000","last_clean":"2024-04-12T19:39:18.175088+0000","last_became_active":"2024-04-12T19:39:11.477400+0000","last_became_peered":"2024-04-12T19:39:11.477400+0000","last_unstale":"2024-04-12T19:39:18.175088+0000","last_undegraded":"2024-04-12T19:39:18.175088+0000","last_fullsized":"2024-04-12T19:39:18.175088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489032+0000","last_change":"2024-04-12T19:39:11.473661+0000","last_active":"2024-04-12T19:39:17.489032+0000","last_peered":"2024-04-12T19:39:17.489032+0000","last_clean":"2024-04-12T19:39:17.489032+0000","last_became_active":"2024-04-12T19:39:11.473335+0000","last_became_peered":"2024-04-12T19:39:11.473335+0000","last_unstale":"2024-04-12T19:39:17.489032+0000","last_undegraded":"2024-04-12T19:39:17.489032+0000","last_fullsized":"2024-04-12T19:39:17.489032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489785+0000","last_change":"2024-04-12T19:39:11.480192+0000","last_active":"2024-04-12T19:39:17.489785+0000","last_peered":"2024-04-12T19:39:17.489785+0000","last_clean":"2024-04-12T19:39:17.489785+0000","last_became_active":"2024-04-12T19:39:11.479845+0000","last_became_peered":"2024-04-12T19:39:11.479845+0000","last_unstale":"2024-04-12T19:39:17.489785+0000","last_undegraded":"2024-04-12T19:39:17.489785+0000","last_fullsized":"2024-04-12T19:39:17.489785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487952+0000","last_change":"2024-04-12T19:39:11.459940+0000","last_active":"2024-04-12T19:39:17.487952+0000","last_peered":"2024-04-12T19:39:17.487952+0000","last_clean":"2024-04-12T19:39:17.487952+0000","last_became_active":"2024-04-12T19:39:11.459403+0000","last_became_peered":"2024-04-12T19:39:11.459403+0000","last_unstale":"2024-04-12T19:39:17.487952+0000","last_undegraded":"2024-04-12T19:39:17.487952+0000","last_fullsized":"2024-04-12T19:39:17.487952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:55:09.781797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491159+0000","last_change":"2024-04-12T19:39:11.457187+0000","last_active":"2024-04-12T19:39:17.491159+0000","last_peered":"2024-04-12T19:39:17.491159+0000","last_clean":"2024-04-12T19:39:17.491159+0000","last_became_active":"2024-04-12T19:39:11.456859+0000","last_became_peered":"2024-04-12T19:39:11.456859+0000","last_unstale":"2024-04-12T19:39:17.491159+0000","last_undegraded":"2024-04-12T19:39:17.491159+0000","last_fullsized":"2024-04-12T19:39:17.491159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:05:52.600930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585047+0000","last_change":"2024-04-12T19:39:11.465043+0000","last_active":"2024-04-12T19:39:18.585047+0000","last_peered":"2024-04-12T19:39:18.585047+0000","last_clean":"2024-04-12T19:39:18.585047+0000","last_became_active":"2024-04-12T19:39:11.464724+0000","last_became_peered":"2024-04-12T19:39:11.464724+0000","last_unstale":"2024-04-12T19:39:18.585047+0000","last_undegraded":"2024-04-12T19:39:18.585047+0000","last_fullsized":"2024-04-12T19:39:18.585047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:20.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174218+0000","last_change":"2024-04-12T19:39:11.473208+0000","last_active":"2024-04-12T19:39:18.174218+0000","last_peered":"2024-04-12T19:39:18.174218+0000","last_clean":"2024-04-12T19:39:18.174218+0000","last_became_active":"2024-04-12T19:39:11.472752+0000","last_became_peered":"2024-04-12T19:39:11.472752+0000","last_unstale":"2024-04-12T19:39:18.174218+0000","last_undegraded":"2024-04-12T19:39:18.174218+0000","last_fullsized":"2024-04-12T19:39:18.174218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:10:44.776087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495278+0000","last_change":"2024-04-12T19:39:11.461738+0000","last_active":"2024-04-12T19:39:18.495278+0000","last_peered":"2024-04-12T19:39:18.495278+0000","last_clean":"2024-04-12T19:39:18.495278+0000","last_became_active":"2024-04-12T19:39:11.461456+0000","last_became_peered":"2024-04-12T19:39:11.461456+0000","last_unstale":"2024-04-12T19:39:18.495278+0000","last_undegraded":"2024-04-12T19:39:18.495278+0000","last_fullsized":"2024-04-12T19:39:18.495278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:22:57.956770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.963582+0000","last_change":"2024-04-12T19:39:11.468295+0000","last_active":"2024-04-12T19:39:18.963582+0000","last_peered":"2024-04-12T19:39:18.963582+0000","last_clean":"2024-04-12T19:39:18.963582+0000","last_became_active":"2024-04-12T19:39:11.468002+0000","last_became_peered":"2024-04-12T19:39:11.468002+0000","last_unstale":"2024-04-12T19:39:18.963582+0000","last_undegraded":"2024-04-12T19:39:18.963582+0000","last_fullsized":"2024-04-12T19:39:18.963582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:16.676989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.494704+0000","last_change":"2024-04-12T19:39:11.457117+0000","last_active":"2024-04-12T19:39:17.494704+0000","last_peered":"2024-04-12T19:39:17.494704+0000","last_clean":"2024-04-12T19:39:17.494704+0000","last_became_active":"2024-04-12T19:39:11.456714+0000","last_became_peered":"2024-04-12T19:39:11.456714+0000","last_unstale":"2024-04-12T19:39:17.494704+0000","last_undegraded":"2024-04-12T19:39:17.494704+0000","last_fullsized":"2024-04-12T19:39:17.494704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:22:57.956770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489510+0000","last_change":"2024-04-12T19:39:11.456585+0000","last_active":"2024-04-12T19:39:17.489510+0000","last_peered":"2024-04-12T19:39:17.489510+0000","last_clean":"2024-04-12T19:39:17.489510+0000","last_became_active":"2024-04-12T19:39:11.453931+0000","last_became_peered":"2024-04-12T19:39:11.453931+0000","last_unstale":"2024-04-12T19:39:17.489510+0000","last_undegraded":"2024-04-12T19:39:17.489510+0000","last_fullsized":"2024-04-12T19:39:17.489510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103665+0000","last_change":"2024-04-12T19:39:11.445513+0000","last_active":"2024-04-12T19:39:18.103665+0000","last_peered":"2024-04-12T19:39:18.103665+0000","last_clean":"2024-04-12T19:39:18.103665+0000","last_became_active":"2024-04-12T19:39:11.445149+0000","last_became_peered":"2024-04-12T19:39:11.445149+0000","last_unstale":"2024-04-12T19:39:18.103665+0000","last_undegraded":"2024-04-12T19:39:18.103665+0000","last_fullsized":"2024-04-12T19:39:18.103665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585076+0000","last_change":"2024-04-12T19:39:11.457130+0000","last_active":"2024-04-12T19:39:18.585076+0000","last_peered":"2024-04-12T19:39:18.585076+0000","last_clean":"2024-04-12T19:39:18.585076+0000","last_became_active":"2024-04-12T19:39:11.456787+0000","last_became_peered":"2024-04-12T19:39:11.456787+0000","last_unstale":"2024-04-12T19:39:18.585076+0000","last_undegraded":"2024-04-12T19:39:18.585076+0000","last_fullsized":"2024-04-12T19:39:18.585076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488357+0000","last_change":"2024-04-12T19:39:11.474356+0000","last_active":"2024-04-12T19:39:17.488357+0000","last_peered":"2024-04-12T19:39:17.488357+0000","last_clean":"2024-04-12T19:39:17.488357+0000","last_became_active":"2024-04-12T19:39:11.474021+0000","last_became_peered":"2024-04-12T19:39:11.474021+0000","last_unstale":"2024-04-12T19:39:17.488357+0000","last_undegraded":"2024-04-12T19:39:17.488357+0000","last_fullsized":"2024-04-12T19:39:17.488357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491247+0000","last_change":"2024-04-12T19:39:11.472738+0000","last_active":"2024-04-12T19:39:17.491247+0000","last_peered":"2024-04-12T19:39:17.491247+0000","last_clean":"2024-04-12T19:39:17.491247+0000","last_became_active":"2024-04-12T19:39:11.472424+0000","last_became_peered":"2024-04-12T19:39:11.472424+0000","last_unstale":"2024-04-12T19:39:17.491247+0000","last_undegraded":"2024-04-12T19:39:17.491247+0000","last_fullsized":"2024-04-12T19:39:17.491247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:32.845169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174515+0000","last_change":"2024-04-12T19:39:11.468484+0000","last_active":"2024-04-12T19:39:18.174515+0000","last_peered":"2024-04-12T19:39:18.174515+0000","last_clean":"2024-04-12T19:39:18.174515+0000","last_became_active":"2024-04-12T19:39:11.468078+0000","last_became_peered":"2024-04-12T19:39:11.468078+0000","last_unstale":"2024-04-12T19:39:18.174515+0000","last_undegraded":"2024-04-12T19:39:18.174515+0000","last_fullsized":"2024-04-12T19:39:18.174515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175012+0000","last_change":"2024-04-12T19:39:11.470836+0000","last_active":"2024-04-12T19:39:18.175012+0000","last_peered":"2024-04-12T19:39:18.175012+0000","last_clean":"2024-04-12T19:39:18.175012+0000","last_became_active":"2024-04-12T19:39:11.470569+0000","last_became_peered":"2024-04-12T19:39:11.470569+0000","last_unstale":"2024-04-12T19:39:18.175012+0000","last_undegraded":"2024-04-12T19:39:18.175012+0000","last_fullsized":"2024-04-12T19:39:18.175012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495253+0000","last_change":"2024-04-12T19:39:11.479266+0000","last_active":"2024-04-12T19:39:18.495253+0000","last_peered":"2024-04-12T19:39:18.495253+0000","last_clean":"2024-04-12T19:39:18.495253+0000","last_became_active":"2024-04-12T19:39:11.479025+0000","last_became_peered":"2024-04-12T19:39:11.479025+0000","last_unstale":"2024-04-12T19:39:18.495253+0000","last_undegraded":"2024-04-12T19:39:18.495253+0000","last_fullsized":"2024-04-12T19:39:18.495253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:26.512414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487468+0000","last_change":"2024-04-12T19:39:11.477102+0000","last_active":"2024-04-12T19:39:17.487468+0000","last_peered":"2024-04-12T19:39:17.487468+0000","last_clean":"2024-04-12T19:39:17.487468+0000","last_became_active":"2024-04-12T19:39:11.476734+0000","last_became_peered":"2024-04-12T19:39:11.476734+0000","last_unstale":"2024-04-12T19:39:17.487468+0000","last_undegraded":"2024-04-12T19:39:17.487468+0000","last_fullsized":"2024-04-12T19:39:17.487468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:10:44.776087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493741+0000","last_change":"2024-04-12T19:39:11.457154+0000","last_active":"2024-04-12T19:39:18.493741+0000","last_peered":"2024-04-12T19:39:18.493741+0000","last_clean":"2024-04-12T19:39:18.493741+0000","last_became_active":"2024-04-12T19:39:11.456829+0000","last_became_peered":"2024-04-12T19:39:11.456829+0000","last_unstale":"2024-04-12T19:39:18.493741+0000","last_undegraded":"2024-04-12T19:39:18.493741+0000","last_fullsized":"2024-04-12T19:39:18.493741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:40:00.108398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490869+0000","last_change":"2024-04-12T19:39:11.457995+0000","last_active":"2024-04-12T19:39:17.490869+0000","last_peered":"2024-04-12T19:39:17.490869+0000","last_clean":"2024-04-12T19:39:17.490869+0000","last_became_active":"2024-04-12T19:39:11.457611+0000","last_became_peered":"2024-04-12T19:39:11.457611+0000","last_unstale":"2024-04-12T19:39:17.490869+0000","last_undegraded":"2024-04-12T19:39:17.490869+0000","last_fullsized":"2024-04-12T19:39:17.490869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:10:23.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493427+0000","last_change":"2024-04-12T19:39:11.458277+0000","last_active":"2024-04-12T19:39:18.493427+0000","last_peered":"2024-04-12T19:39:18.493427+0000","last_clean":"2024-04-12T19:39:18.493427+0000","last_became_active":"2024-04-12T19:39:11.457957+0000","last_became_peered":"2024-04-12T19:39:11.457957+0000","last_unstale":"2024-04-12T19:39:18.493427+0000","last_undegraded":"2024-04-12T19:39:18.493427+0000","last_fullsized":"2024-04-12T19:39:18.493427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:13:56.992995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493124+0000","last_change":"2024-04-12T19:39:11.479162+0000","last_active":"2024-04-12T19:39:17.493124+0000","last_peered":"2024-04-12T19:39:17.493124+0000","last_clean":"2024-04-12T19:39:17.493124+0000","last_became_active":"2024-04-12T19:39:11.478748+0000","last_became_peered":"2024-04-12T19:39:11.478748+0000","last_unstale":"2024-04-12T19:39:17.493124+0000","last_undegraded":"2024-04-12T19:39:17.493124+0000","last_fullsized":"2024-04-12T19:39:17.493124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:13:56.992995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585351+0000","last_change":"2024-04-12T19:39:11.459392+0000","last_active":"2024-04-12T19:39:18.585351+0000","last_peered":"2024-04-12T19:39:18.585351+0000","last_clean":"2024-04-12T19:39:18.585351+0000","last_became_active":"2024-04-12T19:39:11.459080+0000","last_became_peered":"2024-04-12T19:39:11.459080+0000","last_unstale":"2024-04-12T19:39:18.585351+0000","last_undegraded":"2024-04-12T19:39:18.585351+0000","last_fullsized":"2024-04-12T19:39:18.585351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104633+0000","last_change":"2024-04-12T19:39:11.455201+0000","last_active":"2024-04-12T19:39:18.104633+0000","last_peered":"2024-04-12T19:39:18.104633+0000","last_clean":"2024-04-12T19:39:18.104633+0000","last_became_active":"2024-04-12T19:39:11.454864+0000","last_became_peered":"2024-04-12T19:39:11.454864+0000","last_unstale":"2024-04-12T19:39:18.104633+0000","last_undegraded":"2024-04-12T19:39:18.104633+0000","last_fullsized":"2024-04-12T19:39:18.104633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494971+0000","last_change":"2024-04-12T19:39:11.477240+0000","last_active":"2024-04-12T19:39:18.494971+0000","last_peered":"2024-04-12T19:39:18.494971+0000","last_clean":"2024-04-12T19:39:18.494971+0000","last_became_active":"2024-04-12T19:39:11.476955+0000","last_became_peered":"2024-04-12T19:39:11.476955+0000","last_unstale":"2024-04-12T19:39:18.494971+0000","last_undegraded":"2024-04-12T19:39:18.494971+0000","last_fullsized":"2024-04-12T19:39:18.494971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:09.267564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":703014,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":115906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":112154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":112190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":115906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":112064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":112224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":703070,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-12T19:39:39.522 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-12T19:39:39.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.738+0000 7f6f25400640 1 Processor -- start 2024-04-12T19:39:39.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.738+0000 7f6f25400640 1 -- start start 2024-04-12T19:39:39.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.739+0000 7f6f25400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6f200be310 0x7f6f200735f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.739+0000 7f6f25400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f201484e0 0x7f6f20158950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.739+0000 7f6f25400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2006f770 con 0x7f6f20073b30 2024-04-12T19:39:39.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.739+0000 7f6f25400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6f2006f520 con 0x7f6f200be310 2024-04-12T19:39:39.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.739+0000 7f6f25400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6f20073f70 con 0x7f6f201484e0 2024-04-12T19:39:39.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.740+0000 7f6f1f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f201484e0 0x7f6f20158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.740+0000 7f6f1f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f201484e0 0x7f6f20158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:56706/0 (socket says 172.21.15.131:56706) 2024-04-12T19:39:39.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.740+0000 7f6f1f200640 1 -- 172.21.15.131:0/904799016 learned_addr learned my addr 172.21.15.131:0/904799016 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:39.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.740+0000 7f6f1e800640 1 --2- 172.21.15.131:0/904799016 >> v2:172.21.15.171:3300/0 conn(0x7f6f200be310 0x7f6f200735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.741+0000 7f6f1f200640 1 -- 172.21.15.131:0/904799016 >> v2:172.21.15.171:3300/0 conn(0x7f6f200be310 msgr2=0x7f6f200735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:39.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.741+0000 7f6f1f200640 1 --2- 172.21.15.131:0/904799016 >> v2:172.21.15.171:3300/0 conn(0x7f6f200be310 0x7f6f200735f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.741+0000 7f6f1f200640 1 -- 172.21.15.131:0/904799016 >> v1:172.21.15.171:6789/0 conn(0x7f6f20073b30 legacy=0x7f6f20147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.741+0000 7f6f1f200640 1 -- 172.21.15.131:0/904799016 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f200716c0 con 0x7f6f201484e0 2024-04-12T19:39:39.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.743+0000 7f6f1f200640 1 --2- 172.21.15.131:0/904799016 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f201484e0 0x7f6f20158950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009e50 tx=0x7f6f1802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f09d06d0e7e4b45c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:39.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.743+0000 7f6f1de00640 1 -- 172.21.15.131:0/904799016 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1802ca70 con 0x7f6f201484e0 2024-04-12T19:39:39.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.743+0000 7f6f1de00640 1 -- 172.21.15.131:0/904799016 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f1802cc10 con 0x7f6f201484e0 2024-04-12T19:39:39.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.743+0000 7f6f1de00640 1 -- 172.21.15.131:0/904799016 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f180343f0 con 0x7f6f201484e0 2024-04-12T19:39:39.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.744+0000 7f6f25400640 1 -- 172.21.15.131:0/904799016 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f201484e0 msgr2=0x7f6f20158950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.744+0000 7f6f25400640 1 --2- 172.21.15.131:0/904799016 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f201484e0 0x7f6f20158950 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f6f18009e50 tx=0x7f6f1802bed0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.744+0000 7f6f25400640 1 -- 172.21.15.131:0/904799016 shutdown_connections 2024-04-12T19:39:39.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.744+0000 7f6f25400640 1 --2- 172.21.15.131:0/904799016 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f201484e0 0x7f6f20158950 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.744+0000 7f6f25400640 1 --2- 172.21.15.131:0/904799016 >> v2:172.21.15.171:3300/0 conn(0x7f6f200be310 0x7f6f200735f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.744+0000 7f6f25400640 1 -- 172.21.15.131:0/904799016 >> 172.21.15.131:0/904799016 conn(0x7f6f200c2590 msgr2=0x7f6f200c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:39.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.744+0000 7f6f25400640 1 -- 172.21.15.131:0/904799016 shutdown_connections 2024-04-12T19:39:39.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.744+0000 7f6f25400640 1 -- 172.21.15.131:0/904799016 wait complete. 2024-04-12T19:39:39.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.746+0000 7f6f25400640 1 Processor -- start 2024-04-12T19:39:39.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.746+0000 7f6f25400640 1 -- start start 2024-04-12T19:39:39.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f25400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20073b30 0x7f6f20147070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f25400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f200be310 0x7f6f201d8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f25400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f201484e0 0x7f6f2014a990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f25400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6f2006d5a0 con 0x7f6f20073b30 2024-04-12T19:39:39.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f25400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6f20071c80 con 0x7f6f200be310 2024-04-12T19:39:39.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f25400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6f2006fa30 con 0x7f6f201484e0 2024-04-12T19:39:39.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f1e800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20073b30 0x7f6f20147070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f1e800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20073b30 0x7f6f20147070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:55314/0 (socket says 172.21.15.131:55314) 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f1e800640 1 -- 172.21.15.131:0/3162807676 learned_addr learned my addr 172.21.15.131:0/3162807676 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f1f200640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f201484e0 0x7f6f2014a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f17e00640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f200be310 0x7f6f201d8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f1e800640 1 -- 172.21.15.131:0/3162807676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f201484e0 msgr2=0x7f6f2014a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f1e800640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f201484e0 0x7f6f2014a990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f1e800640 1 -- 172.21.15.131:0/3162807676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f200be310 msgr2=0x7f6f201d8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f1e800640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f200be310 0x7f6f201d8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.747+0000 7f6f1e800640 1 -- 172.21.15.131:0/3162807676 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f201475b0 con 0x7f6f20073b30 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.748+0000 7f6f1e800640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20073b30 0x7f6f20147070 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000e8a0 tx=0x7f6f1000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.748+0000 7f6f16a00640 1 -- 172.21.15.131:0/3162807676 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f10017070 con 0x7f6f20073b30 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.748+0000 7f6f16a00640 1 -- 172.21.15.131:0/3162807676 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f1000c940 con 0x7f6f20073b30 2024-04-12T19:39:39.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.748+0000 7f6f16a00640 1 -- 172.21.15.131:0/3162807676 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1000cd30 con 0x7f6f20073b30 2024-04-12T19:39:39.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.748+0000 7f6f25400640 1 -- 172.21.15.131:0/3162807676 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f201ea6b0 con 0x7f6f20073b30 2024-04-12T19:39:39.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.748+0000 7f6f25400640 1 -- 172.21.15.131:0/3162807676 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f201ea950 con 0x7f6f20073b30 2024-04-12T19:39:39.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.749+0000 7f6f25400640 1 -- 172.21.15.131:0/3162807676 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f20072c50 con 0x7f6f20073b30 2024-04-12T19:39:39.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.750+0000 7f6f16a00640 1 -- 172.21.15.131:0/3162807676 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6f1001a070 con 0x7f6f20073b30 2024-04-12T19:39:39.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.751+0000 7f6f16a00640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6efc06c8f0 0x7f6efc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:39.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.751+0000 7f6f16a00640 1 -- 172.21.15.131:0/3162807676 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6f1008bd80 con 0x7f6f20073b30 2024-04-12T19:39:39.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.751+0000 7f6f17e00640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6efc06c8f0 0x7f6efc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:39.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.752+0000 7f6f17e00640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6efc06c8f0 0x7f6efc06edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f20144ff0 tx=0x7f6f08009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:39.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.756+0000 7f6f16a00640 1 -- 172.21.15.131:0/3162807676 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6f20072c50 con 0x7f6f20073b30 2024-04-12T19:39:39.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.944+0000 7f6f25400640 1 -- 172.21.15.131:0/3162807676 --> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6f200bffa0 con 0x7f6efc06c8f0 2024-04-12T19:39:39.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.961+0000 7f6f16a00640 1 -- 172.21.15.131:0/3162807676 <== mgr.4101 v2:172.21.15.131:6832/873500205 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332650 (secure 0 0 0) 0x7f6f200bffa0 con 0x7f6efc06c8f0 2024-04-12T19:39:39.965 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:39.967 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-12T19:39:39.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.966+0000 7f6f25400640 1 -- 172.21.15.131:0/3162807676 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6efc06c8f0 msgr2=0x7f6efc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.966+0000 7f6f25400640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6efc06c8f0 0x7f6efc06edb0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6f20144ff0 tx=0x7f6f08009040 comp rx=0 tx=0).stop 2024-04-12T19:39:39.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.967+0000 7f6f25400640 1 -- 172.21.15.131:0/3162807676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20073b30 msgr2=0x7f6f20147070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:39.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.967+0000 7f6f25400640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20073b30 0x7f6f20147070 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6f1000e8a0 tx=0x7f6f1000ed60 comp rx=0 tx=0).stop 2024-04-12T19:39:39.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.967+0000 7f6f25400640 1 -- 172.21.15.131:0/3162807676 shutdown_connections 2024-04-12T19:39:39.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.967+0000 7f6f25400640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6efc06c8f0 0x7f6efc06edb0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.967+0000 7f6f25400640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6f200be310 0x7f6f201d8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.967+0000 7f6f25400640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6f201484e0 0x7f6f2014a990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.967+0000 7f6f25400640 1 --2- 172.21.15.131:0/3162807676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6f20073b30 0x7f6f20147070 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:39.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.967+0000 7f6f25400640 1 -- 172.21.15.131:0/3162807676 >> 172.21.15.131:0/3162807676 conn(0x7f6f200c2590 msgr2=0x7f6f2014e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:39.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.967+0000 7f6f25400640 1 -- 172.21.15.131:0/3162807676 shutdown_connections 2024-04-12T19:39:39.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:39.967+0000 7f6f25400640 1 -- 172.21.15.131:0/3162807676 wait complete. 2024-04-12T19:39:39.984 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":37,"stamp":"2024-04-12T19:39:38.828538+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218532,"kb_used_data":2368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756188,"statfs":{"total":773094113280,"available":772870336512,"internally_reserved":0,"allocated":2424832,"data_stored":2086528,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004787"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585758+0000","last_change":"2024-04-12T19:39:10.436376+0000","last_active":"2024-04-12T19:39:18.585758+0000","last_peered":"2024-04-12T19:39:18.585758+0000","last_clean":"2024-04-12T19:39:18.585758+0000","last_became_active":"2024-04-12T19:39:10.436052+0000","last_became_peered":"2024-04-12T19:39:10.436052+0000","last_unstale":"2024-04-12T19:39:18.585758+0000","last_undegraded":"2024-04-12T19:39:18.585758+0000","last_fullsized":"2024-04-12T19:39:18.585758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:25:54.417979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489106+0000","last_change":"2024-04-12T19:39:11.476500+0000","last_active":"2024-04-12T19:39:17.489106+0000","last_peered":"2024-04-12T19:39:17.489106+0000","last_clean":"2024-04-12T19:39:17.489106+0000","last_became_active":"2024-04-12T19:39:11.476227+0000","last_became_peered":"2024-04-12T19:39:11.476227+0000","last_unstale":"2024-04-12T19:39:17.489106+0000","last_undegraded":"2024-04-12T19:39:17.489106+0000","last_fullsized":"2024-04-12T19:39:17.489106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:10:23.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488071+0000","last_change":"2024-04-12T19:39:16.130127+0000","last_active":"2024-04-12T19:39:17.488071+0000","last_peered":"2024-04-12T19:39:17.488071+0000","last_clean":"2024-04-12T19:39:17.488071+0000","last_became_active":"2024-04-12T19:39:16.128965+0000","last_became_peered":"2024-04-12T19:39:16.128965+0000","last_unstale":"2024-04-12T19:39:17.488071+0000","last_undegraded":"2024-04-12T19:39:17.488071+0000","last_fullsized":"2024-04-12T19:39:17.488071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:05:40.753433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489202+0000","last_change":"2024-04-12T19:39:10.434713+0000","last_active":"2024-04-12T19:39:17.489202+0000","last_peered":"2024-04-12T19:39:17.489202+0000","last_clean":"2024-04-12T19:39:17.489202+0000","last_became_active":"2024-04-12T19:39:10.434206+0000","last_became_peered":"2024-04-12T19:39:10.434206+0000","last_unstale":"2024-04-12T19:39:17.489202+0000","last_undegraded":"2024-04-12T19:39:17.489202+0000","last_fullsized":"2024-04-12T19:39:17.489202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:35:32.075423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585573+0000","last_change":"2024-04-12T19:39:11.468967+0000","last_active":"2024-04-12T19:39:18.585573+0000","last_peered":"2024-04-12T19:39:18.585573+0000","last_clean":"2024-04-12T19:39:18.585573+0000","last_became_active":"2024-04-12T19:39:11.468506+0000","last_became_peered":"2024-04-12T19:39:11.468506+0000","last_unstale":"2024-04-12T19:39:18.585573+0000","last_undegraded":"2024-04-12T19:39:18.585573+0000","last_fullsized":"2024-04-12T19:39:18.585573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:34:33.700728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490493+0000","last_change":"2024-04-12T19:39:15.514844+0000","last_active":"2024-04-12T19:39:17.490493+0000","last_peered":"2024-04-12T19:39:17.490493+0000","last_clean":"2024-04-12T19:39:17.490493+0000","last_became_active":"2024-04-12T19:39:15.514389+0000","last_became_peered":"2024-04-12T19:39:15.514389+0000","last_unstale":"2024-04-12T19:39:17.490493+0000","last_undegraded":"2024-04-12T19:39:17.490493+0000","last_fullsized":"2024-04-12T19:39:17.490493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:13.334480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493030+0000","last_change":"2024-04-12T19:39:10.449208+0000","last_active":"2024-04-12T19:39:18.493030+0000","last_peered":"2024-04-12T19:39:18.493030+0000","last_clean":"2024-04-12T19:39:18.493030+0000","last_became_active":"2024-04-12T19:39:10.447087+0000","last_became_peered":"2024-04-12T19:39:10.447087+0000","last_unstale":"2024-04-12T19:39:18.493030+0000","last_undegraded":"2024-04-12T19:39:18.493030+0000","last_fullsized":"2024-04-12T19:39:18.493030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:15.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493393+0000","last_change":"2024-04-12T19:39:11.453798+0000","last_active":"2024-04-12T19:39:17.493393+0000","last_peered":"2024-04-12T19:39:17.493393+0000","last_clean":"2024-04-12T19:39:17.493393+0000","last_became_active":"2024-04-12T19:39:11.451146+0000","last_became_peered":"2024-04-12T19:39:11.451146+0000","last_unstale":"2024-04-12T19:39:17.493393+0000","last_undegraded":"2024-04-12T19:39:17.493393+0000","last_fullsized":"2024-04-12T19:39:17.493393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:21:53.745025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491302+0000","last_change":"2024-04-12T19:39:15.516232+0000","last_active":"2024-04-12T19:39:17.491302+0000","last_peered":"2024-04-12T19:39:17.491302+0000","last_clean":"2024-04-12T19:39:17.491302+0000","last_became_active":"2024-04-12T19:39:15.515675+0000","last_became_peered":"2024-04-12T19:39:15.515675+0000","last_unstale":"2024-04-12T19:39:17.491302+0000","last_undegraded":"2024-04-12T19:39:17.491302+0000","last_fullsized":"2024-04-12T19:39:17.491302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:39:36.033443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.492973+0000","last_change":"2024-04-12T19:39:10.448666+0000","last_active":"2024-04-12T19:39:18.492973+0000","last_peered":"2024-04-12T19:39:18.492973+0000","last_clean":"2024-04-12T19:39:18.492973+0000","last_became_active":"2024-04-12T19:39:10.447506+0000","last_became_peered":"2024-04-12T19:39:10.447506+0000","last_unstale":"2024-04-12T19:39:18.492973+0000","last_undegraded":"2024-04-12T19:39:18.492973+0000","last_fullsized":"2024-04-12T19:39:18.492973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493463+0000","last_change":"2024-04-12T19:39:11.444311+0000","last_active":"2024-04-12T19:39:17.493463+0000","last_peered":"2024-04-12T19:39:17.493463+0000","last_clean":"2024-04-12T19:39:17.493463+0000","last_became_active":"2024-04-12T19:39:11.443691+0000","last_became_peered":"2024-04-12T19:39:11.443691+0000","last_unstale":"2024-04-12T19:39:17.493463+0000","last_undegraded":"2024-04-12T19:39:17.493463+0000","last_fullsized":"2024-04-12T19:39:17.493463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:37.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491425+0000","last_change":"2024-04-12T19:39:15.512394+0000","last_active":"2024-04-12T19:39:17.491425+0000","last_peered":"2024-04-12T19:39:17.491425+0000","last_clean":"2024-04-12T19:39:17.491425+0000","last_became_active":"2024-04-12T19:39:15.511995+0000","last_became_peered":"2024-04-12T19:39:15.511995+0000","last_unstale":"2024-04-12T19:39:17.491425+0000","last_undegraded":"2024-04-12T19:39:17.491425+0000","last_fullsized":"2024-04-12T19:39:17.491425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:25:21.809067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.173497+0000","last_change":"2024-04-12T19:39:11.466978+0000","last_active":"2024-04-12T19:39:18.173497+0000","last_peered":"2024-04-12T19:39:18.173497+0000","last_clean":"2024-04-12T19:39:18.173497+0000","last_became_active":"2024-04-12T19:39:11.462526+0000","last_became_peered":"2024-04-12T19:39:11.462526+0000","last_unstale":"2024-04-12T19:39:18.173497+0000","last_undegraded":"2024-04-12T19:39:18.173497+0000","last_fullsized":"2024-04-12T19:39:18.173497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493020+0000","last_change":"2024-04-12T19:39:10.449545+0000","last_active":"2024-04-12T19:39:18.493020+0000","last_peered":"2024-04-12T19:39:18.493020+0000","last_clean":"2024-04-12T19:39:18.493020+0000","last_became_active":"2024-04-12T19:39:10.449218+0000","last_became_peered":"2024-04-12T19:39:10.449218+0000","last_unstale":"2024-04-12T19:39:18.493020+0000","last_undegraded":"2024-04-12T19:39:18.493020+0000","last_fullsized":"2024-04-12T19:39:18.493020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:51.431359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492072+0000","last_change":"2024-04-12T19:39:15.520316+0000","last_active":"2024-04-12T19:39:17.492072+0000","last_peered":"2024-04-12T19:39:17.492072+0000","last_clean":"2024-04-12T19:39:17.492072+0000","last_became_active":"2024-04-12T19:39:15.519733+0000","last_became_peered":"2024-04-12T19:39:15.519733+0000","last_unstale":"2024-04-12T19:39:17.492072+0000","last_undegraded":"2024-04-12T19:39:17.492072+0000","last_fullsized":"2024-04-12T19:39:17.492072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:45:30.872970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488363+0000","last_change":"2024-04-12T19:39:11.468457+0000","last_active":"2024-04-12T19:39:17.488363+0000","last_peered":"2024-04-12T19:39:17.488363+0000","last_clean":"2024-04-12T19:39:17.488363+0000","last_became_active":"2024-04-12T19:39:11.467315+0000","last_became_peered":"2024-04-12T19:39:11.467315+0000","last_unstale":"2024-04-12T19:39:17.488363+0000","last_undegraded":"2024-04-12T19:39:17.488363+0000","last_fullsized":"2024-04-12T19:39:17.488363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103926+0000","last_change":"2024-04-12T19:39:10.440820+0000","last_active":"2024-04-12T19:39:18.103926+0000","last_peered":"2024-04-12T19:39:18.103926+0000","last_clean":"2024-04-12T19:39:18.103926+0000","last_became_active":"2024-04-12T19:39:10.440389+0000","last_became_peered":"2024-04-12T19:39:10.440389+0000","last_unstale":"2024-04-12T19:39:18.103926+0000","last_undegraded":"2024-04-12T19:39:18.103926+0000","last_fullsized":"2024-04-12T19:39:18.103926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490713+0000","last_change":"2024-04-12T19:39:15.512849+0000","last_active":"2024-04-12T19:39:17.490713+0000","last_peered":"2024-04-12T19:39:17.490713+0000","last_clean":"2024-04-12T19:39:17.490713+0000","last_became_active":"2024-04-12T19:39:15.512484+0000","last_became_peered":"2024-04-12T19:39:15.512484+0000","last_unstale":"2024-04-12T19:39:17.490713+0000","last_undegraded":"2024-04-12T19:39:17.490713+0000","last_fullsized":"2024-04-12T19:39:17.490713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:41.709345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487788+0000","last_change":"2024-04-12T19:39:11.467478+0000","last_active":"2024-04-12T19:39:17.487788+0000","last_peered":"2024-04-12T19:39:17.487788+0000","last_clean":"2024-04-12T19:39:17.487788+0000","last_became_active":"2024-04-12T19:39:11.467119+0000","last_became_peered":"2024-04-12T19:39:11.467119+0000","last_unstale":"2024-04-12T19:39:17.487788+0000","last_undegraded":"2024-04-12T19:39:17.487788+0000","last_fullsized":"2024-04-12T19:39:17.487788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103760+0000","last_change":"2024-04-12T19:39:10.445133+0000","last_active":"2024-04-12T19:39:18.103760+0000","last_peered":"2024-04-12T19:39:18.103760+0000","last_clean":"2024-04-12T19:39:18.103760+0000","last_became_active":"2024-04-12T19:39:10.444813+0000","last_became_peered":"2024-04-12T19:39:10.444813+0000","last_unstale":"2024-04-12T19:39:18.103760+0000","last_undegraded":"2024-04-12T19:39:18.103760+0000","last_fullsized":"2024-04-12T19:39:18.103760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:28:58.315840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104936+0000","last_change":"2024-04-12T19:39:16.128749+0000","last_active":"2024-04-12T19:39:18.104936+0000","last_peered":"2024-04-12T19:39:18.104936+0000","last_clean":"2024-04-12T19:39:18.104936+0000","last_became_active":"2024-04-12T19:39:16.127560+0000","last_became_peered":"2024-04-12T19:39:16.127560+0000","last_unstale":"2024-04-12T19:39:18.104936+0000","last_undegraded":"2024-04-12T19:39:18.104936+0000","last_fullsized":"2024-04-12T19:39:18.104936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:27:00.174133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491573+0000","last_change":"2024-04-12T19:39:11.460532+0000","last_active":"2024-04-12T19:39:17.491573+0000","last_peered":"2024-04-12T19:39:17.491573+0000","last_clean":"2024-04-12T19:39:17.491573+0000","last_became_active":"2024-04-12T19:39:11.460027+0000","last_became_peered":"2024-04-12T19:39:11.460027+0000","last_unstale":"2024-04-12T19:39:17.491573+0000","last_undegraded":"2024-04-12T19:39:17.491573+0000","last_fullsized":"2024-04-12T19:39:17.491573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:16.676989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493544+0000","last_change":"2024-04-12T19:39:10.447746+0000","last_active":"2024-04-12T19:39:18.493544+0000","last_peered":"2024-04-12T19:39:18.493544+0000","last_clean":"2024-04-12T19:39:18.493544+0000","last_became_active":"2024-04-12T19:39:10.446264+0000","last_became_peered":"2024-04-12T19:39:10.446264+0000","last_unstale":"2024-04-12T19:39:18.493544+0000","last_undegraded":"2024-04-12T19:39:18.493544+0000","last_fullsized":"2024-04-12T19:39:18.493544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492578+0000","last_change":"2024-04-12T19:39:15.514854+0000","last_active":"2024-04-12T19:39:17.492578+0000","last_peered":"2024-04-12T19:39:17.492578+0000","last_clean":"2024-04-12T19:39:17.492578+0000","last_became_active":"2024-04-12T19:39:15.514469+0000","last_became_peered":"2024-04-12T19:39:15.514469+0000","last_unstale":"2024-04-12T19:39:17.492578+0000","last_undegraded":"2024-04-12T19:39:17.492578+0000","last_fullsized":"2024-04-12T19:39:17.492578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:02:18.119234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.586125+0000","last_change":"2024-04-12T19:39:11.455415+0000","last_active":"2024-04-12T19:39:18.586125+0000","last_peered":"2024-04-12T19:39:18.586125+0000","last_clean":"2024-04-12T19:39:18.586125+0000","last_became_active":"2024-04-12T19:39:11.455042+0000","last_became_peered":"2024-04-12T19:39:11.455042+0000","last_unstale":"2024-04-12T19:39:18.586125+0000","last_undegraded":"2024-04-12T19:39:18.586125+0000","last_fullsized":"2024-04-12T19:39:18.586125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175136+0000","last_change":"2024-04-12T19:39:10.447580+0000","last_active":"2024-04-12T19:39:18.175136+0000","last_peered":"2024-04-12T19:39:18.175136+0000","last_clean":"2024-04-12T19:39:18.175136+0000","last_became_active":"2024-04-12T19:39:10.447234+0000","last_became_peered":"2024-04-12T19:39:10.447234+0000","last_unstale":"2024-04-12T19:39:18.175136+0000","last_undegraded":"2024-04-12T19:39:18.175136+0000","last_fullsized":"2024-04-12T19:39:18.175136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490950+0000","last_change":"2024-04-12T19:39:16.129529+0000","last_active":"2024-04-12T19:39:17.490950+0000","last_peered":"2024-04-12T19:39:17.490950+0000","last_clean":"2024-04-12T19:39:17.490950+0000","last_became_active":"2024-04-12T19:39:16.128296+0000","last_became_peered":"2024-04-12T19:39:16.128296+0000","last_unstale":"2024-04-12T19:39:17.490950+0000","last_undegraded":"2024-04-12T19:39:17.490950+0000","last_fullsized":"2024-04-12T19:39:17.490950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:30.579330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489090+0000","last_change":"2024-04-12T19:39:11.474331+0000","last_active":"2024-04-12T19:39:17.489090+0000","last_peered":"2024-04-12T19:39:17.489090+0000","last_clean":"2024-04-12T19:39:17.489090+0000","last_became_active":"2024-04-12T19:39:11.474034+0000","last_became_peered":"2024-04-12T19:39:11.474034+0000","last_unstale":"2024-04-12T19:39:17.489090+0000","last_undegraded":"2024-04-12T19:39:17.489090+0000","last_fullsized":"2024-04-12T19:39:17.489090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104698+0000","last_change":"2024-04-12T19:39:10.441909+0000","last_active":"2024-04-12T19:39:18.104698+0000","last_peered":"2024-04-12T19:39:18.104698+0000","last_clean":"2024-04-12T19:39:18.104698+0000","last_became_active":"2024-04-12T19:39:10.441461+0000","last_became_peered":"2024-04-12T19:39:10.441461+0000","last_unstale":"2024-04-12T19:39:18.104698+0000","last_undegraded":"2024-04-12T19:39:18.104698+0000","last_fullsized":"2024-04-12T19:39:18.104698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487914+0000","last_change":"2024-04-12T19:39:16.121582+0000","last_active":"2024-04-12T19:39:17.487914+0000","last_peered":"2024-04-12T19:39:17.487914+0000","last_clean":"2024-04-12T19:39:17.487914+0000","last_became_active":"2024-04-12T19:39:16.120301+0000","last_became_peered":"2024-04-12T19:39:16.120301+0000","last_unstale":"2024-04-12T19:39:17.487914+0000","last_undegraded":"2024-04-12T19:39:17.487914+0000","last_fullsized":"2024-04-12T19:39:17.487914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:08:52.349202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104233+0000","last_change":"2024-04-12T19:39:11.454547+0000","last_active":"2024-04-12T19:39:18.104233+0000","last_peered":"2024-04-12T19:39:18.104233+0000","last_clean":"2024-04-12T19:39:18.104233+0000","last_became_active":"2024-04-12T19:39:11.454183+0000","last_became_peered":"2024-04-12T19:39:11.454183+0000","last_unstale":"2024-04-12T19:39:18.104233+0000","last_undegraded":"2024-04-12T19:39:18.104233+0000","last_fullsized":"2024-04-12T19:39:18.104233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495290+0000","last_change":"2024-04-12T19:39:10.450615+0000","last_active":"2024-04-12T19:39:18.495290+0000","last_peered":"2024-04-12T19:39:18.495290+0000","last_clean":"2024-04-12T19:39:18.495290+0000","last_became_active":"2024-04-12T19:39:10.450161+0000","last_became_peered":"2024-04-12T19:39:10.450161+0000","last_unstale":"2024-04-12T19:39:18.495290+0000","last_undegraded":"2024-04-12T19:39:18.495290+0000","last_fullsized":"2024-04-12T19:39:18.495290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:28:58.315840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585091+0000","last_change":"2024-04-12T19:39:16.130720+0000","last_active":"2024-04-12T19:39:18.585091+0000","last_peered":"2024-04-12T19:39:18.585091+0000","last_clean":"2024-04-12T19:39:18.585091+0000","last_became_active":"2024-04-12T19:39:16.127733+0000","last_became_peered":"2024-04-12T19:39:16.127733+0000","last_unstale":"2024-04-12T19:39:18.585091+0000","last_undegraded":"2024-04-12T19:39:18.585091+0000","last_fullsized":"2024-04-12T19:39:18.585091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:25:21.809067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493689+0000","last_change":"2024-04-12T19:39:11.478915+0000","last_active":"2024-04-12T19:39:17.493689+0000","last_peered":"2024-04-12T19:39:17.493689+0000","last_clean":"2024-04-12T19:39:17.493689+0000","last_became_active":"2024-04-12T19:39:11.478570+0000","last_became_peered":"2024-04-12T19:39:11.478570+0000","last_unstale":"2024-04-12T19:39:17.493689+0000","last_undegraded":"2024-04-12T19:39:17.493689+0000","last_fullsized":"2024-04-12T19:39:17.493689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:26.512414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104346+0000","last_change":"2024-04-12T19:39:10.430117+0000","last_active":"2024-04-12T19:39:18.104346+0000","last_peered":"2024-04-12T19:39:18.104346+0000","last_clean":"2024-04-12T19:39:18.104346+0000","last_became_active":"2024-04-12T19:39:10.429533+0000","last_became_peered":"2024-04-12T19:39:10.429533+0000","last_unstale":"2024-04-12T19:39:18.104346+0000","last_undegraded":"2024-04-12T19:39:18.104346+0000","last_fullsized":"2024-04-12T19:39:18.104346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103455+0000","last_change":"2024-04-12T19:39:15.516618+0000","last_active":"2024-04-12T19:39:18.103455+0000","last_peered":"2024-04-12T19:39:18.103455+0000","last_clean":"2024-04-12T19:39:18.103455+0000","last_became_active":"2024-04-12T19:39:15.516233+0000","last_became_peered":"2024-04-12T19:39:15.516233+0000","last_unstale":"2024-04-12T19:39:18.103455+0000","last_undegraded":"2024-04-12T19:39:18.103455+0000","last_fullsized":"2024-04-12T19:39:18.103455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:45:30.872970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491846+0000","last_change":"2024-04-12T19:39:11.459045+0000","last_active":"2024-04-12T19:39:17.491846+0000","last_peered":"2024-04-12T19:39:17.491846+0000","last_clean":"2024-04-12T19:39:17.491846+0000","last_became_active":"2024-04-12T19:39:11.458714+0000","last_became_peered":"2024-04-12T19:39:11.458714+0000","last_unstale":"2024-04-12T19:39:17.491846+0000","last_undegraded":"2024-04-12T19:39:17.491846+0000","last_fullsized":"2024-04-12T19:39:17.491846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:33.845598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491628+0000","last_change":"2024-04-12T19:39:10.437425+0000","last_active":"2024-04-12T19:39:17.491628+0000","last_peered":"2024-04-12T19:39:17.491628+0000","last_clean":"2024-04-12T19:39:17.491628+0000","last_became_active":"2024-04-12T19:39:10.437004+0000","last_became_peered":"2024-04-12T19:39:10.437004+0000","last_unstale":"2024-04-12T19:39:17.491628+0000","last_undegraded":"2024-04-12T19:39:17.491628+0000","last_fullsized":"2024-04-12T19:39:17.491628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104281+0000","last_change":"2024-04-12T19:39:15.523251+0000","last_active":"2024-04-12T19:39:18.104281+0000","last_peered":"2024-04-12T19:39:18.104281+0000","last_clean":"2024-04-12T19:39:18.104281+0000","last_became_active":"2024-04-12T19:39:15.519488+0000","last_became_peered":"2024-04-12T19:39:15.519488+0000","last_unstale":"2024-04-12T19:39:18.104281+0000","last_undegraded":"2024-04-12T19:39:18.104281+0000","last_fullsized":"2024-04-12T19:39:18.104281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:12:45.261630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103426+0000","last_change":"2024-04-12T19:39:11.452969+0000","last_active":"2024-04-12T19:39:18.103426+0000","last_peered":"2024-04-12T19:39:18.103426+0000","last_clean":"2024-04-12T19:39:18.103426+0000","last_became_active":"2024-04-12T19:39:11.452699+0000","last_became_peered":"2024-04-12T19:39:11.452699+0000","last_unstale":"2024-04-12T19:39:18.103426+0000","last_undegraded":"2024-04-12T19:39:18.103426+0000","last_fullsized":"2024-04-12T19:39:18.103426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962166+0000","last_change":"2024-04-12T19:39:10.435670+0000","last_active":"2024-04-12T19:39:18.962166+0000","last_peered":"2024-04-12T19:39:18.962166+0000","last_clean":"2024-04-12T19:39:18.962166+0000","last_became_active":"2024-04-12T19:39:10.435317+0000","last_became_peered":"2024-04-12T19:39:10.435317+0000","last_unstale":"2024-04-12T19:39:18.962166+0000","last_undegraded":"2024-04-12T19:39:18.962166+0000","last_fullsized":"2024-04-12T19:39:18.962166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104855+0000","last_change":"2024-04-12T19:39:15.517258+0000","last_active":"2024-04-12T19:39:18.104855+0000","last_peered":"2024-04-12T19:39:18.104855+0000","last_clean":"2024-04-12T19:39:18.104855+0000","last_became_active":"2024-04-12T19:39:15.516843+0000","last_became_peered":"2024-04-12T19:39:15.516843+0000","last_unstale":"2024-04-12T19:39:18.104855+0000","last_undegraded":"2024-04-12T19:39:18.104855+0000","last_fullsized":"2024-04-12T19:39:18.104855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:56:53.325064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.584621+0000","last_change":"2024-04-12T19:39:11.458719+0000","last_active":"2024-04-12T19:39:18.584621+0000","last_peered":"2024-04-12T19:39:18.584621+0000","last_clean":"2024-04-12T19:39:18.584621+0000","last_became_active":"2024-04-12T19:39:11.457787+0000","last_became_peered":"2024-04-12T19:39:11.457787+0000","last_unstale":"2024-04-12T19:39:18.584621+0000","last_undegraded":"2024-04-12T19:39:18.584621+0000","last_fullsized":"2024-04-12T19:39:18.584621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.492948+0000","last_change":"2024-04-12T19:39:10.450200+0000","last_active":"2024-04-12T19:39:18.492948+0000","last_peered":"2024-04-12T19:39:18.492948+0000","last_clean":"2024-04-12T19:39:18.492948+0000","last_became_active":"2024-04-12T19:39:10.449871+0000","last_became_peered":"2024-04-12T19:39:10.449871+0000","last_unstale":"2024-04-12T19:39:18.492948+0000","last_undegraded":"2024-04-12T19:39:18.492948+0000","last_fullsized":"2024-04-12T19:39:18.492948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.586171+0000","last_change":"2024-04-12T19:39:16.134794+0000","last_active":"2024-04-12T19:39:18.586171+0000","last_peered":"2024-04-12T19:39:18.586171+0000","last_clean":"2024-04-12T19:39:18.586171+0000","last_became_active":"2024-04-12T19:39:16.131743+0000","last_became_peered":"2024-04-12T19:39:16.131743+0000","last_unstale":"2024-04-12T19:39:18.586171+0000","last_undegraded":"2024-04-12T19:39:18.586171+0000","last_fullsized":"2024-04-12T19:39:18.586171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:56:53.325064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488155+0000","last_change":"2024-04-12T19:39:11.474413+0000","last_active":"2024-04-12T19:39:17.488155+0000","last_peered":"2024-04-12T19:39:17.488155+0000","last_clean":"2024-04-12T19:39:17.488155+0000","last_became_active":"2024-04-12T19:39:11.473738+0000","last_became_peered":"2024-04-12T19:39:11.473738+0000","last_unstale":"2024-04-12T19:39:17.488155+0000","last_undegraded":"2024-04-12T19:39:17.488155+0000","last_fullsized":"2024-04-12T19:39:17.488155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:13:56.992995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492770+0000","last_change":"2024-04-12T19:39:10.426342+0000","last_active":"2024-04-12T19:39:17.492770+0000","last_peered":"2024-04-12T19:39:17.492770+0000","last_clean":"2024-04-12T19:39:17.492770+0000","last_became_active":"2024-04-12T19:39:10.426074+0000","last_became_peered":"2024-04-12T19:39:10.426074+0000","last_unstale":"2024-04-12T19:39:17.492770+0000","last_undegraded":"2024-04-12T19:39:17.492770+0000","last_fullsized":"2024-04-12T19:39:17.492770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:19:09.670101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493775+0000","last_change":"2024-04-12T19:39:06.612396+0000","last_active":"2024-04-12T19:39:18.493775+0000","last_peered":"2024-04-12T19:39:18.493775+0000","last_clean":"2024-04-12T19:39:18.493775+0000","last_became_active":"2024-04-12T19:39:06.610032+0000","last_became_peered":"2024-04-12T19:39:06.610032+0000","last_unstale":"2024-04-12T19:39:18.493775+0000","last_undegraded":"2024-04-12T19:39:18.493775+0000","last_fullsized":"2024-04-12T19:39:18.493775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:05.335186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:05.335186+0000","last_clean_scrub_stamp":"2024-04-12T19:39:05.335186+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:31:00.943120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174520+0000","last_change":"2024-04-12T19:39:16.129683+0000","last_active":"2024-04-12T19:39:18.174520+0000","last_peered":"2024-04-12T19:39:18.174520+0000","last_clean":"2024-04-12T19:39:18.174520+0000","last_became_active":"2024-04-12T19:39:16.128384+0000","last_became_peered":"2024-04-12T19:39:16.128384+0000","last_unstale":"2024-04-12T19:39:18.174520+0000","last_undegraded":"2024-04-12T19:39:18.174520+0000","last_fullsized":"2024-04-12T19:39:18.174520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:13.334480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494857+0000","last_change":"2024-04-12T19:39:11.464853+0000","last_active":"2024-04-12T19:39:18.494857+0000","last_peered":"2024-04-12T19:39:18.494857+0000","last_clean":"2024-04-12T19:39:18.494857+0000","last_became_active":"2024-04-12T19:39:11.464583+0000","last_became_peered":"2024-04-12T19:39:11.464583+0000","last_unstale":"2024-04-12T19:39:18.494857+0000","last_undegraded":"2024-04-12T19:39:18.494857+0000","last_fullsized":"2024-04-12T19:39:18.494857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:10:23.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962230+0000","last_change":"2024-04-12T19:39:10.437434+0000","last_active":"2024-04-12T19:39:18.962230+0000","last_peered":"2024-04-12T19:39:18.962230+0000","last_clean":"2024-04-12T19:39:18.962230+0000","last_became_active":"2024-04-12T19:39:10.437000+0000","last_became_peered":"2024-04-12T19:39:10.437000+0000","last_unstale":"2024-04-12T19:39:18.962230+0000","last_undegraded":"2024-04-12T19:39:18.962230+0000","last_fullsized":"2024-04-12T19:39:18.962230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:19:09.670101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175055+0000","last_change":"2024-04-12T19:39:16.122002+0000","last_active":"2024-04-12T19:39:18.175055+0000","last_peered":"2024-04-12T19:39:18.175055+0000","last_clean":"2024-04-12T19:39:18.175055+0000","last_became_active":"2024-04-12T19:39:16.120822+0000","last_became_peered":"2024-04-12T19:39:16.120822+0000","last_unstale":"2024-04-12T19:39:18.175055+0000","last_undegraded":"2024-04-12T19:39:18.175055+0000","last_fullsized":"2024-04-12T19:39:18.175055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:30.579330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.495013+0000","last_change":"2024-04-12T19:39:11.480018+0000","last_active":"2024-04-12T19:39:17.495013+0000","last_peered":"2024-04-12T19:39:17.495013+0000","last_clean":"2024-04-12T19:39:17.495013+0000","last_became_active":"2024-04-12T19:39:11.479672+0000","last_became_peered":"2024-04-12T19:39:11.479672+0000","last_unstale":"2024-04-12T19:39:17.495013+0000","last_undegraded":"2024-04-12T19:39:17.495013+0000","last_fullsized":"2024-04-12T19:39:17.495013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:09.267564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104503+0000","last_change":"2024-04-12T19:39:10.439233+0000","last_active":"2024-04-12T19:39:18.104503+0000","last_peered":"2024-04-12T19:39:18.104503+0000","last_clean":"2024-04-12T19:39:18.104503+0000","last_became_active":"2024-04-12T19:39:10.438816+0000","last_became_peered":"2024-04-12T19:39:10.438816+0000","last_unstale":"2024-04-12T19:39:18.104503+0000","last_undegraded":"2024-04-12T19:39:18.104503+0000","last_fullsized":"2024-04-12T19:39:18.104503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:15.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585297+0000","last_change":"2024-04-12T19:39:15.520784+0000","last_active":"2024-04-12T19:39:18.585297+0000","last_peered":"2024-04-12T19:39:18.585297+0000","last_clean":"2024-04-12T19:39:18.585297+0000","last_became_active":"2024-04-12T19:39:15.520270+0000","last_became_peered":"2024-04-12T19:39:15.520270+0000","last_unstale":"2024-04-12T19:39:18.585297+0000","last_undegraded":"2024-04-12T19:39:18.585297+0000","last_fullsized":"2024-04-12T19:39:18.585297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:45:30.872970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495368+0000","last_change":"2024-04-12T19:39:11.472989+0000","last_active":"2024-04-12T19:39:18.495368+0000","last_peered":"2024-04-12T19:39:18.495368+0000","last_clean":"2024-04-12T19:39:18.495368+0000","last_became_active":"2024-04-12T19:39:11.472677+0000","last_became_peered":"2024-04-12T19:39:11.472677+0000","last_unstale":"2024-04-12T19:39:18.495368+0000","last_undegraded":"2024-04-12T19:39:18.495368+0000","last_fullsized":"2024-04-12T19:39:18.495368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:37.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962266+0000","last_change":"2024-04-12T19:39:10.438486+0000","last_active":"2024-04-12T19:39:18.962266+0000","last_peered":"2024-04-12T19:39:18.962266+0000","last_clean":"2024-04-12T19:39:18.962266+0000","last_became_active":"2024-04-12T19:39:10.438219+0000","last_became_peered":"2024-04-12T19:39:10.438219+0000","last_unstale":"2024-04-12T19:39:18.962266+0000","last_undegraded":"2024-04-12T19:39:18.962266+0000","last_fullsized":"2024-04-12T19:39:18.962266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:11:49.476183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489727+0000","last_change":"2024-04-12T19:39:16.137131+0000","last_active":"2024-04-12T19:39:17.489727+0000","last_peered":"2024-04-12T19:39:17.489727+0000","last_clean":"2024-04-12T19:39:17.489727+0000","last_became_active":"2024-04-12T19:39:16.136171+0000","last_became_peered":"2024-04-12T19:39:16.136171+0000","last_unstale":"2024-04-12T19:39:17.489727+0000","last_undegraded":"2024-04-12T19:39:17.489727+0000","last_fullsized":"2024-04-12T19:39:17.489727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:56:53.325064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495120+0000","last_change":"2024-04-12T19:39:11.476364+0000","last_active":"2024-04-12T19:39:18.495120+0000","last_peered":"2024-04-12T19:39:18.495120+0000","last_clean":"2024-04-12T19:39:18.495120+0000","last_became_active":"2024-04-12T19:39:11.476024+0000","last_became_peered":"2024-04-12T19:39:11.476024+0000","last_unstale":"2024-04-12T19:39:18.495120+0000","last_undegraded":"2024-04-12T19:39:18.495120+0000","last_fullsized":"2024-04-12T19:39:18.495120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:45:10.487944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492470+0000","last_change":"2024-04-12T19:39:10.433299+0000","last_active":"2024-04-12T19:39:17.492470+0000","last_peered":"2024-04-12T19:39:17.492470+0000","last_clean":"2024-04-12T19:39:17.492470+0000","last_became_active":"2024-04-12T19:39:10.432858+0000","last_became_peered":"2024-04-12T19:39:10.432858+0000","last_unstale":"2024-04-12T19:39:17.492470+0000","last_undegraded":"2024-04-12T19:39:17.492470+0000","last_fullsized":"2024-04-12T19:39:17.492470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:00:24.899000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490231+0000","last_change":"2024-04-12T19:39:15.520112+0000","last_active":"2024-04-12T19:39:17.490231+0000","last_peered":"2024-04-12T19:39:17.490231+0000","last_clean":"2024-04-12T19:39:17.490231+0000","last_became_active":"2024-04-12T19:39:15.519631+0000","last_became_peered":"2024-04-12T19:39:15.519631+0000","last_unstale":"2024-04-12T19:39:17.490231+0000","last_undegraded":"2024-04-12T19:39:17.490231+0000","last_fullsized":"2024-04-12T19:39:17.490231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:45:14.554860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494051+0000","last_change":"2024-04-12T19:39:11.472849+0000","last_active":"2024-04-12T19:39:18.494051+0000","last_peered":"2024-04-12T19:39:18.494051+0000","last_clean":"2024-04-12T19:39:18.494051+0000","last_became_active":"2024-04-12T19:39:11.472506+0000","last_became_peered":"2024-04-12T19:39:11.472506+0000","last_unstale":"2024-04-12T19:39:18.494051+0000","last_undegraded":"2024-04-12T19:39:18.494051+0000","last_fullsized":"2024-04-12T19:39:18.494051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:21:53.745025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962167+0000","last_change":"2024-04-12T19:39:10.434547+0000","last_active":"2024-04-12T19:39:18.962167+0000","last_peered":"2024-04-12T19:39:18.962167+0000","last_clean":"2024-04-12T19:39:18.962167+0000","last_became_active":"2024-04-12T19:39:10.433054+0000","last_became_peered":"2024-04-12T19:39:10.433054+0000","last_unstale":"2024-04-12T19:39:18.962167+0000","last_undegraded":"2024-04-12T19:39:18.962167+0000","last_fullsized":"2024-04-12T19:39:18.962167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:35:32.075423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585816+0000","last_change":"2024-04-12T19:39:15.516082+0000","last_active":"2024-04-12T19:39:18.585816+0000","last_peered":"2024-04-12T19:39:18.585816+0000","last_clean":"2024-04-12T19:39:18.585816+0000","last_became_active":"2024-04-12T19:39:15.515321+0000","last_became_peered":"2024-04-12T19:39:15.515321+0000","last_unstale":"2024-04-12T19:39:18.585816+0000","last_undegraded":"2024-04-12T19:39:18.585816+0000","last_fullsized":"2024-04-12T19:39:18.585816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:12:45.261630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174564+0000","last_change":"2024-04-12T19:39:11.468548+0000","last_active":"2024-04-12T19:39:18.174564+0000","last_peered":"2024-04-12T19:39:18.174564+0000","last_clean":"2024-04-12T19:39:18.174564+0000","last_became_active":"2024-04-12T19:39:11.468141+0000","last_became_peered":"2024-04-12T19:39:11.468141+0000","last_unstale":"2024-04-12T19:39:18.174564+0000","last_undegraded":"2024-04-12T19:39:18.174564+0000","last_fullsized":"2024-04-12T19:39:18.174564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174038+0000","last_change":"2024-04-12T19:39:10.444137+0000","last_active":"2024-04-12T19:39:18.174038+0000","last_peered":"2024-04-12T19:39:18.174038+0000","last_clean":"2024-04-12T19:39:18.174038+0000","last_became_active":"2024-04-12T19:39:10.442731+0000","last_became_peered":"2024-04-12T19:39:10.442731+0000","last_unstale":"2024-04-12T19:39:18.174038+0000","last_undegraded":"2024-04-12T19:39:18.174038+0000","last_fullsized":"2024-04-12T19:39:18.174038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:19:09.670101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489001+0000","last_change":"2024-04-12T19:39:16.126978+0000","last_active":"2024-04-12T19:39:17.489001+0000","last_peered":"2024-04-12T19:39:17.489001+0000","last_clean":"2024-04-12T19:39:17.489001+0000","last_became_active":"2024-04-12T19:39:16.125687+0000","last_became_peered":"2024-04-12T19:39:16.125687+0000","last_unstale":"2024-04-12T19:39:17.489001+0000","last_undegraded":"2024-04-12T19:39:17.489001+0000","last_fullsized":"2024-04-12T19:39:17.489001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:07:45.787032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493681+0000","last_change":"2024-04-12T19:39:11.478082+0000","last_active":"2024-04-12T19:39:18.493681+0000","last_peered":"2024-04-12T19:39:18.493681+0000","last_clean":"2024-04-12T19:39:18.493681+0000","last_became_active":"2024-04-12T19:39:11.471563+0000","last_became_peered":"2024-04-12T19:39:11.471563+0000","last_unstale":"2024-04-12T19:39:18.493681+0000","last_undegraded":"2024-04-12T19:39:18.493681+0000","last_fullsized":"2024-04-12T19:39:18.493681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:05:52.600930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491596+0000","last_change":"2024-04-12T19:39:10.443036+0000","last_active":"2024-04-12T19:39:17.491596+0000","last_peered":"2024-04-12T19:39:17.491596+0000","last_clean":"2024-04-12T19:39:17.491596+0000","last_became_active":"2024-04-12T19:39:10.442763+0000","last_became_peered":"2024-04-12T19:39:10.442763+0000","last_unstale":"2024-04-12T19:39:17.491596+0000","last_undegraded":"2024-04-12T19:39:17.491596+0000","last_fullsized":"2024-04-12T19:39:17.491596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488661+0000","last_change":"2024-04-12T19:39:16.123073+0000","last_active":"2024-04-12T19:39:17.488661+0000","last_peered":"2024-04-12T19:39:17.488661+0000","last_clean":"2024-04-12T19:39:17.488661+0000","last_became_active":"2024-04-12T19:39:16.120993+0000","last_became_peered":"2024-04-12T19:39:16.120993+0000","last_unstale":"2024-04-12T19:39:17.488661+0000","last_undegraded":"2024-04-12T19:39:17.488661+0000","last_fullsized":"2024-04-12T19:39:17.488661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:44:14.241958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585081+0000","last_change":"2024-04-12T19:39:11.466277+0000","last_active":"2024-04-12T19:39:18.585081+0000","last_peered":"2024-04-12T19:39:18.585081+0000","last_clean":"2024-04-12T19:39:18.585081+0000","last_became_active":"2024-04-12T19:39:11.465998+0000","last_became_peered":"2024-04-12T19:39:11.465998+0000","last_unstale":"2024-04-12T19:39:18.585081+0000","last_undegraded":"2024-04-12T19:39:18.585081+0000","last_fullsized":"2024-04-12T19:39:18.585081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.583818+0000","last_change":"2024-04-12T19:39:10.430339+0000","last_active":"2024-04-12T19:39:18.583818+0000","last_peered":"2024-04-12T19:39:18.583818+0000","last_clean":"2024-04-12T19:39:18.583818+0000","last_became_active":"2024-04-12T19:39:10.430059+0000","last_became_peered":"2024-04-12T19:39:10.430059+0000","last_unstale":"2024-04-12T19:39:18.583818+0000","last_undegraded":"2024-04-12T19:39:18.583818+0000","last_fullsized":"2024-04-12T19:39:18.583818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:59:25.400930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493660+0000","last_change":"2024-04-12T19:39:16.129872+0000","last_active":"2024-04-12T19:39:17.493660+0000","last_peered":"2024-04-12T19:39:17.493660+0000","last_clean":"2024-04-12T19:39:17.493660+0000","last_became_active":"2024-04-12T19:39:16.127095+0000","last_became_peered":"2024-04-12T19:39:16.127095+0000","last_unstale":"2024-04-12T19:39:17.493660+0000","last_undegraded":"2024-04-12T19:39:17.493660+0000","last_fullsized":"2024-04-12T19:39:17.493660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:27:00.174133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494610+0000","last_change":"2024-04-12T19:39:11.479072+0000","last_active":"2024-04-12T19:39:18.494610+0000","last_peered":"2024-04-12T19:39:18.494610+0000","last_clean":"2024-04-12T19:39:18.494610+0000","last_became_active":"2024-04-12T19:39:11.478779+0000","last_became_peered":"2024-04-12T19:39:11.478779+0000","last_unstale":"2024-04-12T19:39:18.494610+0000","last_undegraded":"2024-04-12T19:39:18.494610+0000","last_fullsized":"2024-04-12T19:39:18.494610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:29.380470+0000","last_change":"2024-04-12T19:39:10.443760+0000","last_active":"2024-04-12T19:39:29.380470+0000","last_peered":"2024-04-12T19:39:29.380470+0000","last_clean":"2024-04-12T19:39:29.380470+0000","last_became_active":"2024-04-12T19:39:10.443031+0000","last_became_peered":"2024-04-12T19:39:10.443031+0000","last_unstale":"2024-04-12T19:39:29.380470+0000","last_undegraded":"2024-04-12T19:39:29.380470+0000","last_fullsized":"2024-04-12T19:39:29.380470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103735+0000","last_change":"2024-04-12T19:39:15.521287+0000","last_active":"2024-04-12T19:39:18.103735+0000","last_peered":"2024-04-12T19:39:18.103735+0000","last_clean":"2024-04-12T19:39:18.103735+0000","last_became_active":"2024-04-12T19:39:15.519545+0000","last_became_peered":"2024-04-12T19:39:15.519545+0000","last_unstale":"2024-04-12T19:39:18.103735+0000","last_undegraded":"2024-04-12T19:39:18.103735+0000","last_fullsized":"2024-04-12T19:39:18.103735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:02:18.119234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491496+0000","last_change":"2024-04-12T19:39:11.467693+0000","last_active":"2024-04-12T19:39:17.491496+0000","last_peered":"2024-04-12T19:39:17.491496+0000","last_clean":"2024-04-12T19:39:17.491496+0000","last_became_active":"2024-04-12T19:39:11.467283+0000","last_became_peered":"2024-04-12T19:39:11.467283+0000","last_unstale":"2024-04-12T19:39:17.491496+0000","last_undegraded":"2024-04-12T19:39:17.491496+0000","last_fullsized":"2024-04-12T19:39:17.491496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:52.447954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104456+0000","last_change":"2024-04-12T19:39:10.440386+0000","last_active":"2024-04-12T19:39:18.104456+0000","last_peered":"2024-04-12T19:39:18.104456+0000","last_clean":"2024-04-12T19:39:18.104456+0000","last_became_active":"2024-04-12T19:39:10.439567+0000","last_became_peered":"2024-04-12T19:39:10.439567+0000","last_unstale":"2024-04-12T19:39:18.104456+0000","last_undegraded":"2024-04-12T19:39:18.104456+0000","last_fullsized":"2024-04-12T19:39:18.104456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:51.431359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493139+0000","last_change":"2024-04-12T19:39:15.511609+0000","last_active":"2024-04-12T19:39:17.493139+0000","last_peered":"2024-04-12T19:39:17.493139+0000","last_clean":"2024-04-12T19:39:17.493139+0000","last_became_active":"2024-04-12T19:39:15.511178+0000","last_became_peered":"2024-04-12T19:39:15.511178+0000","last_unstale":"2024-04-12T19:39:17.493139+0000","last_undegraded":"2024-04-12T19:39:17.493139+0000","last_fullsized":"2024-04-12T19:39:17.493139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:12:45.261630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585669+0000","last_change":"2024-04-12T19:39:11.468760+0000","last_active":"2024-04-12T19:39:18.585669+0000","last_peered":"2024-04-12T19:39:18.585669+0000","last_clean":"2024-04-12T19:39:18.585669+0000","last_became_active":"2024-04-12T19:39:11.468126+0000","last_became_peered":"2024-04-12T19:39:11.468126+0000","last_unstale":"2024-04-12T19:39:18.585669+0000","last_undegraded":"2024-04-12T19:39:18.585669+0000","last_fullsized":"2024-04-12T19:39:18.585669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:18:45.626616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493459+0000","last_change":"2024-04-12T19:39:10.440768+0000","last_active":"2024-04-12T19:39:17.493459+0000","last_peered":"2024-04-12T19:39:17.493459+0000","last_clean":"2024-04-12T19:39:17.493459+0000","last_became_active":"2024-04-12T19:39:10.440480+0000","last_became_peered":"2024-04-12T19:39:10.440480+0000","last_unstale":"2024-04-12T19:39:17.493459+0000","last_undegraded":"2024-04-12T19:39:17.493459+0000","last_fullsized":"2024-04-12T19:39:17.493459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:51.431359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487735+0000","last_change":"2024-04-12T19:39:15.509729+0000","last_active":"2024-04-12T19:39:17.487735+0000","last_peered":"2024-04-12T19:39:17.487735+0000","last_clean":"2024-04-12T19:39:17.487735+0000","last_became_active":"2024-04-12T19:39:15.509283+0000","last_became_peered":"2024-04-12T19:39:15.509283+0000","last_unstale":"2024-04-12T19:39:17.487735+0000","last_undegraded":"2024-04-12T19:39:17.487735+0000","last_fullsized":"2024-04-12T19:39:17.487735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:26:05.519893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493270+0000","last_change":"2024-04-12T19:39:11.460136+0000","last_active":"2024-04-12T19:39:17.493270+0000","last_peered":"2024-04-12T19:39:17.493270+0000","last_clean":"2024-04-12T19:39:17.493270+0000","last_became_active":"2024-04-12T19:39:11.459732+0000","last_became_peered":"2024-04-12T19:39:11.459732+0000","last_unstale":"2024-04-12T19:39:17.493270+0000","last_undegraded":"2024-04-12T19:39:17.493270+0000","last_fullsized":"2024-04-12T19:39:17.493270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:40:00.108398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174891+0000","last_change":"2024-04-12T19:39:10.445173+0000","last_active":"2024-04-12T19:39:18.174891+0000","last_peered":"2024-04-12T19:39:18.174891+0000","last_clean":"2024-04-12T19:39:18.174891+0000","last_became_active":"2024-04-12T19:39:10.444515+0000","last_became_peered":"2024-04-12T19:39:10.444515+0000","last_unstale":"2024-04-12T19:39:18.174891+0000","last_undegraded":"2024-04-12T19:39:18.174891+0000","last_fullsized":"2024-04-12T19:39:18.174891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:11:49.476183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487760+0000","last_change":"2024-04-12T19:39:16.127728+0000","last_active":"2024-04-12T19:39:17.487760+0000","last_peered":"2024-04-12T19:39:17.487760+0000","last_clean":"2024-04-12T19:39:17.487760+0000","last_became_active":"2024-04-12T19:39:16.125486+0000","last_became_peered":"2024-04-12T19:39:16.125486+0000","last_unstale":"2024-04-12T19:39:17.487760+0000","last_undegraded":"2024-04-12T19:39:17.487760+0000","last_fullsized":"2024-04-12T19:39:17.487760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:28:14.853197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585755+0000","last_change":"2024-04-12T19:39:16.133052+0000","last_active":"2024-04-12T19:39:18.585755+0000","last_peered":"2024-04-12T19:39:18.585755+0000","last_clean":"2024-04-12T19:39:18.585755+0000","last_became_active":"2024-04-12T19:39:16.130388+0000","last_became_peered":"2024-04-12T19:39:16.130388+0000","last_unstale":"2024-04-12T19:39:18.585755+0000","last_undegraded":"2024-04-12T19:39:18.585755+0000","last_fullsized":"2024-04-12T19:39:18.585755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:02:18.119234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103422+0000","last_change":"2024-04-12T19:39:11.461191+0000","last_active":"2024-04-12T19:39:18.103422+0000","last_peered":"2024-04-12T19:39:18.103422+0000","last_clean":"2024-04-12T19:39:18.103422+0000","last_became_active":"2024-04-12T19:39:11.460841+0000","last_became_peered":"2024-04-12T19:39:11.460841+0000","last_unstale":"2024-04-12T19:39:18.103422+0000","last_undegraded":"2024-04-12T19:39:18.103422+0000","last_fullsized":"2024-04-12T19:39:18.103422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489885+0000","last_change":"2024-04-12T19:39:10.430054+0000","last_active":"2024-04-12T19:39:17.489885+0000","last_peered":"2024-04-12T19:39:17.489885+0000","last_clean":"2024-04-12T19:39:17.489885+0000","last_became_active":"2024-04-12T19:39:10.429693+0000","last_became_peered":"2024-04-12T19:39:10.429693+0000","last_unstale":"2024-04-12T19:39:17.489885+0000","last_undegraded":"2024-04-12T19:39:17.489885+0000","last_fullsized":"2024-04-12T19:39:17.489885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174774+0000","last_change":"2024-04-12T19:39:15.521261+0000","last_active":"2024-04-12T19:39:18.174774+0000","last_peered":"2024-04-12T19:39:18.174774+0000","last_clean":"2024-04-12T19:39:18.174774+0000","last_became_active":"2024-04-12T19:39:15.520618+0000","last_became_peered":"2024-04-12T19:39:15.520618+0000","last_unstale":"2024-04-12T19:39:18.174774+0000","last_undegraded":"2024-04-12T19:39:18.174774+0000","last_fullsized":"2024-04-12T19:39:18.174774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:41.709345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487629+0000","last_change":"2024-04-12T19:39:11.470231+0000","last_active":"2024-04-12T19:39:17.487629+0000","last_peered":"2024-04-12T19:39:17.487629+0000","last_clean":"2024-04-12T19:39:17.487629+0000","last_became_active":"2024-04-12T19:39:11.469814+0000","last_became_peered":"2024-04-12T19:39:11.469814+0000","last_unstale":"2024-04-12T19:39:17.487629+0000","last_undegraded":"2024-04-12T19:39:17.487629+0000","last_fullsized":"2024-04-12T19:39:17.487629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488012+0000","last_change":"2024-04-12T19:39:10.441115+0000","last_active":"2024-04-12T19:39:17.488012+0000","last_peered":"2024-04-12T19:39:17.488012+0000","last_clean":"2024-04-12T19:39:17.488012+0000","last_became_active":"2024-04-12T19:39:10.440755+0000","last_became_peered":"2024-04-12T19:39:10.440755+0000","last_unstale":"2024-04-12T19:39:17.488012+0000","last_undegraded":"2024-04-12T19:39:17.488012+0000","last_fullsized":"2024-04-12T19:39:17.488012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:25:54.417979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174166+0000","last_change":"2024-04-12T19:39:10.441520+0000","last_active":"2024-04-12T19:39:18.174166+0000","last_peered":"2024-04-12T19:39:18.174166+0000","last_clean":"2024-04-12T19:39:18.174166+0000","last_became_active":"2024-04-12T19:39:10.441219+0000","last_became_peered":"2024-04-12T19:39:10.441219+0000","last_unstale":"2024-04-12T19:39:18.174166+0000","last_undegraded":"2024-04-12T19:39:18.174166+0000","last_fullsized":"2024-04-12T19:39:18.174166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585328+0000","last_change":"2024-04-12T19:39:11.460915+0000","last_active":"2024-04-12T19:39:18.585328+0000","last_peered":"2024-04-12T19:39:18.585328+0000","last_clean":"2024-04-12T19:39:18.585328+0000","last_became_active":"2024-04-12T19:39:11.460672+0000","last_became_peered":"2024-04-12T19:39:11.460672+0000","last_unstale":"2024-04-12T19:39:18.585328+0000","last_undegraded":"2024-04-12T19:39:18.585328+0000","last_fullsized":"2024-04-12T19:39:18.585328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:10:44.776087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.963253+0000","last_change":"2024-04-12T19:39:15.512665+0000","last_active":"2024-04-12T19:39:18.963253+0000","last_peered":"2024-04-12T19:39:18.963253+0000","last_clean":"2024-04-12T19:39:18.963253+0000","last_became_active":"2024-04-12T19:39:15.512224+0000","last_became_peered":"2024-04-12T19:39:15.512224+0000","last_unstale":"2024-04-12T19:39:18.963253+0000","last_undegraded":"2024-04-12T19:39:18.963253+0000","last_fullsized":"2024-04-12T19:39:18.963253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:18:49.693531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488497+0000","last_change":"2024-04-12T19:39:10.446078+0000","last_active":"2024-04-12T19:39:17.488497+0000","last_peered":"2024-04-12T19:39:17.488497+0000","last_clean":"2024-04-12T19:39:17.488497+0000","last_became_active":"2024-04-12T19:39:10.445778+0000","last_became_peered":"2024-04-12T19:39:10.445778+0000","last_unstale":"2024-04-12T19:39:17.488497+0000","last_undegraded":"2024-04-12T19:39:17.488497+0000","last_fullsized":"2024-04-12T19:39:17.488497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:59:25.400930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492269+0000","last_change":"2024-04-12T19:39:11.455047+0000","last_active":"2024-04-12T19:39:17.492269+0000","last_peered":"2024-04-12T19:39:17.492269+0000","last_clean":"2024-04-12T19:39:17.492269+0000","last_became_active":"2024-04-12T19:39:11.454646+0000","last_became_peered":"2024-04-12T19:39:11.454646+0000","last_unstale":"2024-04-12T19:39:17.492269+0000","last_undegraded":"2024-04-12T19:39:17.492269+0000","last_fullsized":"2024-04-12T19:39:17.492269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:52.478867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488924+0000","last_change":"2024-04-12T19:39:15.513691+0000","last_active":"2024-04-12T19:39:17.488924+0000","last_peered":"2024-04-12T19:39:17.488924+0000","last_clean":"2024-04-12T19:39:17.488924+0000","last_became_active":"2024-04-12T19:39:15.513269+0000","last_became_peered":"2024-04-12T19:39:15.513269+0000","last_unstale":"2024-04-12T19:39:17.488924+0000","last_undegraded":"2024-04-12T19:39:17.488924+0000","last_fullsized":"2024-04-12T19:39:17.488924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:40:26.732234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.173537+0000","last_change":"2024-04-12T19:39:11.468368+0000","last_active":"2024-04-12T19:39:18.173537+0000","last_peered":"2024-04-12T19:39:18.173537+0000","last_clean":"2024-04-12T19:39:18.173537+0000","last_became_active":"2024-04-12T19:39:11.467807+0000","last_became_peered":"2024-04-12T19:39:11.467807+0000","last_unstale":"2024-04-12T19:39:18.173537+0000","last_undegraded":"2024-04-12T19:39:18.173537+0000","last_fullsized":"2024-04-12T19:39:18.173537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:55:09.781797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962714+0000","last_change":"2024-04-12T19:39:11.464628+0000","last_active":"2024-04-12T19:39:18.962714+0000","last_peered":"2024-04-12T19:39:18.962714+0000","last_clean":"2024-04-12T19:39:18.962714+0000","last_became_active":"2024-04-12T19:39:11.464333+0000","last_became_peered":"2024-04-12T19:39:11.464333+0000","last_unstale":"2024-04-12T19:39:18.962714+0000","last_undegraded":"2024-04-12T19:39:18.962714+0000","last_fullsized":"2024-04-12T19:39:18.962714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:52.447954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491395+0000","last_change":"2024-04-12T19:39:11.480027+0000","last_active":"2024-04-12T19:39:17.491395+0000","last_peered":"2024-04-12T19:39:17.491395+0000","last_clean":"2024-04-12T19:39:17.491395+0000","last_became_active":"2024-04-12T19:39:11.479816+0000","last_became_peered":"2024-04-12T19:39:11.479816+0000","last_unstale":"2024-04-12T19:39:17.491395+0000","last_undegraded":"2024-04-12T19:39:17.491395+0000","last_fullsized":"2024-04-12T19:39:17.491395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:45:10.487944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585208+0000","last_change":"2024-04-12T19:39:11.475058+0000","last_active":"2024-04-12T19:39:18.585208+0000","last_peered":"2024-04-12T19:39:18.585208+0000","last_clean":"2024-04-12T19:39:18.585208+0000","last_became_active":"2024-04-12T19:39:11.474706+0000","last_became_peered":"2024-04-12T19:39:11.474706+0000","last_unstale":"2024-04-12T19:39:18.585208+0000","last_undegraded":"2024-04-12T19:39:18.585208+0000","last_fullsized":"2024-04-12T19:39:18.585208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:55:09.781797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488726+0000","last_change":"2024-04-12T19:39:11.476138+0000","last_active":"2024-04-12T19:39:17.488726+0000","last_peered":"2024-04-12T19:39:17.488726+0000","last_clean":"2024-04-12T19:39:17.488726+0000","last_became_active":"2024-04-12T19:39:11.473857+0000","last_became_peered":"2024-04-12T19:39:11.473857+0000","last_unstale":"2024-04-12T19:39:17.488726+0000","last_undegraded":"2024-04-12T19:39:17.488726+0000","last_fullsized":"2024-04-12T19:39:17.488726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:40:00.108398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104371+0000","last_change":"2024-04-12T19:39:11.471824+0000","last_active":"2024-04-12T19:39:18.104371+0000","last_peered":"2024-04-12T19:39:18.104371+0000","last_clean":"2024-04-12T19:39:18.104371+0000","last_became_active":"2024-04-12T19:39:11.471316+0000","last_became_peered":"2024-04-12T19:39:11.471316+0000","last_unstale":"2024-04-12T19:39:18.104371+0000","last_undegraded":"2024-04-12T19:39:18.104371+0000","last_fullsized":"2024-04-12T19:39:18.104371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175088+0000","last_change":"2024-04-12T19:39:11.477664+0000","last_active":"2024-04-12T19:39:18.175088+0000","last_peered":"2024-04-12T19:39:18.175088+0000","last_clean":"2024-04-12T19:39:18.175088+0000","last_became_active":"2024-04-12T19:39:11.477400+0000","last_became_peered":"2024-04-12T19:39:11.477400+0000","last_unstale":"2024-04-12T19:39:18.175088+0000","last_undegraded":"2024-04-12T19:39:18.175088+0000","last_fullsized":"2024-04-12T19:39:18.175088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489032+0000","last_change":"2024-04-12T19:39:11.473661+0000","last_active":"2024-04-12T19:39:17.489032+0000","last_peered":"2024-04-12T19:39:17.489032+0000","last_clean":"2024-04-12T19:39:17.489032+0000","last_became_active":"2024-04-12T19:39:11.473335+0000","last_became_peered":"2024-04-12T19:39:11.473335+0000","last_unstale":"2024-04-12T19:39:17.489032+0000","last_undegraded":"2024-04-12T19:39:17.489032+0000","last_fullsized":"2024-04-12T19:39:17.489032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489785+0000","last_change":"2024-04-12T19:39:11.480192+0000","last_active":"2024-04-12T19:39:17.489785+0000","last_peered":"2024-04-12T19:39:17.489785+0000","last_clean":"2024-04-12T19:39:17.489785+0000","last_became_active":"2024-04-12T19:39:11.479845+0000","last_became_peered":"2024-04-12T19:39:11.479845+0000","last_unstale":"2024-04-12T19:39:17.489785+0000","last_undegraded":"2024-04-12T19:39:17.489785+0000","last_fullsized":"2024-04-12T19:39:17.489785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487952+0000","last_change":"2024-04-12T19:39:11.459940+0000","last_active":"2024-04-12T19:39:17.487952+0000","last_peered":"2024-04-12T19:39:17.487952+0000","last_clean":"2024-04-12T19:39:17.487952+0000","last_became_active":"2024-04-12T19:39:11.459403+0000","last_became_peered":"2024-04-12T19:39:11.459403+0000","last_unstale":"2024-04-12T19:39:17.487952+0000","last_undegraded":"2024-04-12T19:39:17.487952+0000","last_fullsized":"2024-04-12T19:39:17.487952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:55:09.781797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491159+0000","last_change":"2024-04-12T19:39:11.457187+0000","last_active":"2024-04-12T19:39:17.491159+0000","last_peered":"2024-04-12T19:39:17.491159+0000","last_clean":"2024-04-12T19:39:17.491159+0000","last_became_active":"2024-04-12T19:39:11.456859+0000","last_became_peered":"2024-04-12T19:39:11.456859+0000","last_unstale":"2024-04-12T19:39:17.491159+0000","last_undegraded":"2024-04-12T19:39:17.491159+0000","last_fullsized":"2024-04-12T19:39:17.491159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:05:52.600930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585047+0000","last_change":"2024-04-12T19:39:11.465043+0000","last_active":"2024-04-12T19:39:18.585047+0000","last_peered":"2024-04-12T19:39:18.585047+0000","last_clean":"2024-04-12T19:39:18.585047+0000","last_became_active":"2024-04-12T19:39:11.464724+0000","last_became_peered":"2024-04-12T19:39:11.464724+0000","last_unstale":"2024-04-12T19:39:18.585047+0000","last_undegraded":"2024-04-12T19:39:18.585047+0000","last_fullsized":"2024-04-12T19:39:18.585047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:20.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174218+0000","last_change":"2024-04-12T19:39:11.473208+0000","last_active":"2024-04-12T19:39:18.174218+0000","last_peered":"2024-04-12T19:39:18.174218+0000","last_clean":"2024-04-12T19:39:18.174218+0000","last_became_active":"2024-04-12T19:39:11.472752+0000","last_became_peered":"2024-04-12T19:39:11.472752+0000","last_unstale":"2024-04-12T19:39:18.174218+0000","last_undegraded":"2024-04-12T19:39:18.174218+0000","last_fullsized":"2024-04-12T19:39:18.174218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:10:44.776087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495278+0000","last_change":"2024-04-12T19:39:11.461738+0000","last_active":"2024-04-12T19:39:18.495278+0000","last_peered":"2024-04-12T19:39:18.495278+0000","last_clean":"2024-04-12T19:39:18.495278+0000","last_became_active":"2024-04-12T19:39:11.461456+0000","last_became_peered":"2024-04-12T19:39:11.461456+0000","last_unstale":"2024-04-12T19:39:18.495278+0000","last_undegraded":"2024-04-12T19:39:18.495278+0000","last_fullsized":"2024-04-12T19:39:18.495278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:22:57.956770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.963582+0000","last_change":"2024-04-12T19:39:11.468295+0000","last_active":"2024-04-12T19:39:18.963582+0000","last_peered":"2024-04-12T19:39:18.963582+0000","last_clean":"2024-04-12T19:39:18.963582+0000","last_became_active":"2024-04-12T19:39:11.468002+0000","last_became_peered":"2024-04-12T19:39:11.468002+0000","last_unstale":"2024-04-12T19:39:18.963582+0000","last_undegraded":"2024-04-12T19:39:18.963582+0000","last_fullsized":"2024-04-12T19:39:18.963582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:16.676989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.494704+0000","last_change":"2024-04-12T19:39:11.457117+0000","last_active":"2024-04-12T19:39:17.494704+0000","last_peered":"2024-04-12T19:39:17.494704+0000","last_clean":"2024-04-12T19:39:17.494704+0000","last_became_active":"2024-04-12T19:39:11.456714+0000","last_became_peered":"2024-04-12T19:39:11.456714+0000","last_unstale":"2024-04-12T19:39:17.494704+0000","last_undegraded":"2024-04-12T19:39:17.494704+0000","last_fullsized":"2024-04-12T19:39:17.494704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:22:57.956770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489510+0000","last_change":"2024-04-12T19:39:11.456585+0000","last_active":"2024-04-12T19:39:17.489510+0000","last_peered":"2024-04-12T19:39:17.489510+0000","last_clean":"2024-04-12T19:39:17.489510+0000","last_became_active":"2024-04-12T19:39:11.453931+0000","last_became_peered":"2024-04-12T19:39:11.453931+0000","last_unstale":"2024-04-12T19:39:17.489510+0000","last_undegraded":"2024-04-12T19:39:17.489510+0000","last_fullsized":"2024-04-12T19:39:17.489510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103665+0000","last_change":"2024-04-12T19:39:11.445513+0000","last_active":"2024-04-12T19:39:18.103665+0000","last_peered":"2024-04-12T19:39:18.103665+0000","last_clean":"2024-04-12T19:39:18.103665+0000","last_became_active":"2024-04-12T19:39:11.445149+0000","last_became_peered":"2024-04-12T19:39:11.445149+0000","last_unstale":"2024-04-12T19:39:18.103665+0000","last_undegraded":"2024-04-12T19:39:18.103665+0000","last_fullsized":"2024-04-12T19:39:18.103665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585076+0000","last_change":"2024-04-12T19:39:11.457130+0000","last_active":"2024-04-12T19:39:18.585076+0000","last_peered":"2024-04-12T19:39:18.585076+0000","last_clean":"2024-04-12T19:39:18.585076+0000","last_became_active":"2024-04-12T19:39:11.456787+0000","last_became_peered":"2024-04-12T19:39:11.456787+0000","last_unstale":"2024-04-12T19:39:18.585076+0000","last_undegraded":"2024-04-12T19:39:18.585076+0000","last_fullsized":"2024-04-12T19:39:18.585076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488357+0000","last_change":"2024-04-12T19:39:11.474356+0000","last_active":"2024-04-12T19:39:17.488357+0000","last_peered":"2024-04-12T19:39:17.488357+0000","last_clean":"2024-04-12T19:39:17.488357+0000","last_became_active":"2024-04-12T19:39:11.474021+0000","last_became_peered":"2024-04-12T19:39:11.474021+0000","last_unstale":"2024-04-12T19:39:17.488357+0000","last_undegraded":"2024-04-12T19:39:17.488357+0000","last_fullsized":"2024-04-12T19:39:17.488357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491247+0000","last_change":"2024-04-12T19:39:11.472738+0000","last_active":"2024-04-12T19:39:17.491247+0000","last_peered":"2024-04-12T19:39:17.491247+0000","last_clean":"2024-04-12T19:39:17.491247+0000","last_became_active":"2024-04-12T19:39:11.472424+0000","last_became_peered":"2024-04-12T19:39:11.472424+0000","last_unstale":"2024-04-12T19:39:17.491247+0000","last_undegraded":"2024-04-12T19:39:17.491247+0000","last_fullsized":"2024-04-12T19:39:17.491247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:32.845169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174515+0000","last_change":"2024-04-12T19:39:11.468484+0000","last_active":"2024-04-12T19:39:18.174515+0000","last_peered":"2024-04-12T19:39:18.174515+0000","last_clean":"2024-04-12T19:39:18.174515+0000","last_became_active":"2024-04-12T19:39:11.468078+0000","last_became_peered":"2024-04-12T19:39:11.468078+0000","last_unstale":"2024-04-12T19:39:18.174515+0000","last_undegraded":"2024-04-12T19:39:18.174515+0000","last_fullsized":"2024-04-12T19:39:18.174515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175012+0000","last_change":"2024-04-12T19:39:11.470836+0000","last_active":"2024-04-12T19:39:18.175012+0000","last_peered":"2024-04-12T19:39:18.175012+0000","last_clean":"2024-04-12T19:39:18.175012+0000","last_became_active":"2024-04-12T19:39:11.470569+0000","last_became_peered":"2024-04-12T19:39:11.470569+0000","last_unstale":"2024-04-12T19:39:18.175012+0000","last_undegraded":"2024-04-12T19:39:18.175012+0000","last_fullsized":"2024-04-12T19:39:18.175012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495253+0000","last_change":"2024-04-12T19:39:11.479266+0000","last_active":"2024-04-12T19:39:18.495253+0000","last_peered":"2024-04-12T19:39:18.495253+0000","last_clean":"2024-04-12T19:39:18.495253+0000","last_became_active":"2024-04-12T19:39:11.479025+0000","last_became_peered":"2024-04-12T19:39:11.479025+0000","last_unstale":"2024-04-12T19:39:18.495253+0000","last_undegraded":"2024-04-12T19:39:18.495253+0000","last_fullsized":"2024-04-12T19:39:18.495253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:26.512414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487468+0000","last_change":"2024-04-12T19:39:11.477102+0000","last_active":"2024-04-12T19:39:17.487468+0000","last_peered":"2024-04-12T19:39:17.487468+0000","last_clean":"2024-04-12T19:39:17.487468+0000","last_became_active":"2024-04-12T19:39:11.476734+0000","last_became_peered":"2024-04-12T19:39:11.476734+0000","last_unstale":"2024-04-12T19:39:17.487468+0000","last_undegraded":"2024-04-12T19:39:17.487468+0000","last_fullsized":"2024-04-12T19:39:17.487468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:10:44.776087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493741+0000","last_change":"2024-04-12T19:39:11.457154+0000","last_active":"2024-04-12T19:39:18.493741+0000","last_peered":"2024-04-12T19:39:18.493741+0000","last_clean":"2024-04-12T19:39:18.493741+0000","last_became_active":"2024-04-12T19:39:11.456829+0000","last_became_peered":"2024-04-12T19:39:11.456829+0000","last_unstale":"2024-04-12T19:39:18.493741+0000","last_undegraded":"2024-04-12T19:39:18.493741+0000","last_fullsized":"2024-04-12T19:39:18.493741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:40:00.108398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490869+0000","last_change":"2024-04-12T19:39:11.457995+0000","last_active":"2024-04-12T19:39:17.490869+0000","last_peered":"2024-04-12T19:39:17.490869+0000","last_clean":"2024-04-12T19:39:17.490869+0000","last_became_active":"2024-04-12T19:39:11.457611+0000","last_became_peered":"2024-04-12T19:39:11.457611+0000","last_unstale":"2024-04-12T19:39:17.490869+0000","last_undegraded":"2024-04-12T19:39:17.490869+0000","last_fullsized":"2024-04-12T19:39:17.490869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:10:23.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493427+0000","last_change":"2024-04-12T19:39:11.458277+0000","last_active":"2024-04-12T19:39:18.493427+0000","last_peered":"2024-04-12T19:39:18.493427+0000","last_clean":"2024-04-12T19:39:18.493427+0000","last_became_active":"2024-04-12T19:39:11.457957+0000","last_became_peered":"2024-04-12T19:39:11.457957+0000","last_unstale":"2024-04-12T19:39:18.493427+0000","last_undegraded":"2024-04-12T19:39:18.493427+0000","last_fullsized":"2024-04-12T19:39:18.493427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:13:56.992995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493124+0000","last_change":"2024-04-12T19:39:11.479162+0000","last_active":"2024-04-12T19:39:17.493124+0000","last_peered":"2024-04-12T19:39:17.493124+0000","last_clean":"2024-04-12T19:39:17.493124+0000","last_became_active":"2024-04-12T19:39:11.478748+0000","last_became_peered":"2024-04-12T19:39:11.478748+0000","last_unstale":"2024-04-12T19:39:17.493124+0000","last_undegraded":"2024-04-12T19:39:17.493124+0000","last_fullsized":"2024-04-12T19:39:17.493124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:13:56.992995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585351+0000","last_change":"2024-04-12T19:39:11.459392+0000","last_active":"2024-04-12T19:39:18.585351+0000","last_peered":"2024-04-12T19:39:18.585351+0000","last_clean":"2024-04-12T19:39:18.585351+0000","last_became_active":"2024-04-12T19:39:11.459080+0000","last_became_peered":"2024-04-12T19:39:11.459080+0000","last_unstale":"2024-04-12T19:39:18.585351+0000","last_undegraded":"2024-04-12T19:39:18.585351+0000","last_fullsized":"2024-04-12T19:39:18.585351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104633+0000","last_change":"2024-04-12T19:39:11.455201+0000","last_active":"2024-04-12T19:39:18.104633+0000","last_peered":"2024-04-12T19:39:18.104633+0000","last_clean":"2024-04-12T19:39:18.104633+0000","last_became_active":"2024-04-12T19:39:11.454864+0000","last_became_peered":"2024-04-12T19:39:11.454864+0000","last_unstale":"2024-04-12T19:39:18.104633+0000","last_undegraded":"2024-04-12T19:39:18.104633+0000","last_fullsized":"2024-04-12T19:39:18.104633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494971+0000","last_change":"2024-04-12T19:39:11.477240+0000","last_active":"2024-04-12T19:39:18.494971+0000","last_peered":"2024-04-12T19:39:18.494971+0000","last_clean":"2024-04-12T19:39:18.494971+0000","last_became_active":"2024-04-12T19:39:11.476955+0000","last_became_peered":"2024-04-12T19:39:11.476955+0000","last_unstale":"2024-04-12T19:39:18.494971+0000","last_undegraded":"2024-04-12T19:39:18.494971+0000","last_fullsized":"2024-04-12T19:39:18.494971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:09.267564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":703014,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":115906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":112154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":112190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":115906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574856,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":112064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":112224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":703070,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-12T19:39:39.989 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-12T19:39:39.989 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-12T19:39:39.989 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-12T19:39:39.989 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-12T19:39:39.989 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-12T19:39:40.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.228+0000 7f5f13e00640 1 Processor -- start 2024-04-12T19:39:40.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.228+0000 7f5f13e00640 1 -- start start 2024-04-12T19:39:40.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.229+0000 7f5f13e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5f0c14ec10 0x7f5f0c0c5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.229+0000 7f5f13e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f0c0c5c90 0x7f5f0c1517b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.229+0000 7f5f13e00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f0c152180 con 0x7f5f0c151cf0 2024-04-12T19:39:40.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.229+0000 7f5f13e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f5f0c1512b0 con 0x7f5f0c14ec10 2024-04-12T19:39:40.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.229+0000 7f5f13e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0c06c3e0 con 0x7f5f0c0c5c90 2024-04-12T19:39:40.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.230+0000 7f5f11400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5f0c14ec10 0x7f5f0c0c5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:40.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.230+0000 7f5f11400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5f0c14ec10 0x7f5f0c0c5750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41066/0 (socket says 172.21.15.131:41066) 2024-04-12T19:39:40.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.230+0000 7f5f11400640 1 -- 172.21.15.131:0/1716255349 learned_addr learned my addr 172.21.15.131:0/1716255349 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:40.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.230+0000 7f5f11400640 1 -- 172.21.15.131:0/1716255349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f0c0c5c90 msgr2=0x7f5f0c1517b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:40.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.230+0000 7f5f11400640 1 --2- 172.21.15.131:0/1716255349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f0c0c5c90 0x7f5f0c1517b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.230+0000 7f5f11400640 1 -- 172.21.15.131:0/1716255349 >> v1:172.21.15.171:6789/0 conn(0x7f5f0c151cf0 legacy=0x7f5f0c154820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:40.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.230+0000 7f5f11400640 1 -- 172.21.15.131:0/1716255349 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0c06cff0 con 0x7f5f0c14ec10 2024-04-12T19:39:40.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.231+0000 7f5f11400640 1 --2- 172.21.15.131:0/1716255349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f0c14ec10 0x7f5f0c0c5750 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009870 tx=0x7f5f0002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbea464d33b5cf71 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:40.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.231+0000 7f5f0be00640 1 -- 172.21.15.131:0/1716255349 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f00035020 con 0x7f5f0c14ec10 2024-04-12T19:39:40.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.231+0000 7f5f0be00640 1 -- 172.21.15.131:0/1716255349 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f00031640 con 0x7f5f0c14ec10 2024-04-12T19:39:40.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.231+0000 7f5f0be00640 1 -- 172.21.15.131:0/1716255349 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f0002d040 con 0x7f5f0c14ec10 2024-04-12T19:39:40.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.232+0000 7f5f13e00640 1 -- 172.21.15.131:0/1716255349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f0c14ec10 msgr2=0x7f5f0c0c5750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:40.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.232+0000 7f5f13e00640 1 --2- 172.21.15.131:0/1716255349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f0c14ec10 0x7f5f0c0c5750 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5f00009870 tx=0x7f5f0002b8f0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.232+0000 7f5f13e00640 1 -- 172.21.15.131:0/1716255349 shutdown_connections 2024-04-12T19:39:40.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.232+0000 7f5f13e00640 1 --2- 172.21.15.131:0/1716255349 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f0c0c5c90 0x7f5f0c1517b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.232+0000 7f5f13e00640 1 --2- 172.21.15.131:0/1716255349 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f0c14ec10 0x7f5f0c0c5750 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.232+0000 7f5f13e00640 1 -- 172.21.15.131:0/1716255349 >> 172.21.15.131:0/1716255349 conn(0x7f5f0c0c32c0 msgr2=0x7f5f0c0c36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:40.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.232+0000 7f5f13e00640 1 -- 172.21.15.131:0/1716255349 shutdown_connections 2024-04-12T19:39:40.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.232+0000 7f5f13e00640 1 -- 172.21.15.131:0/1716255349 wait complete. 2024-04-12T19:39:40.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.234+0000 7f5f13e00640 1 Processor -- start 2024-04-12T19:39:40.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.234+0000 7f5f13e00640 1 -- start start 2024-04-12T19:39:40.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.234+0000 7f5f13e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f0c0c5c90 0x7f5f0c0a79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.234+0000 7f5f13e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f0c14ec10 0x7f5f0c1e77a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.234+0000 7f5f13e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f0c151cf0 0x7f5f0c0bc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f13e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0c06c020 con 0x7f5f0c151cf0 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f13e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5f0c073840 con 0x7f5f0c14ec10 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f13e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5f0c06c1a0 con 0x7f5f0c0c5c90 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f11e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f0c151cf0 0x7f5f0c0bc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f11e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f0c151cf0 0x7f5f0c0bc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41076/0 (socket says 172.21.15.131:41076) 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f11e00640 1 -- 172.21.15.131:0/1467328829 learned_addr learned my addr 172.21.15.131:0/1467328829 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f11400640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f0c0c5c90 0x7f5f0c0a79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f11e00640 1 -- 172.21.15.131:0/1467328829 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f0c0c5c90 msgr2=0x7f5f0c0a79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f11e00640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f0c0c5c90 0x7f5f0c0a79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f10a00640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f0c14ec10 0x7f5f0c1e77a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f11e00640 1 -- 172.21.15.131:0/1467328829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f0c14ec10 msgr2=0x7f5f0c1e77a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f11e00640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f0c14ec10 0x7f5f0c1e77a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f11e00640 1 -- 172.21.15.131:0/1467328829 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f0c0a7f20 con 0x7f5f0c151cf0 2024-04-12T19:39:40.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.235+0000 7f5f10a00640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f0c14ec10 0x7f5f0c1e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:40.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.236+0000 7f5f11e00640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f0c151cf0 0x7f5f0c0bc400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400b990 tx=0x7f5f0400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:40.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.236+0000 7f5f09600640 1 -- 172.21.15.131:0/1467328829 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f04019070 con 0x7f5f0c151cf0 2024-04-12T19:39:40.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.236+0000 7f5f09600640 1 -- 172.21.15.131:0/1467328829 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5f0400cba0 con 0x7f5f0c151cf0 2024-04-12T19:39:40.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.236+0000 7f5f09600640 1 -- 172.21.15.131:0/1467328829 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f04014440 con 0x7f5f0c151cf0 2024-04-12T19:39:40.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.236+0000 7f5f13e00640 1 -- 172.21.15.131:0/1467328829 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f0c1e7ce0 con 0x7f5f0c151cf0 2024-04-12T19:39:40.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.236+0000 7f5f13e00640 1 -- 172.21.15.131:0/1467328829 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f0c1e6fa0 con 0x7f5f0c151cf0 2024-04-12T19:39:40.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.237+0000 7f5f13e00640 1 -- 172.21.15.131:0/1467328829 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f0c04fd50 con 0x7f5f0c151cf0 2024-04-12T19:39:40.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.238+0000 7f5f09600640 1 -- 172.21.15.131:0/1467328829 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5f0401c070 con 0x7f5f0c151cf0 2024-04-12T19:39:40.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.239+0000 7f5f09600640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5eec06c8f0 0x7f5eec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.239+0000 7f5f09600640 1 -- 172.21.15.131:0/1467328829 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5f0408bc20 con 0x7f5f0c151cf0 2024-04-12T19:39:40.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.240+0000 7f5f11400640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5eec06c8f0 0x7f5eec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:40.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.240+0000 7f5f11400640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5eec06c8f0 0x7f5eec06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f00036000 tx=0x7f5f0003c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:40.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.244+0000 7f5f09600640 1 -- 172.21.15.131:0/1467328829 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5f04059d00 con 0x7f5f0c151cf0 2024-04-12T19:39:40.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.478+0000 7f5f13e00640 1 -- 172.21.15.131:0/1467328829 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f5f0c151850 con 0x7f5f0c151cf0 2024-04-12T19:39:40.486 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.486+0000 7f5f09600640 1 -- 172.21.15.131:0/1467328829 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+174141 (secure 0 0 0) 0x7f5f04059600 con 0x7f5f0c151cf0 2024-04-12T19:39:40.489 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:40.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.490+0000 7f5f13e00640 1 -- 172.21.15.131:0/1467328829 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5eec06c8f0 msgr2=0x7f5eec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:40.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.490+0000 7f5f13e00640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5eec06c8f0 0x7f5eec06edb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5f00036000 tx=0x7f5f0003c040 comp rx=0 tx=0).stop 2024-04-12T19:39:40.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.490+0000 7f5f13e00640 1 -- 172.21.15.131:0/1467328829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f0c151cf0 msgr2=0x7f5f0c0bc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:40.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.490+0000 7f5f13e00640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f0c151cf0 0x7f5f0c0bc400 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5f0400b990 tx=0x7f5f0400be50 comp rx=0 tx=0).stop 2024-04-12T19:39:40.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.491+0000 7f5f13e00640 1 -- 172.21.15.131:0/1467328829 shutdown_connections 2024-04-12T19:39:40.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.491+0000 7f5f13e00640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5eec06c8f0 0x7f5eec06edb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.491+0000 7f5f13e00640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5f0c14ec10 0x7f5f0c1e77a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.491+0000 7f5f13e00640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5f0c151cf0 0x7f5f0c0bc400 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.491+0000 7f5f13e00640 1 --2- 172.21.15.131:0/1467328829 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5f0c0c5c90 0x7f5f0c0a79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.491+0000 7f5f13e00640 1 -- 172.21.15.131:0/1467328829 >> 172.21.15.131:0/1467328829 conn(0x7f5f0c0c32c0 msgr2=0x7f5f0c14a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:40.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.491+0000 7f5f13e00640 1 -- 172.21.15.131:0/1467328829 shutdown_connections 2024-04-12T19:39:40.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.491+0000 7f5f13e00640 1 -- 172.21.15.131:0/1467328829 wait complete. 2024-04-12T19:39:40.508 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":5,"flags":0,"active_gid":4101,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6832","nonce":873500205},{"type":"v1","addr":"172.21.15.131:6833","nonce":873500205}]},"active_addr":"172.21.15.131:6833/873500205","active_change":"2024-04-12T19:38:56.800847+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4111,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":2694913947}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":3930893666}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":3061425993}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.131:0","nonce":1662299366}]}]} 2024-04-12T19:39:40.511 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-12T19:39:40.511 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-12T19:39:40.511 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:40.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.711+0000 7f6a90200640 1 Processor -- start 2024-04-12T19:39:40.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.711+0000 7f6a90200640 1 -- start start 2024-04-12T19:39:40.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.712+0000 7f6a90200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6a88073b90 0x7f6a881547f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.712+0000 7f6a90200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6a88154d30 0x7f6a880b8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.712+0000 7f6a90200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a8806f520 0x7f6a880b8590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a90200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6a880b91b0 con 0x7f6a88073b90 2024-04-12T19:39:40.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a90200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6a88155210 con 0x7f6a88154d30 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a90200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6a881554f0 con 0x7f6a8806f520 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a8d800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6a88073b90 0x7f6a881547f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a8d800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6a88073b90 0x7f6a881547f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41090/0 (socket says 172.21.15.131:41090) 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a8d800640 1 -- 172.21.15.131:0/1734427488 learned_addr learned my addr 172.21.15.131:0/1734427488 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a8e200640 1 --2- 172.21.15.131:0/1734427488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a8806f520 0x7f6a880b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a8ce00640 1 --2- 172.21.15.131:0/1734427488 >> v2:172.21.15.171:3300/0 conn(0x7f6a88154d30 0x7f6a880b8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a8d800640 1 -- 172.21.15.131:0/1734427488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a8806f520 msgr2=0x7f6a880b8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a8d800640 1 --2- 172.21.15.131:0/1734427488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a8806f520 0x7f6a880b8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a8d800640 1 -- 172.21.15.131:0/1734427488 >> v2:172.21.15.171:3300/0 conn(0x7f6a88154d30 msgr2=0x7f6a880b8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a8d800640 1 --2- 172.21.15.131:0/1734427488 >> v2:172.21.15.171:3300/0 conn(0x7f6a88154d30 0x7f6a880b8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a8d800640 1 -- 172.21.15.131:0/1734427488 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a880b8e40 con 0x7f6a88073b90 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a8e200640 1 --2- 172.21.15.131:0/1734427488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a8806f520 0x7f6a880b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:40.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.713+0000 7f6a8ce00640 1 --2- 172.21.15.131:0/1734427488 >> v2:172.21.15.171:3300/0 conn(0x7f6a88154d30 0x7f6a880b8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:40.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.715+0000 7f6a8d800640 1 --2- 172.21.15.131:0/1734427488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88073b90 0x7f6a881547f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6a8806fdf0 tx=0x7f6a7c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acb519f098ab491 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:40.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.715+0000 7f6a87e00640 1 -- 172.21.15.131:0/1734427488 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c035020 con 0x7f6a88073b90 2024-04-12T19:39:40.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.715+0000 7f6a87e00640 1 -- 172.21.15.131:0/1734427488 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a7c031870 con 0x7f6a88073b90 2024-04-12T19:39:40.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.715+0000 7f6a87e00640 1 -- 172.21.15.131:0/1734427488 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c031c40 con 0x7f6a88073b90 2024-04-12T19:39:40.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.716+0000 7f6a90200640 1 -- 172.21.15.131:0/1734427488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88073b90 msgr2=0x7f6a881547f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:40.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.716+0000 7f6a90200640 1 --2- 172.21.15.131:0/1734427488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88073b90 0x7f6a881547f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6a8806fdf0 tx=0x7f6a7c02b910 comp rx=0 tx=0).stop 2024-04-12T19:39:40.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.716+0000 7f6a90200640 1 -- 172.21.15.131:0/1734427488 shutdown_connections 2024-04-12T19:39:40.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.716+0000 7f6a90200640 1 --2- 172.21.15.131:0/1734427488 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a8806f520 0x7f6a880b8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.716+0000 7f6a90200640 1 --2- 172.21.15.131:0/1734427488 >> v2:172.21.15.171:3300/0 conn(0x7f6a88154d30 0x7f6a880b8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.716+0000 7f6a90200640 1 --2- 172.21.15.131:0/1734427488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88073b90 0x7f6a881547f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.716+0000 7f6a90200640 1 -- 172.21.15.131:0/1734427488 >> 172.21.15.131:0/1734427488 conn(0x7f6a880c2590 msgr2=0x7f6a880c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:40.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.716+0000 7f6a90200640 1 -- 172.21.15.131:0/1734427488 shutdown_connections 2024-04-12T19:39:40.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.716+0000 7f6a90200640 1 -- 172.21.15.131:0/1734427488 wait complete. 2024-04-12T19:39:40.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.718+0000 7f6a90200640 1 Processor -- start 2024-04-12T19:39:40.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.718+0000 7f6a90200640 1 -- start start 2024-04-12T19:39:40.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a90200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a8806f520 0x7f6a881ea560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a90200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88073b90 0x7f6a881dc570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a90200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a88154d30 0x7f6a88143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a90200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6a880bee70 con 0x7f6a88073b90 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a90200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6a880becf0 con 0x7f6a8806f520 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a90200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6a880a50a0 con 0x7f6a88154d30 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a8ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88073b90 0x7f6a881dc570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a8ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88073b90 0x7f6a881dc570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41092/0 (socket says 172.21.15.131:41092) 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a8ce00640 1 -- 172.21.15.131:0/822382059 learned_addr learned my addr 172.21.15.131:0/822382059 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a8d800640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a8806f520 0x7f6a881ea560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a8e200640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a88154d30 0x7f6a88143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a8ce00640 1 -- 172.21.15.131:0/822382059 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a88154d30 msgr2=0x7f6a88143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.719+0000 7f6a8ce00640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a88154d30 0x7f6a88143360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.720+0000 7f6a8ce00640 1 -- 172.21.15.131:0/822382059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a8806f520 msgr2=0x7f6a881ea560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.720+0000 7f6a8ce00640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a8806f520 0x7f6a881ea560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.720+0000 7f6a8ce00640 1 -- 172.21.15.131:0/822382059 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a881eaaa0 con 0x7f6a88073b90 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.720+0000 7f6a8d800640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a8806f520 0x7f6a881ea560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:40.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.720+0000 7f6a8ce00640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88073b90 0x7f6a881dc570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400c820 tx=0x7f6a7400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:40.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.720+0000 7f6a85600640 1 -- 172.21.15.131:0/822382059 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74015070 con 0x7f6a88073b90 2024-04-12T19:39:40.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.720+0000 7f6a85600640 1 -- 172.21.15.131:0/822382059 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a74007a30 con 0x7f6a88073b90 2024-04-12T19:39:40.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.720+0000 7f6a85600640 1 -- 172.21.15.131:0/822382059 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a74007e00 con 0x7f6a88073b90 2024-04-12T19:39:40.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.720+0000 7f6a90200640 1 -- 172.21.15.131:0/822382059 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a88147150 con 0x7f6a88073b90 2024-04-12T19:39:40.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.720+0000 7f6a90200640 1 -- 172.21.15.131:0/822382059 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a881eaff0 con 0x7f6a88073b90 2024-04-12T19:39:40.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.721+0000 7f6a90200640 1 -- 172.21.15.131:0/822382059 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a880bffa0 con 0x7f6a88073b90 2024-04-12T19:39:40.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.722+0000 7f6a85600640 1 -- 172.21.15.131:0/822382059 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6a74018070 con 0x7f6a88073b90 2024-04-12T19:39:40.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.723+0000 7f6a85600640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6a6806c920 0x7f6a6806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:40.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.723+0000 7f6a85600640 1 -- 172.21.15.131:0/822382059 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6a7408bde0 con 0x7f6a88073b90 2024-04-12T19:39:40.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.723+0000 7f6a8d800640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6a6806c920 0x7f6a6806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:40.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.724+0000 7f6a8d800640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6a6806c920 0x7f6a6806ede0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c036000 tx=0x7f6a7c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:40.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.728+0000 7f6a85600640 1 -- 172.21.15.131:0/822382059 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6a880bffa0 con 0x7f6a88073b90 2024-04-12T19:39:40.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.929+0000 7f6a90200640 1 -- 172.21.15.131:0/822382059 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6a881eb1f0 con 0x7f6a88073b90 2024-04-12T19:39:40.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.931+0000 7f6a85600640 1 -- 172.21.15.131:0/822382059 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f6a74059ed0 con 0x7f6a88073b90 2024-04-12T19:39:40.931 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:40.931 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":26,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:17.479662+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:40.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.933+0000 7f6a90200640 1 -- 172.21.15.131:0/822382059 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6a6806c920 msgr2=0x7f6a6806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:40.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.933+0000 7f6a90200640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6a6806c920 0x7f6a6806ede0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c036000 tx=0x7f6a7c008030 comp rx=0 tx=0).stop 2024-04-12T19:39:40.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.933+0000 7f6a90200640 1 -- 172.21.15.131:0/822382059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88073b90 msgr2=0x7f6a881dc570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:40.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.933+0000 7f6a90200640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88073b90 0x7f6a881dc570 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6a7400c820 tx=0x7f6a7400cc20 comp rx=0 tx=0).stop 2024-04-12T19:39:40.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.933+0000 7f6a90200640 1 -- 172.21.15.131:0/822382059 shutdown_connections 2024-04-12T19:39:40.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.933+0000 7f6a90200640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6a6806c920 0x7f6a6806ede0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.933+0000 7f6a90200640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6a88154d30 0x7f6a88143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.933+0000 7f6a90200640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a88073b90 0x7f6a881dc570 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.933+0000 7f6a90200640 1 --2- 172.21.15.131:0/822382059 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6a8806f520 0x7f6a881ea560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:40.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.933+0000 7f6a90200640 1 -- 172.21.15.131:0/822382059 >> 172.21.15.131:0/822382059 conn(0x7f6a880c2590 msgr2=0x7f6a880c0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:40.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.934+0000 7f6a90200640 1 -- 172.21.15.131:0/822382059 shutdown_connections 2024-04-12T19:39:40.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:40.934+0000 7f6a90200640 1 -- 172.21.15.131:0/822382059 wait complete. 2024-04-12T19:39:40.951 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-12T19:39:40.951 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:41.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.159+0000 7f17e7c00640 1 Processor -- start 2024-04-12T19:39:41.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.159+0000 7f17e7c00640 1 -- start start 2024-04-12T19:39:41.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.160+0000 7f17e7c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f17e00a8120 0x7f17e00728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.160+0000 7f17e7c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17e00a4e60 0x7f17e0159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.160+0000 7f17e7c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17e01531a0 con 0x7f17e00a8500 2024-04-12T19:39:41.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.160+0000 7f17e7c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f17e0153680 con 0x7f17e00a8120 2024-04-12T19:39:41.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.160+0000 7f17e7c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f17e0071df0 con 0x7f17e00a4e60 2024-04-12T19:39:41.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.161+0000 7f17e5200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f17e00a8120 0x7f17e00728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.161+0000 7f17e5200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f17e00a8120 0x7f17e00728d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41098/0 (socket says 172.21.15.131:41098) 2024-04-12T19:39:41.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.161+0000 7f17e5200640 1 -- 172.21.15.131:0/567823356 learned_addr learned my addr 172.21.15.131:0/567823356 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.161+0000 7f17e5200640 1 -- 172.21.15.131:0/567823356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17e00a4e60 msgr2=0x7f17e0159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:41.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.161+0000 7f17e5200640 1 --2- 172.21.15.131:0/567823356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17e00a4e60 0x7f17e0159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.161+0000 7f17e5200640 1 -- 172.21.15.131:0/567823356 >> v1:172.21.15.171:6789/0 conn(0x7f17e00a8500 legacy=0x7f17e01526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:41.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.161+0000 7f17e5200640 1 -- 172.21.15.131:0/567823356 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e00720d0 con 0x7f17e00a8120 2024-04-12T19:39:41.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.162+0000 7f17e5200640 1 --2- 172.21.15.131:0/567823356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17e00a8120 0x7f17e00728d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17d4009870 tx=0x7f17d402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceff6a4a893c3dda server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.162+0000 7f17df400640 1 -- 172.21.15.131:0/567823356 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4035020 con 0x7f17e00a8120 2024-04-12T19:39:41.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.162+0000 7f17df400640 1 -- 172.21.15.131:0/567823356 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d4031870 con 0x7f17e00a8120 2024-04-12T19:39:41.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.163+0000 7f17df400640 1 -- 172.21.15.131:0/567823356 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4031c40 con 0x7f17e00a8120 2024-04-12T19:39:41.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.163+0000 7f17e7c00640 1 -- 172.21.15.131:0/567823356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17e00a8120 msgr2=0x7f17e00728d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.163+0000 7f17e7c00640 1 --2- 172.21.15.131:0/567823356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17e00a8120 0x7f17e00728d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f17d4009870 tx=0x7f17d402b910 comp rx=0 tx=0).stop 2024-04-12T19:39:41.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.163+0000 7f17e7c00640 1 -- 172.21.15.131:0/567823356 shutdown_connections 2024-04-12T19:39:41.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.163+0000 7f17e7c00640 1 --2- 172.21.15.131:0/567823356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17e00a4e60 0x7f17e0159a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.163+0000 7f17e7c00640 1 --2- 172.21.15.131:0/567823356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17e00a8120 0x7f17e00728d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.163+0000 7f17e7c00640 1 -- 172.21.15.131:0/567823356 >> 172.21.15.131:0/567823356 conn(0x7f17e00c2590 msgr2=0x7f17e00c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.163+0000 7f17e7c00640 1 -- 172.21.15.131:0/567823356 shutdown_connections 2024-04-12T19:39:41.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.163+0000 7f17e7c00640 1 -- 172.21.15.131:0/567823356 wait complete. 2024-04-12T19:39:41.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.165+0000 7f17e7c00640 1 Processor -- start 2024-04-12T19:39:41.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.165+0000 7f17e7c00640 1 -- start start 2024-04-12T19:39:41.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.166+0000 7f17e7c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17e00a4e60 0x7f17e01d8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.166+0000 7f17e7c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17e00a8120 0x7f17e0142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.166+0000 7f17e7c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17e00a8500 0x7f17e0142d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.166+0000 7f17e7c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f17e006d970 con 0x7f17e00a8120 2024-04-12T19:39:41.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.166+0000 7f17e7c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f17e0072e10 con 0x7f17e00a8500 2024-04-12T19:39:41.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.166+0000 7f17e7c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f17e0152e00 con 0x7f17e00a4e60 2024-04-12T19:39:41.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.166+0000 7f17dfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17e00a8120 0x7f17e0142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.166+0000 7f17dfe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17e00a8120 0x7f17e0142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41106/0 (socket says 172.21.15.131:41106) 2024-04-12T19:39:41.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.166+0000 7f17dfe00640 1 -- 172.21.15.131:0/1129931217 learned_addr learned my addr 172.21.15.131:0/1129931217 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.167+0000 7f17e5200640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17e00a4e60 0x7f17e01d8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.167+0000 7f17e5c00640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17e00a8500 0x7f17e0142d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.167+0000 7f17dfe00640 1 -- 172.21.15.131:0/1129931217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17e00a4e60 msgr2=0x7f17e01d8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.167+0000 7f17dfe00640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17e00a4e60 0x7f17e01d8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.167+0000 7f17dfe00640 1 -- 172.21.15.131:0/1129931217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17e00a8500 msgr2=0x7f17e0142d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.167+0000 7f17dfe00640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17e00a8500 0x7f17e0142d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.167+0000 7f17dfe00640 1 -- 172.21.15.131:0/1129931217 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17e01d8db0 con 0x7f17e00a8120 2024-04-12T19:39:41.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.167+0000 7f17dfe00640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17e00a8120 0x7f17e0142810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00b3f0 tx=0x7f17cc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.167+0000 7f17dcc00640 1 -- 172.21.15.131:0/1129931217 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc015020 con 0x7f17e00a8120 2024-04-12T19:39:41.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.167+0000 7f17dcc00640 1 -- 172.21.15.131:0/1129931217 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17cc011830 con 0x7f17e00a8120 2024-04-12T19:39:41.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.167+0000 7f17dcc00640 1 -- 172.21.15.131:0/1129931217 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc011c00 con 0x7f17e00a8120 2024-04-12T19:39:41.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.167+0000 7f17e7c00640 1 -- 172.21.15.131:0/1129931217 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17e0144dd0 con 0x7f17e00a8120 2024-04-12T19:39:41.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.168+0000 7f17e7c00640 1 -- 172.21.15.131:0/1129931217 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17e0145390 con 0x7f17e00a8120 2024-04-12T19:39:41.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.169+0000 7f17e7c00640 1 -- 172.21.15.131:0/1129931217 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17e0073bd0 con 0x7f17e00a8120 2024-04-12T19:39:41.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.170+0000 7f17dcc00640 1 -- 172.21.15.131:0/1129931217 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f17cc018020 con 0x7f17e00a8120 2024-04-12T19:39:41.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.171+0000 7f17dcc00640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f17c006c920 0x7f17c006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.171+0000 7f17dcc00640 1 -- 172.21.15.131:0/1129931217 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f17cc08b760 con 0x7f17e00a8120 2024-04-12T19:39:41.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.171+0000 7f17e5200640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f17c006c920 0x7f17c006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.172+0000 7f17e5200640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f17c006c920 0x7f17c006ede0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17d4036000 tx=0x7f17d403c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.176+0000 7f17dcc00640 1 -- 172.21.15.131:0/1129931217 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f17e0073bd0 con 0x7f17e00a8120 2024-04-12T19:39:41.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.377+0000 7f17e7c00640 1 -- 172.21.15.131:0/1129931217 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17e01495a0 con 0x7f17e00a8120 2024-04-12T19:39:41.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.378+0000 7f17dcc00640 1 -- 172.21.15.131:0/1129931217 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f17e01495a0 con 0x7f17e00a8120 2024-04-12T19:39:41.379 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:41.379 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":26,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:17.479662+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:41.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.381+0000 7f17e7c00640 1 -- 172.21.15.131:0/1129931217 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f17c006c920 msgr2=0x7f17c006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.381+0000 7f17e7c00640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f17c006c920 0x7f17c006ede0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f17d4036000 tx=0x7f17d403c040 comp rx=0 tx=0).stop 2024-04-12T19:39:41.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.381+0000 7f17e7c00640 1 -- 172.21.15.131:0/1129931217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17e00a8120 msgr2=0x7f17e0142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.381+0000 7f17e7c00640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17e00a8120 0x7f17e0142810 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00b3f0 tx=0x7f17cc00b8b0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.381+0000 7f17e7c00640 1 -- 172.21.15.131:0/1129931217 shutdown_connections 2024-04-12T19:39:41.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.381+0000 7f17e7c00640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f17c006c920 0x7f17c006ede0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.381+0000 7f17e7c00640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f17e00a8500 0x7f17e0142d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.381+0000 7f17e7c00640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f17e00a8120 0x7f17e0142810 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.381+0000 7f17e7c00640 1 --2- 172.21.15.131:0/1129931217 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f17e00a4e60 0x7f17e01d8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.381+0000 7f17e7c00640 1 -- 172.21.15.131:0/1129931217 >> 172.21.15.131:0/1129931217 conn(0x7f17e00c2590 msgr2=0x7f17e00c2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.382+0000 7f17e7c00640 1 -- 172.21.15.131:0/1129931217 shutdown_connections 2024-04-12T19:39:41.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.382+0000 7f17e7c00640 1 -- 172.21.15.131:0/1129931217 wait complete. 2024-04-12T19:39:41.398 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-12T19:39:41.398 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-12T19:39:41.399 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-12T19:39:41.399 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-12T19:39:41.399 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-12T19:39:41.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-12T19:39:41.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-12T19:39:41.400 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-12T19:39:41.693 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.693+0000 7feb37800640 1 Processor -- start 2024-04-12T19:39:41.694 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.691+0000 7f9d14e00640 1 Processor -- start 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.692+0000 7f9d14e00640 1 -- start start 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.693+0000 7f9d14e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9d1006e6b0 0x7f9d10155d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.693+0000 7f9d14e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d100bd630 0x7f9d100bda90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.693+0000 7f9d14e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9d100b8570 0x7f9d100b89c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.693+0000 7f9d14e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9d100bdfd0 con 0x7f9d1006e6b0 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.693+0000 7f9d14e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9d100bec70 con 0x7f9d100b8570 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.693+0000 7f9d14e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9d100be6b0 con 0x7f9d100bd630 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.694+0000 7f9d0de00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9d1006e6b0 0x7f9d10155d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.694+0000 7f9d0de00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f9d1006e6b0 0x7f9d10155d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41108/0 (socket says 172.21.15.131:41108) 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.694+0000 7f9d0de00640 1 -- 172.21.15.131:0/1617929456 learned_addr learned my addr 172.21.15.131:0/1617929456 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.694+0000 7f9d0d400640 1 --2- 172.21.15.131:0/1617929456 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d100bd630 0x7f9d100bda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.695+0000 7f9d0de00640 1 -- 172.21.15.131:0/1617929456 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d100bd630 msgr2=0x7f9d100bda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.695+0000 7f9d0e800640 1 --2- 172.21.15.131:0/1617929456 >> v2:172.21.15.171:3300/0 conn(0x7f9d100b8570 0x7f9d100b89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.695 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.695+0000 7f9d0de00640 1 --2- 172.21.15.131:0/1617929456 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d100bd630 0x7f9d100bda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.695+0000 7f9d0de00640 1 -- 172.21.15.131:0/1617929456 >> v2:172.21.15.171:3300/0 conn(0x7f9d100b8570 msgr2=0x7f9d100b89c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:41.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.693+0000 7feb37800640 1 -- start start 2024-04-12T19:39:41.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.694+0000 7feb37800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7feb28007430 0x7feb280cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.694+0000 7feb37800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb280d6470 0x7feb280301e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.694+0000 7feb37800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb28046570 con 0x7feb280cff00 2024-04-12T19:39:41.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.694+0000 7feb37800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7feb280460e0 con 0x7feb28007430 2024-04-12T19:39:41.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.694+0000 7feb37800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feb280497e0 con 0x7feb280d6470 2024-04-12T19:39:41.696 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.695+0000 7f9d0de00640 1 --2- 172.21.15.131:0/1617929456 >> v2:172.21.15.171:3300/0 conn(0x7f9d100b8570 0x7f9d100b89c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.695+0000 7f9d0de00640 1 -- 172.21.15.131:0/1617929456 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d100be990 con 0x7f9d1006e6b0 2024-04-12T19:39:41.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.695+0000 7f9d0e800640 1 --2- 172.21.15.131:0/1617929456 >> v2:172.21.15.171:3300/0 conn(0x7f9d100b8570 0x7f9d100b89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:41.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.695+0000 7feb35800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb280d6470 0x7feb280301e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.695+0000 7feb34e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7feb28007430 0x7feb280cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.696+0000 7feb2fe00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7feb280cff00 0x7feb2800e940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.131:41240/0 (socket says 172.21.15.131:41240) 2024-04-12T19:39:41.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.696+0000 7feb2fe00640 1 -- 172.21.15.131:0/1123226605 learned_addr learned my addr 172.21.15.131:0/1123226605 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:41.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.696+0000 7feb2f400640 1 -- 172.21.15.131:0/1123226605 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2948679497 0 0) 0x7feb28046570 con 0x7feb280cff00 2024-04-12T19:39:41.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.697+0000 7feb2f400640 1 -- 172.21.15.131:0/1123226605 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb18003520 con 0x7feb280cff00 2024-04-12T19:39:41.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.697+0000 7feb34e00640 1 -- 172.21.15.131:0/1123226605 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb280d6470 msgr2=0x7feb280301e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:41.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.697+0000 7f9d0de00640 1 --2- 172.21.15.131:0/1617929456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d1006e6b0 0x7f9d10155d60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d1006f000 tx=0x7f9d0802bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f70780c23f38834 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.697+0000 7f37f7200640 1 Processor -- start 2024-04-12T19:39:41.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.698+0000 7f37f7200640 1 -- start start 2024-04-12T19:39:41.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.698+0000 7f9d0ca00640 1 -- 172.21.15.131:0/1617929456 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0802caa0 con 0x7f9d1006e6b0 2024-04-12T19:39:41.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.697+0000 7feb34e00640 1 --2- 172.21.15.131:0/1123226605 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb280d6470 0x7feb280301e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.697+0000 7feb34e00640 1 -- 172.21.15.131:0/1123226605 >> v1:172.21.15.171:6789/0 conn(0x7feb280cff00 legacy=0x7feb2800e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.697+0000 7feb34e00640 1 -- 172.21.15.131:0/1123226605 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb28049ac0 con 0x7feb28007430 2024-04-12T19:39:41.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.698+0000 7f9d0ca00640 1 -- 172.21.15.131:0/1617929456 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d0802cc40 con 0x7f9d1006e6b0 2024-04-12T19:39:41.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.698+0000 7f9d0ca00640 1 -- 172.21.15.131:0/1617929456 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d0802caa0 con 0x7f9d1006e6b0 2024-04-12T19:39:41.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f9d14e00640 1 -- 172.21.15.131:0/1617929456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d1006e6b0 msgr2=0x7f9d10155d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f9d14e00640 1 --2- 172.21.15.131:0/1617929456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d1006e6b0 0x7f9d10155d60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f9d1006f000 tx=0x7f9d0802bf00 comp rx=0 tx=0).stop 2024-04-12T19:39:41.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f37f7200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f37f00cf9d0 0x7f37f00cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f37f7200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37f0049040 0x7f37f0049650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f37f7200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f37f004a070 0x7f37f00071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f37f7200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f37f00311f0 con 0x7f37f00cf9d0 2024-04-12T19:39:41.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f37f7200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f37f0049cc0 con 0x7f37f004a070 2024-04-12T19:39:41.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f37f7200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f37f00d5ce0 con 0x7f37f0049040 2024-04-12T19:39:41.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f9d14e00640 1 -- 172.21.15.131:0/1617929456 shutdown_connections 2024-04-12T19:39:41.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f9d14e00640 1 --2- 172.21.15.131:0/1617929456 >> v2:172.21.15.171:3300/0 conn(0x7f9d100b8570 0x7f9d100b89c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f9d14e00640 1 --2- 172.21.15.131:0/1617929456 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d100bd630 0x7f9d100bda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f9d14e00640 1 --2- 172.21.15.131:0/1617929456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d1006e6b0 0x7f9d10155d60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7f9d14e00640 1 -- 172.21.15.131:0/1617929456 >> 172.21.15.131:0/1617929456 conn(0x7f9d100bee90 msgr2=0x7f9d100bf2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.699+0000 7feb34e00640 1 --2- 172.21.15.131:0/1123226605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb28007430 0x7feb280cf9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb240097a0 tx=0x7feb2402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc647bf7607e4a7a server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.700+0000 7feb2f400640 1 -- 172.21.15.131:0/1123226605 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb24035020 con 0x7feb28007430 2024-04-12T19:39:41.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.700+0000 7f37f5400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37f0049040 0x7f37f0049650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.700+0000 7feb2f400640 1 -- 172.21.15.131:0/1123226605 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb24031640 con 0x7feb28007430 2024-04-12T19:39:41.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.700+0000 7feb2f400640 1 -- 172.21.15.131:0/1123226605 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2402d040 con 0x7feb28007430 2024-04-12T19:39:41.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.700+0000 7f37f6800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f37f004a070 0x7f37f00071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.700+0000 7f37f5e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f37f00cf9d0 0x7f37f00cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.700+0000 7f37f6800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f37f004a070 0x7f37f00071b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:34906/0 (socket says 172.21.15.131:34906) 2024-04-12T19:39:41.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.700+0000 7f37f6800640 1 -- 172.21.15.131:0/2636512366 learned_addr learned my addr 172.21.15.131:0/2636512366 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.701+0000 7f37f6800640 1 -- 172.21.15.131:0/2636512366 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37f0049040 msgr2=0x7f37f0049650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:41.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.701+0000 7fb1cda00640 1 Processor -- start 2024-04-12T19:39:41.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.701+0000 7f9d14e00640 1 -- 172.21.15.131:0/1617929456 shutdown_connections 2024-04-12T19:39:41.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.701+0000 7f9d14e00640 1 -- 172.21.15.131:0/1617929456 wait complete. 2024-04-12T19:39:41.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.701+0000 7feb37800640 1 -- 172.21.15.131:0/1123226605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb28007430 msgr2=0x7feb280cf9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.701+0000 7feb37800640 1 --2- 172.21.15.131:0/1123226605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb28007430 0x7feb280cf9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7feb240097a0 tx=0x7feb2402b8f0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.702+0000 7feb37800640 1 -- 172.21.15.131:0/1123226605 shutdown_connections 2024-04-12T19:39:41.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.702+0000 7feb37800640 1 --2- 172.21.15.131:0/1123226605 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb280d6470 0x7feb280301e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.702+0000 7feb37800640 1 --2- 172.21.15.131:0/1123226605 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb28007430 0x7feb280cf9c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.702+0000 7feb37800640 1 -- 172.21.15.131:0/1123226605 >> 172.21.15.131:0/1123226605 conn(0x7feb28047cb0 msgr2=0x7feb280480c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.701+0000 7f37f6800640 1 --2- 172.21.15.131:0/2636512366 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37f0049040 0x7f37f0049650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.701+0000 7f37f6800640 1 -- 172.21.15.131:0/2636512366 >> v2:172.21.15.131:3300/0 conn(0x7f37f00cf9d0 msgr2=0x7f37f00cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:41.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.701+0000 7f37f6800640 1 --2- 172.21.15.131:0/2636512366 >> v2:172.21.15.131:3300/0 conn(0x7f37f00cf9d0 0x7f37f00cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.702+0000 7feb37800640 1 -- 172.21.15.131:0/1123226605 shutdown_connections 2024-04-12T19:39:41.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.702+0000 7feb37800640 1 -- 172.21.15.131:0/1123226605 wait complete. 2024-04-12T19:39:41.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.701+0000 7f37f6800640 1 -- 172.21.15.131:0/2636512366 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f00d5fc0 con 0x7f37f004a070 2024-04-12T19:39:41.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.702+0000 7f37f5400640 1 --2- 172.21.15.131:0/2636512366 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37f0049040 0x7f37f0049650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:41.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.702+0000 7f37f5e00640 1 --2- 172.21.15.131:0/2636512366 >> v2:172.21.15.131:3300/0 conn(0x7f37f00cf9d0 0x7f37f00cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:39:41.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.701+0000 7fb1cda00640 1 -- start start 2024-04-12T19:39:41.706 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.703+0000 7f37f6800640 1 --2- 172.21.15.131:0/2636512366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37f004a070 0x7f37f00071b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f37f806b940 tx=0x7f37f80a7260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=417f37270800300e server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.703+0000 7f9d14e00640 1 Processor -- start 2024-04-12T19:39:41.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.703+0000 7f9d14e00640 1 -- start start 2024-04-12T19:39:41.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.703+0000 7f37f4a00640 1 -- 172.21.15.131:0/2636512366 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80b4070 con 0x7f37f004a070 2024-04-12T19:39:41.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.703+0000 7f37f4a00640 1 -- 172.21.15.131:0/2636512366 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f80af640 con 0x7f37f004a070 2024-04-12T19:39:41.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.703+0000 7f37f4a00640 1 -- 172.21.15.131:0/2636512366 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80afa70 con 0x7f37f004a070 2024-04-12T19:39:41.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.703+0000 7fb1cda00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fb1c80c17a0 0x7fb1c80c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7fb1cda00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c80c5e80 con 0x7fb1c80c3900 2024-04-12T19:39:41.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7fb1cda00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1c80c4020 con 0x7fb1c81511e0 2024-04-12T19:39:41.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7fb1cda00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fb1c80c59f0 con 0x7fb1c80c17a0 2024-04-12T19:39:41.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7f37f7200640 1 -- 172.21.15.131:0/2636512366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37f004a070 msgr2=0x7f37f00071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7f9d14e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d1006e6b0 0x7f9d10156cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7f9d14e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d100b8570 0x7f9d100bac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7f9d14e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d100bd630 0x7f9d10150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7f9d14e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9d100b8f00 con 0x7f9d100bd630 2024-04-12T19:39:41.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7f9d14e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9d100bd110 con 0x7f9d100b8570 2024-04-12T19:39:41.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7f9d14e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9d100a5cf0 con 0x7f9d1006e6b0 2024-04-12T19:39:41.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7f37f7200640 1 --2- 172.21.15.131:0/2636512366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37f004a070 0x7f37f00071b0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f37f806b940 tx=0x7f37f80a7260 comp rx=0 tx=0).stop 2024-04-12T19:39:41.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.705+0000 7f9d0e800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d100bd630 0x7f9d10150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.705+0000 7f9d0e800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d100bd630 0x7f9d10150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41138/0 (socket says 172.21.15.131:41138) 2024-04-12T19:39:41.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.705+0000 7f9d0e800640 1 -- 172.21.15.131:0/1337665136 learned_addr learned my addr 172.21.15.131:0/1337665136 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.705+0000 7f9d0de00640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d1006e6b0 0x7f9d10156cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.703+0000 7f7293e00640 1 Processor -- start 2024-04-12T19:39:41.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.703+0000 7f7293e00640 1 -- start start 2024-04-12T19:39:41.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7fb1c6000640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fb1c81511e0 0x7fb1c80c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.131:41254/0 (socket says 172.21.15.131:41254) 2024-04-12T19:39:41.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.704+0000 7fb1c6000640 1 -- 172.21.15.131:0/230882496 learned_addr learned my addr 172.21.15.131:0/230882496 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:41.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.705+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 56940202 0 0) 0x7fb1c80c4020 con 0x7fb1c81511e0 2024-04-12T19:39:41.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.705+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1ac003520 con 0x7fb1c81511e0 2024-04-12T19:39:41.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f37f7200640 1 -- 172.21.15.131:0/2636512366 shutdown_connections 2024-04-12T19:39:41.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f37f7200640 1 --2- 172.21.15.131:0/2636512366 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37f004a070 0x7f37f00071b0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f37f7200640 1 --2- 172.21.15.131:0/2636512366 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37f0049040 0x7f37f0049650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f37f7200640 1 --2- 172.21.15.131:0/2636512366 >> v2:172.21.15.131:3300/0 conn(0x7f37f00cf9d0 0x7f37f00cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f37f7200640 1 -- 172.21.15.131:0/2636512366 >> 172.21.15.131:0/2636512366 conn(0x7f37f0047cc0 msgr2=0x7f37f00480d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f9d0e800640 1 -- 172.21.15.131:0/1337665136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d1006e6b0 msgr2=0x7f9d10156cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f9d0e800640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9d1006e6b0 0x7f9d10156cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f9d0e800640 1 -- 172.21.15.131:0/1337665136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d100b8570 msgr2=0x7f9d100bac10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-12T19:39:41.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f9d0e800640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9d100b8570 0x7f9d100bac10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f9d0e800640 1 -- 172.21.15.131:0/1337665136 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d100bb150 con 0x7f9d100bd630 2024-04-12T19:39:41.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c6a00640 1 --2- 172.21.15.131:0/230882496 >> v2:172.21.15.131:3300/0 conn(0x7fb1c80c17a0 0x7fb1c80c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f7293e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72940c5870 0x7f729406c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f7293e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72940c1d90 0x7f72940c21d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f7293e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f729406dcf0 0x7f729406e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f7293e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f72940c1340 con 0x7f72940c5870 2024-04-12T19:39:41.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f7293e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f72940c1900 con 0x7f729406dcf0 2024-04-12T19:39:41.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f7293e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f72940c2710 con 0x7f72940c1d90 2024-04-12T19:39:41.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 166383296 0 0) 0x7fb1ac003520 con 0x7fb1c81511e0 2024-04-12T19:39:41.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 >> v2:172.21.15.131:3300/0 conn(0x7fb1c80c17a0 msgr2=0x7fb1c80c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:41.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 --2- 172.21.15.131:0/230882496 >> v2:172.21.15.131:3300/0 conn(0x7fb1c80c17a0 0x7fb1c80c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 >> v1:172.21.15.131:6789/0 conn(0x7fb1c80c3900 legacy=0x7fb1c815ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:41.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c80c6260 con 0x7fb1c81511e0 2024-04-12T19:39:41.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7fb1b4001670 con 0x7fb1c81511e0 2024-04-12T19:39:41.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 >> v1:172.21.15.171:6789/0 conn(0x7fb1c81511e0 legacy=0x7fb1c80c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 --2- 172.21.15.131:0/230882496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ac0039b0 0x7fb1ac003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 --2- 172.21.15.131:0/230882496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1ac004800 0x7fb1ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 --2- 172.21.15.131:0/230882496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac0051c0 0x7fb1ac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c80c59f0 con 0x7fb1ac0039b0 2024-04-12T19:39:41.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ac00c0f0 con 0x7fb1ac0051c0 2024-04-12T19:39:41.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1ac00c2f0 con 0x7fb1ac004800 2024-04-12T19:39:41.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.706+0000 7f7292a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72940c5870 0x7f729406c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7f7292a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72940c5870 0x7f729406c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41148/0 (socket says 172.21.15.131:41148) 2024-04-12T19:39:41.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7f7292a00640 1 -- 172.21.15.131:0/1066984836 learned_addr learned my addr 172.21.15.131:0/1066984836 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.715 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.705+0000 7feb37800640 1 Processor -- start 2024-04-12T19:39:41.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7f37f7200640 1 -- 172.21.15.131:0/2636512366 shutdown_connections 2024-04-12T19:39:41.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7f817ae00640 1 Processor -- start 2024-04-12T19:39:41.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7f7292a00640 1 -- 172.21.15.131:0/1066984836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72940c1d90 msgr2=0x7f72940c21d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-12T19:39:41.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7f7292a00640 1 --2- 172.21.15.131:0/1066984836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72940c1d90 0x7f72940c21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7f7292a00640 1 -- 172.21.15.131:0/1066984836 >> v2:172.21.15.171:3300/0 conn(0x7f729406dcf0 msgr2=0x7f729406e150 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T19:39:41.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7f37f7200640 1 -- 172.21.15.131:0/2636512366 wait complete. 2024-04-12T19:39:41.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7f9d0e800640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d100bd630 0x7f9d10150d20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000afd0 tx=0x7f9d0000ca20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7fb1c6a00640 1 --2- 172.21.15.131:0/230882496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ac0039b0 0x7fb1ac003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7fb1c7400640 1 --2- 172.21.15.131:0/230882496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac0051c0 0x7fb1ac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7fb1c6000640 1 --2- 172.21.15.131:0/230882496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1ac004800 0x7fb1ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.708+0000 7f032a400640 1 Processor -- start 2024-04-12T19:39:41.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.708+0000 7f9d06000640 1 -- 172.21.15.131:0/1337665136 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00015020 con 0x7f9d100bd630 2024-04-12T19:39:41.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.708+0000 7f032a400640 1 -- start start 2024-04-12T19:39:41.719 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.707+0000 7f817ae00640 1 -- start start 2024-04-12T19:39:41.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7fb1c6000640 1 -- 172.21.15.131:0/230882496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac0051c0 msgr2=0x7fb1ac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:41.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7fb1c6000640 1 --2- 172.21.15.131:0/230882496 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac0051c0 0x7fb1ac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7fb1c6000640 1 -- 172.21.15.131:0/230882496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ac0039b0 msgr2=0x7fb1ac003db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:41.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7fb1c6000640 1 --2- 172.21.15.131:0/230882496 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1ac0039b0 0x7fb1ac003db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7fb1c6000640 1 -- 172.21.15.131:0/230882496 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c80c6260 con 0x7fb1ac004800 2024-04-12T19:39:41.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.708+0000 7f7292a00640 1 --2- 172.21.15.131:0/1066984836 >> v2:172.21.15.171:3300/0 conn(0x7f729406dcf0 0x7f729406e150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.708+0000 7f7292a00640 1 -- 172.21.15.131:0/1066984836 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72940c62e0 con 0x7f72940c5870 2024-04-12T19:39:41.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7f9d06000640 1 -- 172.21.15.131:0/1337665136 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d00004440 con 0x7f9d100bd630 2024-04-12T19:39:41.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7f9d06000640 1 -- 172.21.15.131:0/1337665136 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d00003850 con 0x7f9d100bd630 2024-04-12T19:39:41.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.708+0000 7feb37800640 1 -- start start 2024-04-12T19:39:41.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7feb37800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb28007430 0x7feb280d2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7feb37800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280cff00 0x7feb2816eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7feb37800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb280d6470 0x7feb280d0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7feb37800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7feb28007810 con 0x7feb280cff00 2024-04-12T19:39:41.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7feb37800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7feb280310a0 con 0x7feb28007430 2024-04-12T19:39:41.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7feb37800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7feb28007990 con 0x7feb280d6470 2024-04-12T19:39:41.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7f9d14e00640 1 -- 172.21.15.131:0/1337665136 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d10154840 con 0x7f9d100bd630 2024-04-12T19:39:41.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7fb1c7400640 1 -- 172.21.15.131:0/230882496 reap_dead start 2024-04-12T19:39:41.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7f9d14e00640 1 -- 172.21.15.131:0/1337665136 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d10144b70 con 0x7f9d100bd630 2024-04-12T19:39:41.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7feb34e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb28007430 0x7feb280d2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7feb2fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280cff00 0x7feb2816eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7feb2fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280cff00 0x7feb2816eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41166/0 (socket says 172.21.15.131:41166) 2024-04-12T19:39:41.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7feb2fe00640 1 -- 172.21.15.131:0/3129742200 learned_addr learned my addr 172.21.15.131:0/3129742200 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7feb35800640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb280d6470 0x7feb280d0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.725 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7feb2fe00640 1 -- 172.21.15.131:0/3129742200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb280d6470 msgr2=0x7feb280d0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7feb2fe00640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7feb280d6470 0x7feb280d0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7feb2fe00640 1 -- 172.21.15.131:0/3129742200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb28007430 msgr2=0x7feb280d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7feb2fe00640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7feb28007430 0x7feb280d2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7feb2fe00640 1 -- 172.21.15.131:0/3129742200 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb2816f3d0 con 0x7feb280cff00 2024-04-12T19:39:41.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7f7292a00640 1 --2- 172.21.15.131:0/1066984836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72940c5870 0x7f729406c120 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72940685a0 tx=0x7f728402b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d224c76e90b2997c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7f817ae00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f81740bf720 0x7f81740be140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7f817ae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81741598e0 0x7f817415ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7f817ae00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f817406e380 con 0x7f81740a4d60 2024-04-12T19:39:41.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7f817ae00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f817406e660 con 0x7f81740bf720 2024-04-12T19:39:41.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.709+0000 7f817ae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81740bdcb0 con 0x7f81741598e0 2024-04-12T19:39:41.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7f8173400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f81740a4d60 0x7f81741591d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34160/0 (socket says 172.21.15.131:34160) 2024-04-12T19:39:41.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7f8173400640 1 -- 172.21.15.131:0/2394125357 learned_addr learned my addr 172.21.15.131:0/2394125357 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:41.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.711+0000 7feb2fe00640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280cff00 0x7feb2816eb20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feb30063580 tx=0x7feb3006ce80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.711+0000 7f7291600640 1 -- 172.21.15.131:0/1066984836 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7284035020 con 0x7f72940c5870 2024-04-12T19:39:41.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.711+0000 7f7291600640 1 -- 172.21.15.131:0/1066984836 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7284031800 con 0x7f72940c5870 2024-04-12T19:39:41.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.711+0000 7f7291600640 1 -- 172.21.15.131:0/1066984836 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7284031bd0 con 0x7f72940c5870 2024-04-12T19:39:41.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.711+0000 7f8173e00640 1 --2- 172.21.15.131:0/2394125357 >> v2:172.21.15.171:3300/0 conn(0x7f81740bf720 0x7f81740be140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.712+0000 7feb2cc00640 1 -- 172.21.15.131:0/3129742200 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb30094d50 con 0x7feb280cff00 2024-04-12T19:39:41.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7f032a400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03240c2fe0 0x7f03240c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7f032a400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03240bb6f0 con 0x7f03240bb290 2024-04-12T19:39:41.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7f032a400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f032414f9d0 con 0x7f0324157740 2024-04-12T19:39:41.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.710+0000 7f032a400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f03240bae00 con 0x7f03240c2fe0 2024-04-12T19:39:41.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.711+0000 7f0329000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03240c2fe0 0x7f03240c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.711+0000 7f0323e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f03240bb290 0x7f03240c0fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34174/0 (socket says 172.21.15.131:34174) 2024-04-12T19:39:41.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.711+0000 7f0323e00640 1 -- 172.21.15.131:0/1094127548 learned_addr learned my addr 172.21.15.131:0/1094127548 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:41.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.712+0000 7f8178e00640 1 --2- 172.21.15.131:0/2394125357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81741598e0 0x7f817415ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.712+0000 7f8172a00640 1 -- 172.21.15.131:0/2394125357 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2877519631 0 0) 0x7f817406e380 con 0x7f81740a4d60 2024-04-12T19:39:41.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.712+0000 7f8172a00640 1 -- 172.21.15.131:0/2394125357 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8158003520 con 0x7f81740a4d60 2024-04-12T19:39:41.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.712+0000 7f37f7200640 1 Processor -- start 2024-04-12T19:39:41.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.712+0000 7f9d14e00640 1 -- 172.21.15.131:0/1337665136 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9d1004fd50 con 0x7f9d100bd630 2024-04-12T19:39:41.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.712+0000 7feb2cc00640 1 -- 172.21.15.131:0/3129742200 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb3009c400 con 0x7feb280cff00 2024-04-12T19:39:41.731 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.712+0000 7f37f7200640 1 -- start start 2024-04-12T19:39:41.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.712+0000 7feb2cc00640 1 -- 172.21.15.131:0/3129742200 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb30094d50 con 0x7feb280cff00 2024-04-12T19:39:41.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.712+0000 7feb37800640 1 -- 172.21.15.131:0/3129742200 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb2816f6b0 con 0x7feb280cff00 2024-04-12T19:39:41.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.712+0000 7feb37800640 1 -- 172.21.15.131:0/3129742200 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb280d08e0 con 0x7feb280cff00 2024-04-12T19:39:41.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7f0323400640 1 -- 172.21.15.131:0/1094127548 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2820346997 0 0) 0x7f032414f9d0 con 0x7f0324157740 2024-04-12T19:39:41.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7f0323400640 1 -- 172.21.15.131:0/1094127548 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0308003520 con 0x7f0324157740 2024-04-12T19:39:41.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7f0329000640 1 -- 172.21.15.131:0/1094127548 >> v1:172.21.15.171:6789/0 conn(0x7f0324157740 legacy=0x7f0324159b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.732 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7f0329000640 1 -- 172.21.15.131:0/1094127548 >> v1:172.21.15.131:6789/0 conn(0x7f03240bb290 legacy=0x7f03240c0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7f0329000640 1 -- 172.21.15.131:0/1094127548 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f032414fcb0 con 0x7f03240c2fe0 2024-04-12T19:39:41.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7f4451400640 1 Processor -- start 2024-04-12T19:39:41.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7feb37800640 1 -- 172.21.15.131:0/3129742200 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7feb28005380 con 0x7feb280cff00 2024-04-12T19:39:41.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7f8173e00640 1 -- 172.21.15.131:0/2394125357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81741598e0 msgr2=0x7f817415ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:41.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7f8173e00640 1 --2- 172.21.15.131:0/2394125357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81741598e0 0x7f817415ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7f8173e00640 1 -- 172.21.15.131:0/2394125357 >> v1:172.21.15.131:6789/0 conn(0x7f81740a4d60 legacy=0x7f81741591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7f8173e00640 1 -- 172.21.15.131:0/2394125357 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81740bd660 con 0x7f81740bf720 2024-04-12T19:39:41.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.714+0000 7f7293e00640 1 -- 172.21.15.131:0/1066984836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72940c5870 msgr2=0x7f729406c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.714+0000 7f7293e00640 1 --2- 172.21.15.131:0/1066984836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72940c5870 0x7f729406c120 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72940685a0 tx=0x7f728402b8a0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7f4451400640 1 -- start start 2024-04-12T19:39:41.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7fb1c6000640 1 --2- 172.21.15.131:0/230882496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1ac004800 0x7fb1ac004c80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4007fd0 tx=0x7fb1ac005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=627a15a8f0612976 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4007d50 con 0x7fb1ac004800 2024-04-12T19:39:41.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7fb1c5600640 1 -- 172.21.15.131:0/230882496 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b4030070 con 0x7fb1ac004800 2024-04-12T19:39:41.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.714+0000 7f7293e00640 1 -- 172.21.15.131:0/1066984836 shutdown_connections 2024-04-12T19:39:41.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.714+0000 7f7293e00640 1 --2- 172.21.15.131:0/1066984836 >> v2:172.21.15.171:3300/0 conn(0x7f729406dcf0 0x7f729406e150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.714+0000 7f7293e00640 1 --2- 172.21.15.131:0/1066984836 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72940c1d90 0x7f72940c21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.714+0000 7f7293e00640 1 --2- 172.21.15.131:0/1066984836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72940c5870 0x7f729406c120 secure :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f72940685a0 tx=0x7f728402b8a0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.714+0000 7f7293e00640 1 -- 172.21.15.131:0/1066984836 >> 172.21.15.131:0/1066984836 conn(0x7f72940c3170 msgr2=0x7f72940c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.714+0000 7fb1cda00640 1 -- 172.21.15.131:0/230882496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1ac004800 msgr2=0x7fb1ac004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.714+0000 7fb1cda00640 1 --2- 172.21.15.131:0/230882496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1ac004800 0x7fb1ac004c80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4007fd0 tx=0x7fb1ac005830 comp rx=0 tx=0).stop 2024-04-12T19:39:41.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.713+0000 7f9d06000640 1 -- 172.21.15.131:0/1337665136 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9d00018020 con 0x7f9d100bd630 2024-04-12T19:39:41.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.714+0000 7f9d06000640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f9cf006c8f0 0x7f9cf006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.715+0000 7f7293e00640 1 -- 172.21.15.131:0/1066984836 shutdown_connections 2024-04-12T19:39:41.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.715+0000 7f7293e00640 1 -- 172.21.15.131:0/1066984836 wait complete. 2024-04-12T19:39:41.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.715+0000 7f0329000640 1 --2- 172.21.15.131:0/1094127548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03240c2fe0 0x7f03240c23d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f03140097d0 tx=0x7f031402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a7a30606613788e0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.737 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.715+0000 7f4451400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f444c0c4c90 0x7f444c06c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.715+0000 7f4451400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f444c0c14d0 con 0x7f444c14e8a0 2024-04-12T19:39:41.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.715+0000 7f4451400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f444c151b90 con 0x7f444c06cd50 2024-04-12T19:39:41.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.715+0000 7f4451400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f444c0c1950 con 0x7f444c0c4c90 2024-04-12T19:39:41.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.715+0000 7fb1cda00640 1 -- 172.21.15.131:0/230882496 shutdown_connections 2024-04-12T19:39:41.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.715+0000 7fb1cda00640 1 --2- 172.21.15.131:0/230882496 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1ac004800 0x7fb1ac004c80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.715+0000 7fb1cda00640 1 -- 172.21.15.131:0/230882496 >> 172.21.15.131:0/230882496 conn(0x7fb1c80a8490 msgr2=0x7fb1c80a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.715+0000 7f9d0de00640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f9cf006c8f0 0x7f9cf006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.738 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.715+0000 7f9d06000640 1 -- 172.21.15.131:0/1337665136 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f9d00057830 con 0x7f9d100bd630 2024-04-12T19:39:41.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f9d06000640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:6800/1197764671,v1:172.21.15.131:6801/1197764671] conn(0x7f9cf0076c30 0x7f9cf00790d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f9d06000640 1 -- 172.21.15.131:0/1337665136 --> [v2:172.21.15.131:6800/1197764671,v1:172.21.15.131:6801/1197764671] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9cf00797a0 con 0x7f9cf0076c30 2024-04-12T19:39:41.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7fb1cda00640 1 -- 172.21.15.131:0/230882496 shutdown_connections 2024-04-12T19:39:41.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f4450a00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f444c06cd50 0x7f444c15b910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.131:41268/0 (socket says 172.21.15.131:41268) 2024-04-12T19:39:41.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f4450a00640 1 -- 172.21.15.131:0/2415225466 learned_addr learned my addr 172.21.15.131:0/2415225466 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:41.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f4443400640 1 --2- 172.21.15.131:0/2415225466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f444c0c4c90 0x7f444c06c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f0323400640 1 -- 172.21.15.131:0/1094127548 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314034070 con 0x7f03240c2fe0 2024-04-12T19:39:41.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f0323400640 1 -- 172.21.15.131:0/1094127548 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0314030610 con 0x7f03240c2fe0 2024-04-12T19:39:41.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f0323400640 1 -- 172.21.15.131:0/1094127548 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0314030a20 con 0x7f03240c2fe0 2024-04-12T19:39:41.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7fb1cda00640 1 -- 172.21.15.131:0/230882496 wait complete. 2024-04-12T19:39:41.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f444b400640 1 -- 172.21.15.131:0/2415225466 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2693432456 0 0) 0x7f444c151b90 con 0x7f444c06cd50 2024-04-12T19:39:41.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f444b400640 1 -- 172.21.15.131:0/2415225466 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4430003520 con 0x7f444c06cd50 2024-04-12T19:39:41.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f37f7200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37f0049040 0x7f37f0040840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f37f7200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37f004a070 0x7f37f00413b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f37f7200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37f00cf9d0 0x7f37f00ce030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f37f7200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f37f00d67c0 con 0x7f37f0049040 2024-04-12T19:39:41.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f37f7200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f37f00d5990 con 0x7f37f00cf9d0 2024-04-12T19:39:41.741 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f37f7200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f37f00d6940 con 0x7f37f004a070 2024-04-12T19:39:41.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.717+0000 7f4443400640 1 -- 172.21.15.131:0/2415225466 >> v1:172.21.15.171:6789/0 conn(0x7f444c06cd50 legacy=0x7f444c15b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.717+0000 7f4443400640 1 -- 172.21.15.131:0/2415225466 >> v1:172.21.15.131:6789/0 conn(0x7f444c14e8a0 legacy=0x7f444c0c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.717+0000 7f4443400640 1 -- 172.21.15.131:0/2415225466 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c151e30 con 0x7f444c0c4c90 2024-04-12T19:39:41.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.717+0000 7f032a400640 1 -- 172.21.15.131:0/1094127548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03240c2fe0 msgr2=0x7f03240c23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.717+0000 7f032a400640 1 --2- 172.21.15.131:0/1094127548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03240c2fe0 0x7f03240c23d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f03140097d0 tx=0x7f031402b960 comp rx=0 tx=0).stop 2024-04-12T19:39:41.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f9d0d400640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:6800/1197764671,v1:172.21.15.131:6801/1197764671] conn(0x7f9cf0076c30 0x7f9cf00790d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.717+0000 7f9d06000640 1 -- 172.21.15.131:0/1337665136 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9d000561c0 con 0x7f9d100bd630 2024-04-12T19:39:41.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.717+0000 7f37f6800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37f00cf9d0 0x7f37f00ce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.717+0000 7f37f6800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37f00cf9d0 0x7f37f00ce030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:34936/0 (socket says 172.21.15.131:34936) 2024-04-12T19:39:41.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.717+0000 7f37f6800640 1 -- 172.21.15.131:0/1011380668 learned_addr learned my addr 172.21.15.131:0/1011380668 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f7293e00640 1 Processor -- start 2024-04-12T19:39:41.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f9d0d400640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:6800/1197764671,v1:172.21.15.131:6801/1197764671] conn(0x7f9cf0076c30 0x7f9cf00790d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f032a400640 1 -- 172.21.15.131:0/1094127548 shutdown_connections 2024-04-12T19:39:41.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f032a400640 1 --2- 172.21.15.131:0/1094127548 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03240c2fe0 0x7f03240c23d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f032a400640 1 -- 172.21.15.131:0/1094127548 >> 172.21.15.131:0/1094127548 conn(0x7f03240a62c0 msgr2=0x7f03240a66a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.716+0000 7f8173e00640 1 --2- 172.21.15.131:0/2394125357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81740bf720 0x7f81740be140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f81640097a0 tx=0x7f816402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7103bacb93abdd7e server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f8172a00640 1 -- 172.21.15.131:0/2394125357 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164035020 con 0x7f81740bf720 2024-04-12T19:39:41.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f37f5e00640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37f0049040 0x7f37f0040840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f8172a00640 1 -- 172.21.15.131:0/2394125357 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8164031810 con 0x7f81740bf720 2024-04-12T19:39:41.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f8172a00640 1 -- 172.21.15.131:0/2394125357 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8164031be0 con 0x7f81740bf720 2024-04-12T19:39:41.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f37f6800640 1 -- 172.21.15.131:0/1011380668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37f004a070 msgr2=0x7f37f00413b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f032a400640 1 -- 172.21.15.131:0/1094127548 shutdown_connections 2024-04-12T19:39:41.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f37f6800640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f37f004a070 0x7f37f00413b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f37f6800640 1 -- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37f0049040 msgr2=0x7f37f0040840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f37f6800640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37f0049040 0x7f37f0040840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f37f6800640 1 -- 172.21.15.131:0/1011380668 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37f00d2bd0 con 0x7f37f00cf9d0 2024-04-12T19:39:41.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f7293e00640 1 -- start start 2024-04-12T19:39:41.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7feb2cc00640 1 -- 172.21.15.131:0/3129742200 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7feb3009c5b0 con 0x7feb280cff00 2024-04-12T19:39:41.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f37f6800640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37f00cf9d0 0x7f37f00ce030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f37f802db70 tx=0x7f37f8069ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f9d0de00640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f9cf006c8f0 0x7f9cf006edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9d08035000 tx=0x7f9d08030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f37f5e00640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37f0049040 0x7f37f0040840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:41.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f817ae00640 1 -- 172.21.15.131:0/2394125357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81740bf720 msgr2=0x7f81740be140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f817ae00640 1 --2- 172.21.15.131:0/2394125357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81740bf720 0x7f81740be140 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f81640097a0 tx=0x7f816402b8b0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f37ee000640 1 -- 172.21.15.131:0/1011380668 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80bc070 con 0x7f37f00cf9d0 2024-04-12T19:39:41.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.718+0000 7f032a400640 1 -- 172.21.15.131:0/1094127548 wait complete. 2024-04-12T19:39:41.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f4443400640 1 --2- 172.21.15.131:0/2415225466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f444c0c4c90 0x7f444c06c810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f44340097d0 tx=0x7f443402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5e281862bc131ccc server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7fb1cda00640 1 Processor -- start 2024-04-12T19:39:41.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f7293e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f729406dcf0 0x7f7294155e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f7293e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72940c1d90 0x7f72940ab8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f7293e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72941eb6c0 0x7f72940abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f7293e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f72940c1070 con 0x7f72940c1d90 2024-04-12T19:39:41.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f7293e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f72940c1590 con 0x7f729406dcf0 2024-04-12T19:39:41.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f7293e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f72940a5d80 con 0x7f72941eb6c0 2024-04-12T19:39:41.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f817ae00640 1 -- 172.21.15.131:0/2394125357 shutdown_connections 2024-04-12T19:39:41.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f817ae00640 1 --2- 172.21.15.131:0/2394125357 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f81741598e0 0x7f817415ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f817ae00640 1 --2- 172.21.15.131:0/2394125357 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81740bf720 0x7f81740be140 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f817ae00640 1 -- 172.21.15.131:0/2394125357 >> 172.21.15.131:0/2394125357 conn(0x7f817406be00 msgr2=0x7f817406c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7f9d06000640 1 -- 172.21.15.131:0/1337665136 <== osd.0 v2:172.21.15.131:6800/1197764671 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9cf00797a0 con 0x7f9cf0076c30 2024-04-12T19:39:41.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7fb1cda00640 1 -- start start 2024-04-12T19:39:41.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7f444b400640 1 -- 172.21.15.131:0/2415225466 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434035020 con 0x7f444c0c4c90 2024-04-12T19:39:41.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f37ee000640 1 -- 172.21.15.131:0/1011380668 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37f80afda0 con 0x7f37f00cf9d0 2024-04-12T19:39:41.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.719+0000 7f37ee000640 1 -- 172.21.15.131:0/1011380668 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f80b4040 con 0x7f37f00cf9d0 2024-04-12T19:39:41.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7f444b400640 1 -- 172.21.15.131:0/2415225466 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4434031810 con 0x7f444c0c4c90 2024-04-12T19:39:41.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7f817ae00640 1 -- 172.21.15.131:0/2394125357 shutdown_connections 2024-04-12T19:39:41.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7f7292a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f729406dcf0 0x7f7294155e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7f7292a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f729406dcf0 0x7f7294155e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:34940/0 (socket says 172.21.15.131:34940) 2024-04-12T19:39:41.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7f7293400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72941eb6c0 0x7f72940abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7f444b400640 1 -- 172.21.15.131:0/2415225466 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4434031bc0 con 0x7f444c0c4c90 2024-04-12T19:39:41.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.721+0000 7f7293400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72941eb6c0 0x7f72940abdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:46180/0 (socket says 172.21.15.131:46180) 2024-04-12T19:39:41.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.721+0000 7f7292a00640 1 -- 172.21.15.131:0/2586687389 learned_addr learned my addr 172.21.15.131:0/2586687389 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7feb2cc00640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7feb1006caf0 0x7feb1006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7feb2cc00640 1 -- 172.21.15.131:0/3129742200 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7feb3010fbb0 con 0x7feb280cff00 2024-04-12T19:39:41.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7feb2cc00640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:6808/3781331940,v1:172.21.15.131:6809/3781331940] conn(0x7feb10076260 0x7feb100786a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7feb2cc00640 1 -- 172.21.15.131:0/3129742200 --> [v2:172.21.15.131:6808/3781331940,v1:172.21.15.131:6809/3781331940] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feb300a5e50 con 0x7feb10076260 2024-04-12T19:39:41.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7feb2cc00640 1 -- 172.21.15.131:0/3129742200 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7feb3010ffa0 con 0x7feb280cff00 2024-04-12T19:39:41.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7f37f7200640 1 -- 172.21.15.131:0/1011380668 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37f002ade0 con 0x7f37f00cf9d0 2024-04-12T19:39:41.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7f37f7200640 1 -- 172.21.15.131:0/1011380668 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37f016bf80 con 0x7f37f00cf9d0 2024-04-12T19:39:41.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.721+0000 7f032a400640 1 Processor -- start 2024-04-12T19:39:41.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.721+0000 7fb1cda00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac004800 0x7fb1c81d75f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.721+0000 7f032a400640 1 -- start start 2024-04-12T19:39:41.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7fb1cda00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1c80bccd0 0x7fb1c80bd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.755 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7fb1cda00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c81e9ad0 0x7fb1c81e9f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.721+0000 7feb35800640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:6808/3781331940,v1:172.21.15.131:6809/3781331940] conn(0x7feb10076260 0x7feb100786a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.721+0000 7feb34e00640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7feb1006caf0 0x7feb1006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7f7292000640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72940c1d90 0x7f72940ab8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.756 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7f4451400640 1 -- 172.21.15.131:0/2415225466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f444c0c4c90 msgr2=0x7f444c06c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7fb1cda00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c80c48e0 con 0x7fb1c80bccd0 2024-04-12T19:39:41.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7fb1cda00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c80c4760 con 0x7fb1ac004800 2024-04-12T19:39:41.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7fb1cda00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb1c80c1b80 con 0x7fb1c81e9ad0 2024-04-12T19:39:41.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7f4451400640 1 --2- 172.21.15.131:0/2415225466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f444c0c4c90 0x7f444c06c810 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f44340097d0 tx=0x7f443402b8b0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.720+0000 7f817ae00640 1 -- 172.21.15.131:0/2394125357 wait complete. 2024-04-12T19:39:41.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7fb1c6000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1c80bccd0 0x7fb1c80bd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f37f7200640 1 -- 172.21.15.131:0/1011380668 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f37f00057e0 con 0x7f37f00cf9d0 2024-04-12T19:39:41.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f032a400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03240bb290 0x7f0324142b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.758 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f032a400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03240c2fe0 0x7f03241ee4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7f7292a00640 1 -- 172.21.15.131:0/2586687389 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72941eb6c0 msgr2=0x7f72940abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7f7292a00640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72941eb6c0 0x7f72940abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7f7292a00640 1 -- 172.21.15.131:0/2586687389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72940c1d90 msgr2=0x7f72940ab8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7f7292a00640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72940c1d90 0x7f72940ab8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.722+0000 7f7292a00640 1 -- 172.21.15.131:0/2586687389 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72940ab120 con 0x7f729406dcf0 2024-04-12T19:39:41.759 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f817ae00640 1 Processor -- start 2024-04-12T19:39:41.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7fb1c6a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac004800 0x7fb1c81d75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7fb1c6a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac004800 0x7fb1c81d75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:34952/0 (socket says 172.21.15.131:34952) 2024-04-12T19:39:41.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7fb1c6a00640 1 -- 172.21.15.131:0/1926099622 learned_addr learned my addr 172.21.15.131:0/1926099622 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7fb1c7400640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c81e9ad0 0x7fb1c81e9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7feb34e00640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7feb1006caf0 0x7feb1006efb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb24036000 tx=0x7feb24008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.760 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f032a400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0324157740 0x7f0324147be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f032a400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f03240baa70 con 0x7f0324157740 2024-04-12T19:39:41.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f032a400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f03240c33c0 con 0x7f03240c2fe0 2024-04-12T19:39:41.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f032a400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f03240c16f0 con 0x7f03240bb290 2024-04-12T19:39:41.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f4451400640 1 -- 172.21.15.131:0/2415225466 shutdown_connections 2024-04-12T19:39:41.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f7293400640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f72941eb6c0 0x7f72940abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:39:41.761 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f817ae00640 1 -- start start 2024-04-12T19:39:41.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f4451400640 1 --2- 172.21.15.131:0/2415225466 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f444c0c4c90 0x7f444c06c810 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f4451400640 1 -- 172.21.15.131:0/2415225466 >> 172.21.15.131:0/2415225466 conn(0x7f444c0c6780 msgr2=0x7f444c0c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.762 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7feb35800640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:6808/3781331940,v1:172.21.15.131:6809/3781331940] conn(0x7feb10076260 0x7feb100786a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f0329a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0324157740 0x7f0324147be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f0329a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0324157740 0x7f0324147be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41220/0 (socket says 172.21.15.131:41220) 2024-04-12T19:39:41.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.723+0000 7f0329a00640 1 -- 172.21.15.131:0/3449143270 learned_addr learned my addr 172.21.15.131:0/3449143270 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7f4451400640 1 -- 172.21.15.131:0/2415225466 shutdown_connections 2024-04-12T19:39:41.763 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7f4451400640 1 -- 172.21.15.131:0/2415225466 wait complete. 2024-04-12T19:39:41.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7f0323e00640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03240c2fe0 0x7f03241ee4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7f7292a00640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f729406dcf0 0x7f7294155e90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f728402be30 tx=0x7f72840046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.764 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7f0329000640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03240bb290 0x7f0324142b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7fb1c6000640 1 -- 172.21.15.131:0/1926099622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c81e9ad0 msgr2=0x7fb1c81e9f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7fb1c6000640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb1c81e9ad0 0x7fb1c81e9f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7fb1c6000640 1 -- 172.21.15.131:0/1926099622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac004800 msgr2=0x7fb1c81d75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7fb1c6000640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb1ac004800 0x7fb1c81d75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7fb1c6000640 1 -- 172.21.15.131:0/1926099622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c81d7b30 con 0x7fb1c80bccd0 2024-04-12T19:39:41.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7f0329a00640 1 -- 172.21.15.131:0/3449143270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03240bb290 msgr2=0x7f0324142b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7f0329a00640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f03240bb290 0x7f0324142b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7f0329a00640 1 -- 172.21.15.131:0/3449143270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03240c2fe0 msgr2=0x7f03241ee4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.765 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7f0329a00640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f03240c2fe0 0x7f03241ee4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7f0329a00640 1 -- 172.21.15.131:0/3449143270 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03241430a0 con 0x7f0324157740 2024-04-12T19:39:41.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.724+0000 7fb1c6000640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1c80bccd0 0x7fb1c80bd130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c4c0 tx=0x7fb1b4001970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7fb1bea00640 1 -- 172.21.15.131:0/1926099622 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b4007070 con 0x7fb1c80bccd0 2024-04-12T19:39:41.766 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7f728b400640 1 -- 172.21.15.131:0/2586687389 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7284045450 con 0x7f729406dcf0 2024-04-12T19:39:41.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7fb1bea00640 1 -- 172.21.15.131:0/1926099622 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1b4007210 con 0x7fb1c80bccd0 2024-04-12T19:39:41.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7fb1bea00640 1 -- 172.21.15.131:0/1926099622 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1b40075e0 con 0x7fb1c80bccd0 2024-04-12T19:39:41.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7fb1cda00640 1 -- 172.21.15.131:0/1926099622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c80bd670 con 0x7fb1c80bccd0 2024-04-12T19:39:41.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7fb1cda00640 1 -- 172.21.15.131:0/1926099622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c80bc1f0 con 0x7fb1c80bccd0 2024-04-12T19:39:41.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.726+0000 7fb1cda00640 1 -- 172.21.15.131:0/1926099622 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb1c804fd50 con 0x7fb1c80bccd0 2024-04-12T19:39:41.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7feb2cc00640 1 -- 172.21.15.131:0/3129742200 <== osd.1 v2:172.21.15.131:6808/3781331940 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feb300a5e50 con 0x7feb10076260 2024-04-12T19:39:41.767 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7f0329a00640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0324157740 0x7f0324147be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f031000c3f0 tx=0x7f031000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.726+0000 7f728b400640 1 -- 172.21.15.131:0/2586687389 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72840455f0 con 0x7f729406dcf0 2024-04-12T19:39:41.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.726+0000 7f728b400640 1 -- 172.21.15.131:0/2586687389 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72840459c0 con 0x7f729406dcf0 2024-04-12T19:39:41.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.726+0000 7f7293e00640 1 -- 172.21.15.131:0/2586687389 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72941563d0 con 0x7f729406dcf0 2024-04-12T19:39:41.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.726+0000 7f7293e00640 1 -- 172.21.15.131:0/2586687389 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72940a99e0 con 0x7f729406dcf0 2024-04-12T19:39:41.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7f817ae00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81740bf720 0x7f81741527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7f817ae00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8174132400 0x7f81741e72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7f817ae00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81741f7380 0x7f81741f7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.768 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7f817ae00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f81740bee20 con 0x7f81741f7380 2024-04-12T19:39:41.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7f817ae00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f81740bd140 con 0x7f81740bf720 2024-04-12T19:39:41.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.725+0000 7f817ae00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f81740be680 con 0x7f8174132400 2024-04-12T19:39:41.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.727+0000 7f7293e00640 1 -- 172.21.15.131:0/2586687389 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f729404fd50 con 0x7f729406dcf0 2024-04-12T19:39:41.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.726+0000 7f37ee000640 1 -- 172.21.15.131:0/1011380668 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f37f80bf070 con 0x7f37f00cf9d0 2024-04-12T19:39:41.769 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.727+0000 7f4451400640 1 Processor -- start 2024-04-12T19:39:41.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.727+0000 7f0320c00640 1 -- 172.21.15.131:0/3449143270 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310017070 con 0x7f0324157740 2024-04-12T19:39:41.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.727+0000 7f37ee000640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f37d806c9f0 0x7f37d806eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.727+0000 7f4451400640 1 -- start start 2024-04-12T19:39:41.770 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.727+0000 7f032a400640 1 -- 172.21.15.131:0/3449143270 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0324148e60 con 0x7f0324157740 2024-04-12T19:39:41.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.728+0000 7f032a400640 1 -- 172.21.15.131:0/3449143270 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03240a5400 con 0x7f0324157740 2024-04-12T19:39:41.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.727+0000 7f37ee000640 1 -- 172.21.15.131:0/1011380668 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f37f8129430 con 0x7f37f00cf9d0 2024-04-12T19:39:41.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.728+0000 7f37ee000640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:6816/1637719657,v1:172.21.15.131:6817/1637719657] conn(0x7f37d8076160 0x7f37d80785a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.728+0000 7f37ee000640 1 -- 172.21.15.131:0/1011380668 --> [v2:172.21.15.131:6816/1637719657,v1:172.21.15.131:6817/1637719657] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f37d8078c70 con 0x7f37d8076160 2024-04-12T19:39:41.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.728+0000 7f37ee000640 1 -- 172.21.15.131:0/1011380668 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f37f8129820 con 0x7f37f00cf9d0 2024-04-12T19:39:41.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.728+0000 7f37f5e00640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f37d806c9f0 0x7f37d806eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.729+0000 7f37f5400640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:6816/1637719657,v1:172.21.15.131:6817/1637719657] conn(0x7f37d8076160 0x7f37d80785a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.771 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.728+0000 7f0320c00640 1 -- 172.21.15.131:0/3449143270 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f03100052d0 con 0x7f0324157740 2024-04-12T19:39:41.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.728+0000 7f0320c00640 1 -- 172.21.15.131:0/3449143270 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0310017070 con 0x7f0324157740 2024-04-12T19:39:41.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.729+0000 7f4451400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f444c06cd50 0x7f444c154820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.729+0000 7f8173e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81740bf720 0x7f81741527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.729+0000 7f8173400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8174132400 0x7f81741e72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.729+0000 7f8173400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8174132400 0x7f81741e72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:46212/0 (socket says 172.21.15.131:46212) 2024-04-12T19:39:41.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.729+0000 7f8173400640 1 -- 172.21.15.131:0/371105456 learned_addr learned my addr 172.21.15.131:0/371105456 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f031a000640 1 -- 172.21.15.131:0/3449143270 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f02f8001030 con 0x7f0324157740 2024-04-12T19:39:41.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f8178e00640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81741f7380 0x7f81741f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.773 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f444be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f444c06cd50 0x7f444c154820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f4451400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f444c0c4c90 0x7f444c0bda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f4451400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f444c14e8a0 0x7f444c0bdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f4451400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f444c06c380 con 0x7f444c06cd50 2024-04-12T19:39:41.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f444be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f444c06cd50 0x7f444c154820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41244/0 (socket says 172.21.15.131:41244) 2024-04-12T19:39:41.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f444be00640 1 -- 172.21.15.131:0/111101398 learned_addr learned my addr 172.21.15.131:0/111101398 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:41.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f444c06c0a0 con 0x7f444c0c4c90 2024-04-12T19:39:41.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f444c0c1ba0 con 0x7f444c14e8a0 2024-04-12T19:39:41.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.729+0000 7fb1bea00640 1 -- 172.21.15.131:0/1926099622 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb1b4040470 con 0x7fb1c80bccd0 2024-04-12T19:39:41.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7fb1bea00640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb1a806c8f0 0x7fb1a806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7fb1bea00640 1 -- 172.21.15.131:0/1926099622 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb1b40adb00 con 0x7fb1c80bccd0 2024-04-12T19:39:41.774 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.731+0000 7fb1bea00640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:6824/736798902,v1:172.21.15.131:6825/736798902] conn(0x7fb1a8075fe0 0x7fb1a8078420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.731+0000 7fb1bea00640 1 -- 172.21.15.131:0/1926099622 --> [v2:172.21.15.131:6824/736798902,v1:172.21.15.131:6825/736798902] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb1b4006e50 con 0x7fb1a8075fe0 2024-04-12T19:39:41.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f8173400640 1 -- 172.21.15.131:0/371105456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81740bf720 msgr2=0x7f81741527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f8173400640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f81740bf720 0x7f81741527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f8173400640 1 -- 172.21.15.131:0/371105456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81741f7380 msgr2=0x7f81741f7800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f8173400640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81741f7380 0x7f81741f7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.775 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.730+0000 7f8173400640 1 -- 172.21.15.131:0/371105456 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81741e7820 con 0x7f8174132400 2024-04-12T19:39:41.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.731+0000 7fb1bea00640 1 -- 172.21.15.131:0/1926099622 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb1b40b4050 con 0x7fb1c80bccd0 2024-04-12T19:39:41.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.732+0000 7fb1c6a00640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb1a806c8f0 0x7fb1a806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.731+0000 7f444be00640 1 -- 172.21.15.131:0/111101398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f444c14e8a0 msgr2=0x7f444c0bdfc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-12T19:39:41.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.731+0000 7f444be00640 1 --2- 172.21.15.131:0/111101398 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f444c14e8a0 0x7f444c0bdfc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.731+0000 7f444be00640 1 -- 172.21.15.131:0/111101398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f444c0c4c90 msgr2=0x7f444c0bda80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-12T19:39:41.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.731+0000 7f444be00640 1 --2- 172.21.15.131:0/111101398 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f444c0c4c90 0x7f444c0bda80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.731+0000 7f444be00640 1 -- 172.21.15.131:0/111101398 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f444c154d60 con 0x7f444c06cd50 2024-04-12T19:39:41.776 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.732+0000 7f8173400640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8174132400 0x7f81741e72e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f816000c490 tx=0x7f816000c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.732+0000 7f37f5e00640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f37d806c9f0 0x7f37d806eeb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009a20 tx=0x7f37e8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.732+0000 7f444be00640 1 --2- 172.21.15.131:0/111101398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f444c06cd50 0x7f444c154820 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f443c00c3f0 tx=0x7f443c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.777 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.732+0000 7f37f5400640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:6816/1637719657,v1:172.21.15.131:6817/1637719657] conn(0x7f37d8076160 0x7f37d80785a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.732+0000 7f4448c00640 1 -- 172.21.15.131:0/111101398 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c0052d0 con 0x7f444c06cd50 2024-04-12T19:39:41.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.732+0000 7f816be00640 1 -- 172.21.15.131:0/371105456 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8160017070 con 0x7f8174132400 2024-04-12T19:39:41.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.732+0000 7f4448c00640 1 -- 172.21.15.131:0/111101398 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f443c005470 con 0x7f444c06cd50 2024-04-12T19:39:41.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.732+0000 7f4448c00640 1 -- 172.21.15.131:0/111101398 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443c007260 con 0x7f444c06cd50 2024-04-12T19:39:41.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.733+0000 7f816be00640 1 -- 172.21.15.131:0/371105456 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8160005ce0 con 0x7f8174132400 2024-04-12T19:39:41.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.733+0000 7f816be00640 1 -- 172.21.15.131:0/371105456 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8160007270 con 0x7f8174132400 2024-04-12T19:39:41.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.733+0000 7fb1c7400640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:6824/736798902,v1:172.21.15.131:6825/736798902] conn(0x7fb1a8075fe0 0x7fb1a8078420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.733+0000 7f728b400640 1 -- 172.21.15.131:0/2586687389 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7284038020 con 0x7f729406dcf0 2024-04-12T19:39:41.779 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.734+0000 7f0320c00640 1 -- 172.21.15.131:0/3449143270 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f031001a070 con 0x7f0324157740 2024-04-12T19:39:41.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.734+0000 7f817ae00640 1 -- 172.21.15.131:0/371105456 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81741f7d40 con 0x7f8174132400 2024-04-12T19:39:41.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.734+0000 7f37ee000640 1 -- 172.21.15.131:0/1011380668 <== osd.2 v2:172.21.15.131:6816/1637719657 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f37d8078c70 con 0x7f37d8076160 2024-04-12T19:39:41.780 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.734+0000 7f817ae00640 1 -- 172.21.15.131:0/371105456 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8174151f40 con 0x7f8174132400 2024-04-12T19:39:41.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.735+0000 7fb1c7400640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:6824/736798902,v1:172.21.15.131:6825/736798902] conn(0x7fb1a8075fe0 0x7fb1a8078420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.735+0000 7f728b400640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f727406c9c0 0x7f727406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.735+0000 7f728b400640 1 -- 172.21.15.131:0/2586687389 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f72840ae330 con 0x7f729406dcf0 2024-04-12T19:39:41.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.735+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f444c0ba350 con 0x7f444c06cd50 2024-04-12T19:39:41.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.735+0000 7f728b400640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.171:6800/1706601782,v1:172.21.15.171:6801/1706601782] conn(0x7f7274076130 0x7f7274078570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.735+0000 7f817ae00640 1 -- 172.21.15.131:0/371105456 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f817404fd50 con 0x7f8174132400 2024-04-12T19:39:41.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.735+0000 7f7292000640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f727406c9c0 0x7f727406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.736+0000 7f728b400640 1 -- 172.21.15.131:0/2586687389 --> [v2:172.21.15.171:6800/1706601782,v1:172.21.15.171:6801/1706601782] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f728403be50 con 0x7f7274076130 2024-04-12T19:39:41.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.736+0000 7f728b400640 1 -- 172.21.15.131:0/2586687389 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f72840ae720 con 0x7f729406dcf0 2024-04-12T19:39:41.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.736+0000 7f7293400640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.171:6800/1706601782,v1:172.21.15.171:6801/1706601782] conn(0x7f7274076130 0x7f7274078570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.737+0000 7f7292000640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f727406c9c0 0x7f727406ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f72941555d0 tx=0x7f7280009060 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.736+0000 7fb1bea00640 1 -- 172.21.15.131:0/1926099622 <== osd.3 v2:172.21.15.131:6824/736798902 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb1b4006e50 con 0x7fb1a8075fe0 2024-04-12T19:39:41.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.735+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f444c1e7980 con 0x7f444c06cd50 2024-04-12T19:39:41.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.737+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f444c04fd50 con 0x7f444c06cd50 2024-04-12T19:39:41.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.737+0000 7fb1c6a00640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb1a806c8f0 0x7fb1a806edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8004650 tx=0x7fb1b8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.738+0000 7f7293400640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.171:6800/1706601782,v1:172.21.15.171:6801/1706601782] conn(0x7f7274076130 0x7f7274078570 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.739+0000 7f0320c00640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f030406caf0 0x7f030406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.739+0000 7f0320c00640 1 -- 172.21.15.131:0/3449143270 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f031008b4b0 con 0x7f0324157740 2024-04-12T19:39:41.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.740+0000 7f0320c00640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.171:6821/22785163,v1:172.21.15.171:6823/22785163] conn(0x7f0304076270 0x7f03040786b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.740+0000 7f0320c00640 1 -- 172.21.15.131:0/3449143270 --> [v2:172.21.15.171:6821/22785163,v1:172.21.15.171:6823/22785163] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0304078d80 con 0x7f0304076270 2024-04-12T19:39:41.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.740+0000 7f0320c00640 1 -- 172.21.15.131:0/3449143270 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f031008b8a0 con 0x7f0324157740 2024-04-12T19:39:41.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.740+0000 7f0329000640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f030406caf0 0x7f030406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.740+0000 7f0323e00640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.171:6821/22785163,v1:172.21.15.171:6823/22785163] conn(0x7f0304076270 0x7f03040786b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.741+0000 7f728b400640 1 -- 172.21.15.131:0/2586687389 <== osd.5 v2:172.21.15.171:6800/1706601782 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f728403be50 con 0x7f7274076130 2024-04-12T19:39:41.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.741+0000 7f0329000640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f030406caf0 0x7f030406efb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0314036000 tx=0x7f031403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.741+0000 7f0323e00640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.171:6821/22785163,v1:172.21.15.171:6823/22785163] conn(0x7f0304076270 0x7f03040786b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.741+0000 7f4448c00640 1 -- 172.21.15.131:0/111101398 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f443c007400 con 0x7f444c06cd50 2024-04-12T19:39:41.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.742+0000 7f4448c00640 1 --2- 172.21.15.131:0/111101398 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f442806c8f0 0x7f442806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.743+0000 7f4448c00640 1 -- 172.21.15.131:0/111101398 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f443c08b330 con 0x7f444c06cd50 2024-04-12T19:39:41.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.743+0000 7f4443400640 1 --2- 172.21.15.131:0/111101398 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f442806c8f0 0x7f442806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.743+0000 7f4448c00640 1 --2- 172.21.15.131:0/111101398 >> [v2:172.21.15.171:6816/54064703,v1:172.21.15.171:6817/54064703] conn(0x7f4428075f60 0x7f44280783a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.743+0000 7f4448c00640 1 -- 172.21.15.131:0/111101398 --> [v2:172.21.15.171:6816/54064703,v1:172.21.15.171:6817/54064703] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f443c009e50 con 0x7f4428075f60 2024-04-12T19:39:41.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.741+0000 7f816be00640 1 -- 172.21.15.131:0/371105456 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f816001a070 con 0x7f8174132400 2024-04-12T19:39:41.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.742+0000 7f816be00640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f815406c920 0x7f815406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.742+0000 7f816be00640 1 -- 172.21.15.131:0/371105456 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f816008b8e0 con 0x7f8174132400 2024-04-12T19:39:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.742+0000 7f816be00640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.171:6808/285879561,v1:172.21.15.171:6809/285879561] conn(0x7f8154076090 0x7f81540784d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.742+0000 7f816be00640 1 -- 172.21.15.131:0/371105456 --> [v2:172.21.15.171:6808/285879561,v1:172.21.15.171:6809/285879561] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8154078ba0 con 0x7f8154076090 2024-04-12T19:39:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.742+0000 7f816be00640 1 -- 172.21.15.131:0/371105456 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f816008bcd0 con 0x7f8174132400 2024-04-12T19:39:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.743+0000 7f8173e00640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f815406c920 0x7f815406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.743+0000 7f8178e00640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.171:6808/285879561,v1:172.21.15.171:6809/285879561] conn(0x7f8154076090 0x7f81540784d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.744+0000 7f4448c00640 1 -- 172.21.15.131:0/111101398 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f443c054fb0 con 0x7f444c06cd50 2024-04-12T19:39:41.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.744+0000 7f0320c00640 1 -- 172.21.15.131:0/3449143270 <== osd.4 v2:172.21.15.171:6821/22785163 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0304078d80 con 0x7f0304076270 2024-04-12T19:39:41.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.744+0000 7f8178e00640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.171:6808/285879561,v1:172.21.15.171:6809/285879561] conn(0x7f8154076090 0x7f81540784d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.744+0000 7f4450a00640 1 --2- 172.21.15.131:0/111101398 >> [v2:172.21.15.171:6816/54064703,v1:172.21.15.171:6817/54064703] conn(0x7f4428075f60 0x7f44280783a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:41.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.745+0000 7f4443400640 1 --2- 172.21.15.131:0/111101398 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f442806c8f0 0x7f442806edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4434036000 tx=0x7f4434008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.745+0000 7f8173e00640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f815406c920 0x7f815406ede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8164036000 tx=0x7f8164008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.746+0000 7f4450a00640 1 --2- 172.21.15.131:0/111101398 >> [v2:172.21.15.171:6816/54064703,v1:172.21.15.171:6817/54064703] conn(0x7f4428075f60 0x7f44280783a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:41.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.747+0000 7f816be00640 1 -- 172.21.15.131:0/371105456 <== osd.7 v2:172.21.15.171:6808/285879561 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8154078ba0 con 0x7f8154076090 2024-04-12T19:39:41.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.749+0000 7f4448c00640 1 -- 172.21.15.131:0/111101398 <== osd.6 v2:172.21.15.171:6816/54064703 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f443c009e50 con 0x7f4428075f60 2024-04-12T19:39:41.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.749+0000 7feb37800640 1 -- 172.21.15.131:0/3129742200 --> [v2:172.21.15.131:6808/3781331940,v1:172.21.15.131:6809/3781331940] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7feb28030180 con 0x7feb10076260 2024-04-12T19:39:41.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.750+0000 7feb2cc00640 1 -- 172.21.15.131:0/3129742200 <== osd.1 v2:172.21.15.131:6808/3781331940 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7feb28030180 con 0x7feb10076260 2024-04-12T19:39:41.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.751+0000 7feb37800640 1 -- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:6808/3781331940,v1:172.21.15.131:6809/3781331940] conn(0x7feb10076260 msgr2=0x7feb100786a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.751+0000 7feb37800640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:6808/3781331940,v1:172.21.15.131:6809/3781331940] conn(0x7feb10076260 0x7feb100786a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.751+0000 7feb37800640 1 -- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7feb1006caf0 msgr2=0x7feb1006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.751+0000 7feb37800640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7feb1006caf0 0x7feb1006efb0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feb24036000 tx=0x7feb24008030 comp rx=0 tx=0).stop 2024-04-12T19:39:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.751+0000 7feb37800640 1 -- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280cff00 msgr2=0x7feb2816eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.751+0000 7feb37800640 1 --2- 172.21.15.131:0/3129742200 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb280cff00 0x7feb2816eb20 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7feb30063580 tx=0x7feb3006ce80 comp rx=0 tx=0).stop 2024-04-12T19:39:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.751+0000 7feb35800640 1 -- 172.21.15.131:0/3129742200 reap_dead start 2024-04-12T19:39:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.751+0000 7feb37800640 1 -- 172.21.15.131:0/3129742200 shutdown_connections 2024-04-12T19:39:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.751+0000 7feb37800640 1 -- 172.21.15.131:0/3129742200 >> 172.21.15.131:0/3129742200 conn(0x7feb28047cb0 msgr2=0x7feb2802c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.753+0000 7f9d14e00640 1 -- 172.21.15.131:0/1337665136 --> [v2:172.21.15.131:6800/1197764671,v1:172.21.15.131:6801/1197764671] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9d1006e040 con 0x7f9cf0076c30 2024-04-12T19:39:41.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.753+0000 7feb37800640 1 -- 172.21.15.131:0/3129742200 shutdown_connections 2024-04-12T19:39:41.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.753+0000 7feb37800640 1 -- 172.21.15.131:0/3129742200 wait complete. 2024-04-12T19:39:41.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.754+0000 7f9d06000640 1 -- 172.21.15.131:0/1337665136 <== osd.0 v2:172.21.15.131:6800/1197764671 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9d1006e040 con 0x7f9cf0076c30 2024-04-12T19:39:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.757+0000 7f9cfb400640 1 -- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:6800/1197764671,v1:172.21.15.131:6801/1197764671] conn(0x7f9cf0076c30 msgr2=0x7f9cf00790d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.757+0000 7f9cfb400640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:6800/1197764671,v1:172.21.15.131:6801/1197764671] conn(0x7f9cf0076c30 0x7f9cf00790d0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.758+0000 7f9cfb400640 1 -- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f9cf006c8f0 msgr2=0x7f9cf006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.758+0000 7f9cfb400640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f9cf006c8f0 0x7f9cf006edb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9d08035000 tx=0x7f9d08030000 comp rx=0 tx=0).stop 2024-04-12T19:39:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.758+0000 7f9cfb400640 1 -- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d100bd630 msgr2=0x7f9d10150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.758+0000 7f9cfb400640 1 --2- 172.21.15.131:0/1337665136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9d100bd630 0x7f9d10150d20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f9d0000afd0 tx=0x7f9d0000ca20 comp rx=0 tx=0).stop 2024-04-12T19:39:41.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.758+0000 7f9d0e800640 1 -- 172.21.15.131:0/1337665136 reap_dead start 2024-04-12T19:39:41.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.758+0000 7f9cfb400640 1 -- 172.21.15.131:0/1337665136 shutdown_connections 2024-04-12T19:39:41.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.758+0000 7f9cfb400640 1 -- 172.21.15.131:0/1337665136 >> 172.21.15.131:0/1337665136 conn(0x7f9d100bee90 msgr2=0x7f9d100b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.759+0000 7f9cfb400640 1 -- 172.21.15.131:0/1337665136 shutdown_connections 2024-04-12T19:39:41.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.759+0000 7f9cfb400640 1 -- 172.21.15.131:0/1337665136 wait complete. 2024-04-12T19:39:41.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.766+0000 7f37f7200640 1 -- 172.21.15.131:0/1011380668 --> [v2:172.21.15.131:6816/1637719657,v1:172.21.15.131:6817/1637719657] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f37f0010370 con 0x7f37d8076160 2024-04-12T19:39:41.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.767+0000 7f37ee000640 1 -- 172.21.15.131:0/1011380668 <== osd.2 v2:172.21.15.131:6816/1637719657 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f37f0010370 con 0x7f37d8076160 2024-04-12T19:39:41.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.768+0000 7f37f7200640 1 -- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:6816/1637719657,v1:172.21.15.131:6817/1637719657] conn(0x7f37d8076160 msgr2=0x7f37d80785a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.768+0000 7f37f7200640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:6816/1637719657,v1:172.21.15.131:6817/1637719657] conn(0x7f37d8076160 0x7f37d80785a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.769+0000 7f37f7200640 1 -- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f37d806c9f0 msgr2=0x7f37d806eeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.769+0000 7f37f7200640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f37d806c9f0 0x7f37d806eeb0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f37e8009a20 tx=0x7f37e8008040 comp rx=0 tx=0).stop 2024-04-12T19:39:41.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.770+0000 7fb1cda00640 1 -- 172.21.15.131:0/1926099622 --> [v2:172.21.15.131:6824/736798902,v1:172.21.15.131:6825/736798902] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb1c81ea710 con 0x7fb1a8075fe0 2024-04-12T19:39:41.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.769+0000 7f37f7200640 1 -- 172.21.15.131:0/1011380668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37f00cf9d0 msgr2=0x7f37f00ce030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.769+0000 7f37f7200640 1 --2- 172.21.15.131:0/1011380668 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f37f00cf9d0 0x7f37f00ce030 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f37f802db70 tx=0x7f37f8069ee0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.769+0000 7f37f6800640 1 -- 172.21.15.131:0/1011380668 reap_dead start 2024-04-12T19:39:41.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.769+0000 7f37f7200640 1 -- 172.21.15.131:0/1011380668 shutdown_connections 2024-04-12T19:39:41.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.769+0000 7f37f7200640 1 -- 172.21.15.131:0/1011380668 >> 172.21.15.131:0/1011380668 conn(0x7f37f0047cc0 msgr2=0x7f37f00072d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.770+0000 7f37f7200640 1 -- 172.21.15.131:0/1011380668 shutdown_connections 2024-04-12T19:39:41.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.771+0000 7f37f7200640 1 -- 172.21.15.131:0/1011380668 wait complete. 2024-04-12T19:39:41.798 INFO:teuthology.orchestra.run.smithi131.stdout:55834574858 2024-04-12T19:39:41.799 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-12T19:39:41.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.772+0000 7fb1bea00640 1 -- 172.21.15.131:0/1926099622 <== osd.3 v2:172.21.15.131:6824/736798902 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb1c81ea710 con 0x7fb1a8075fe0 2024-04-12T19:39:41.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.773+0000 7fb1cda00640 1 -- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:6824/736798902,v1:172.21.15.131:6825/736798902] conn(0x7fb1a8075fe0 msgr2=0x7fb1a8078420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.773+0000 7fb1cda00640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:6824/736798902,v1:172.21.15.131:6825/736798902] conn(0x7fb1a8075fe0 0x7fb1a8078420 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.773+0000 7f7293e00640 1 -- 172.21.15.131:0/2586687389 --> [v2:172.21.15.171:6800/1706601782,v1:172.21.15.171:6801/1706601782] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f72940c4ff0 con 0x7f7274076130 2024-04-12T19:39:41.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.773+0000 7fb1cda00640 1 -- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb1a806c8f0 msgr2=0x7fb1a806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.773+0000 7fb1cda00640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb1a806c8f0 0x7fb1a806edb0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb1b8004650 tx=0x7fb1b8008040 comp rx=0 tx=0).stop 2024-04-12T19:39:41.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.773+0000 7fb1cda00640 1 -- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1c80bccd0 msgr2=0x7fb1c80bd130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.773+0000 7fb1cda00640 1 --2- 172.21.15.131:0/1926099622 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1c80bccd0 0x7fb1c80bd130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fb1ac00c4c0 tx=0x7fb1b4001970 comp rx=0 tx=0).stop 2024-04-12T19:39:41.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.774+0000 7fb1c7400640 1 -- 172.21.15.131:0/1926099622 reap_dead start 2024-04-12T19:39:41.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.775+0000 7fb1cda00640 1 -- 172.21.15.131:0/1926099622 shutdown_connections 2024-04-12T19:39:41.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.775+0000 7fb1cda00640 1 -- 172.21.15.131:0/1926099622 >> 172.21.15.131:0/1926099622 conn(0x7fb1c80a8490 msgr2=0x7fb1c80a8870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.775+0000 7f728b400640 1 -- 172.21.15.131:0/2586687389 <== osd.5 v2:172.21.15.171:6800/1706601782 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f72940c4ff0 con 0x7f7274076130 2024-04-12T19:39:41.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.775+0000 7fb1cda00640 1 -- 172.21.15.131:0/1926099622 shutdown_connections 2024-04-12T19:39:41.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.776+0000 7f7293e00640 1 -- 172.21.15.131:0/2586687389 >> [v2:172.21.15.171:6800/1706601782,v1:172.21.15.171:6801/1706601782] conn(0x7f7274076130 msgr2=0x7f7274078570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.776+0000 7fb1cda00640 1 -- 172.21.15.131:0/1926099622 wait complete. 2024-04-12T19:39:41.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.776+0000 7f7293e00640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.171:6800/1706601782,v1:172.21.15.171:6801/1706601782] conn(0x7f7274076130 0x7f7274078570 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.776+0000 7f7293e00640 1 -- 172.21.15.131:0/2586687389 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f727406c9c0 msgr2=0x7f727406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.776+0000 7f7293e00640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f727406c9c0 0x7f727406ee80 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f72941555d0 tx=0x7f7280009060 comp rx=0 tx=0).stop 2024-04-12T19:39:41.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.776+0000 7f7293e00640 1 -- 172.21.15.131:0/2586687389 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f729406dcf0 msgr2=0x7f7294155e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.776+0000 7f7293e00640 1 --2- 172.21.15.131:0/2586687389 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f729406dcf0 0x7f7294155e90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f728402be30 tx=0x7f72840046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.776+0000 7f7293400640 1 -- 172.21.15.131:0/2586687389 reap_dead start 2024-04-12T19:39:41.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.776+0000 7f7293e00640 1 -- 172.21.15.131:0/2586687389 shutdown_connections 2024-04-12T19:39:41.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.776+0000 7f7293e00640 1 -- 172.21.15.131:0/2586687389 >> 172.21.15.131:0/2586687389 conn(0x7f72940c3170 msgr2=0x7f729406bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.779+0000 7f817ae00640 1 -- 172.21.15.131:0/371105456 --> [v2:172.21.15.171:6808/285879561,v1:172.21.15.171:6809/285879561] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8174072630 con 0x7f8154076090 2024-04-12T19:39:41.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.779+0000 7f7293e00640 1 -- 172.21.15.131:0/2586687389 shutdown_connections 2024-04-12T19:39:41.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.779+0000 7f7293e00640 1 -- 172.21.15.131:0/2586687389 wait complete. 2024-04-12T19:39:41.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.780+0000 7f816be00640 1 -- 172.21.15.131:0/371105456 <== osd.7 v2:172.21.15.171:6808/285879561 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8174072630 con 0x7f8154076090 2024-04-12T19:39:41.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.780+0000 7f817ae00640 1 -- 172.21.15.131:0/371105456 >> [v2:172.21.15.171:6808/285879561,v1:172.21.15.171:6809/285879561] conn(0x7f8154076090 msgr2=0x7f81540784d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.780+0000 7f031a000640 1 -- 172.21.15.131:0/3449143270 --> [v2:172.21.15.171:6821/22785163,v1:172.21.15.171:6823/22785163] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f02f8002dd0 con 0x7f0304076270 2024-04-12T19:39:41.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.780+0000 7f817ae00640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.171:6808/285879561,v1:172.21.15.171:6809/285879561] conn(0x7f8154076090 0x7f81540784d0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.780+0000 7f817ae00640 1 -- 172.21.15.131:0/371105456 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f815406c920 msgr2=0x7f815406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.780+0000 7f817ae00640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f815406c920 0x7f815406ede0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f8164036000 tx=0x7f8164008030 comp rx=0 tx=0).stop 2024-04-12T19:39:41.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.780+0000 7f817ae00640 1 -- 172.21.15.131:0/371105456 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8174132400 msgr2=0x7f81741e72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.780+0000 7f817ae00640 1 --2- 172.21.15.131:0/371105456 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8174132400 0x7f81741e72e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f816000c490 tx=0x7f816000c950 comp rx=0 tx=0).stop 2024-04-12T19:39:41.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.781+0000 7f8178e00640 1 -- 172.21.15.131:0/371105456 reap_dead start 2024-04-12T19:39:41.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.781+0000 7f817ae00640 1 -- 172.21.15.131:0/371105456 shutdown_connections 2024-04-12T19:39:41.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.781+0000 7f817ae00640 1 -- 172.21.15.131:0/371105456 >> 172.21.15.131:0/371105456 conn(0x7f817406be00 msgr2=0x7f81740b75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.781+0000 7f817ae00640 1 -- 172.21.15.131:0/371105456 shutdown_connections 2024-04-12T19:39:41.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.781+0000 7f817ae00640 1 -- 172.21.15.131:0/371105456 wait complete. 2024-04-12T19:39:41.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.781+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 --> [v2:172.21.15.171:6816/54064703,v1:172.21.15.171:6817/54064703] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f444c155410 con 0x7f4428075f60 2024-04-12T19:39:41.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.782+0000 7f0320c00640 1 -- 172.21.15.131:0/3449143270 <== osd.4 v2:172.21.15.171:6821/22785163 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f02f8002dd0 con 0x7f0304076270 2024-04-12T19:39:41.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.782+0000 7f4448c00640 1 -- 172.21.15.131:0/111101398 <== osd.6 v2:172.21.15.171:6816/54064703 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f444c155410 con 0x7f4428075f60 2024-04-12T19:39:41.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.783+0000 7f031a000640 1 -- 172.21.15.131:0/3449143270 >> [v2:172.21.15.171:6821/22785163,v1:172.21.15.171:6823/22785163] conn(0x7f0304076270 msgr2=0x7f03040786b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.783+0000 7f031a000640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.171:6821/22785163,v1:172.21.15.171:6823/22785163] conn(0x7f0304076270 0x7f03040786b0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.783+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 >> [v2:172.21.15.171:6816/54064703,v1:172.21.15.171:6817/54064703] conn(0x7f4428075f60 msgr2=0x7f44280783a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.783+0000 7f4451400640 1 --2- 172.21.15.131:0/111101398 >> [v2:172.21.15.171:6816/54064703,v1:172.21.15.171:6817/54064703] conn(0x7f4428075f60 0x7f44280783a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.783+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f442806c8f0 msgr2=0x7f442806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.783+0000 7f4451400640 1 --2- 172.21.15.131:0/111101398 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f442806c8f0 0x7f442806edb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f4434036000 tx=0x7f4434008030 comp rx=0 tx=0).stop 2024-04-12T19:39:41.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.784+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f444c06cd50 msgr2=0x7f444c154820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.784+0000 7f4451400640 1 --2- 172.21.15.131:0/111101398 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f444c06cd50 0x7f444c154820 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f443c00c3f0 tx=0x7f443c00c8b0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.784+0000 7f4450a00640 1 -- 172.21.15.131:0/111101398 reap_dead start 2024-04-12T19:39:41.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.784+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 shutdown_connections 2024-04-12T19:39:41.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.784+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 >> 172.21.15.131:0/111101398 conn(0x7f444c0c6780 msgr2=0x7f444c14fbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.784+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 shutdown_connections 2024-04-12T19:39:41.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.784+0000 7f4451400640 1 -- 172.21.15.131:0/111101398 wait complete. 2024-04-12T19:39:41.811 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-04-12T19:39:41.811 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-12T19:39:41.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.785+0000 7f031a000640 1 -- 172.21.15.131:0/3449143270 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f030406caf0 msgr2=0x7f030406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.785+0000 7f031a000640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f030406caf0 0x7f030406efb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0314036000 tx=0x7f031403b040 comp rx=0 tx=0).stop 2024-04-12T19:39:41.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.785+0000 7f031a000640 1 -- 172.21.15.131:0/3449143270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0324157740 msgr2=0x7f0324147be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:41.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.785+0000 7f031a000640 1 --2- 172.21.15.131:0/3449143270 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0324157740 0x7f0324147be0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f031000c3f0 tx=0x7f031000c8b0 comp rx=0 tx=0).stop 2024-04-12T19:39:41.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.786+0000 7f0329a00640 1 -- 172.21.15.131:0/3449143270 reap_dead start 2024-04-12T19:39:41.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.786+0000 7f031a000640 1 -- 172.21.15.131:0/3449143270 shutdown_connections 2024-04-12T19:39:41.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.786+0000 7f031a000640 1 -- 172.21.15.131:0/3449143270 >> 172.21.15.131:0/3449143270 conn(0x7f03240a62c0 msgr2=0x7f03240c0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:41.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.787+0000 7f031a000640 1 -- 172.21.15.131:0/3449143270 shutdown_connections 2024-04-12T19:39:41.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:41.787+0000 7f031a000640 1 -- 172.21.15.131:0/3449143270 wait complete. 2024-04-12T19:39:41.813 INFO:teuthology.orchestra.run.smithi131.stdout:55834574858 2024-04-12T19:39:41.814 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-12T19:39:41.814 INFO:teuthology.orchestra.run.smithi131.stdout:55834574858 2024-04-12T19:39:41.815 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-12T19:39:41.816 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-04-12T19:39:41.816 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-12T19:39:41.817 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-04-12T19:39:41.817 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-12T19:39:41.818 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-04-12T19:39:41.818 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-12T19:39:41.819 INFO:teuthology.orchestra.run.smithi131.stdout:55834574858 2024-04-12T19:39:41.819 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-12T19:39:42.138 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.138+0000 7f52f0600640 1 Processor -- start 2024-04-12T19:39:42.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.138+0000 7f52f0600640 1 -- start start 2024-04-12T19:39:42.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.140+0000 7f52f0600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f52e80be210 0x7f52e80bd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.140+0000 7f52f0600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e814d160 con 0x7f52e80a8100 2024-04-12T19:39:42.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.140+0000 7f52f0600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e80bcd00 con 0x7f52e8147280 2024-04-12T19:39:42.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.140+0000 7f52f0600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f52e80a6300 con 0x7f52e80be210 2024-04-12T19:39:42.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.141+0000 7f52ee600640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f52e8147280 0x7f52e8157790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.131:41280/0 (socket says 172.21.15.131:41280) 2024-04-12T19:39:42.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.141+0000 7f52ee600640 1 -- 172.21.15.131:0/1212258286 learned_addr learned my addr 172.21.15.131:0/1212258286 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:42.141 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.141+0000 7f52ed200640 1 --2- 172.21.15.131:0/1212258286 >> v2:172.21.15.131:3300/0 conn(0x7f52e80be210 0x7f52e80bd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.142+0000 7f52ed200640 1 -- 172.21.15.131:0/1212258286 >> v1:172.21.15.171:6789/0 conn(0x7f52e8147280 legacy=0x7f52e8157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.142+0000 7f52e7e00640 1 -- 172.21.15.131:0/1212258286 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396997318 0 0) 0x7f52e80bcd00 con 0x7f52e8147280 2024-04-12T19:39:42.142 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.142+0000 7f52ed200640 1 -- 172.21.15.131:0/1212258286 >> v1:172.21.15.131:6789/0 conn(0x7f52e80a8100 legacy=0x7f52e806e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.143 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.143+0000 7f52ed200640 1 -- 172.21.15.131:0/1212258286 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e80bcfe0 con 0x7f52e80be210 2024-04-12T19:39:42.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.144+0000 7feddb000640 1 Processor -- start 2024-04-12T19:39:42.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.144+0000 7f52ed200640 1 --2- 172.21.15.131:0/1212258286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80be210 0x7f52e80bd7e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009a00 tx=0x7f52dc02b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e46ee547476557f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.144+0000 7feddb000640 1 -- start start 2024-04-12T19:39:42.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.145+0000 7f52e7e00640 1 -- 172.21.15.131:0/1212258286 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc034070 con 0x7f52e80be210 2024-04-12T19:39:42.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.145+0000 7f52e7e00640 1 -- 172.21.15.131:0/1212258286 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52dc030620 con 0x7f52e80be210 2024-04-12T19:39:42.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.145+0000 7f52e7e00640 1 -- 172.21.15.131:0/1212258286 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc0309f0 con 0x7f52e80be210 2024-04-12T19:39:42.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.146+0000 7f52f0600640 1 -- 172.21.15.131:0/1212258286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80be210 msgr2=0x7f52e80bd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.146+0000 7f52f0600640 1 --2- 172.21.15.131:0/1212258286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80be210 0x7f52e80bd7e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009a00 tx=0x7f52dc02b9f0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.147+0000 7f52f0600640 1 -- 172.21.15.131:0/1212258286 shutdown_connections 2024-04-12T19:39:42.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.147+0000 7f52f0600640 1 --2- 172.21.15.131:0/1212258286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80be210 0x7f52e80bd7e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.147+0000 7f52f0600640 1 -- 172.21.15.131:0/1212258286 >> 172.21.15.131:0/1212258286 conn(0x7f52e806cce0 msgr2=0x7f52e806d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.147+0000 7f52f0600640 1 -- 172.21.15.131:0/1212258286 shutdown_connections 2024-04-12T19:39:42.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.147+0000 7f52f0600640 1 -- 172.21.15.131:0/1212258286 wait complete. 2024-04-12T19:39:42.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.148+0000 7feddb000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fedd40c6960 0x7fedd40c2e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.148+0000 7feddb000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd414fa90 con 0x7fedd40c1360 2024-04-12T19:39:42.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.149+0000 7feddb000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedd406f410 con 0x7fedd4159070 2024-04-12T19:39:42.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.149+0000 7fedd3400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fedd40c6960 0x7fedd40c2e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.150+0000 7fedd3400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fedd40c6960 0x7fedd40c2e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:34980/0 (socket says 172.21.15.131:34980) 2024-04-12T19:39:42.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.150+0000 7fedd3400640 1 -- 172.21.15.131:0/3925990938 learned_addr learned my addr 172.21.15.131:0/3925990938 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:42.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.149+0000 7fedd9000640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fedd4159070 0x7fedd415fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.131:41294/0 (socket says 172.21.15.131:41294) 2024-04-12T19:39:42.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.150+0000 7feddb000640 1 -- 172.21.15.131:0/3925990938 --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fedd406f1c0 con 0x7fedd40c6960 2024-04-12T19:39:42.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.151+0000 7f52f0600640 1 Processor -- start 2024-04-12T19:39:42.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.151+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1465475601 0 0) 0x7fedd414fa90 con 0x7fedd40c1360 2024-04-12T19:39:42.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.151+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedb8003520 con 0x7fedd40c1360 2024-04-12T19:39:42.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.151+0000 7f52f0600640 1 -- start start 2024-04-12T19:39:42.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.151+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2065674408 0 0) 0x7fedd406f410 con 0x7fedd4159070 2024-04-12T19:39:42.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.151+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedd414fa90 con 0x7fedd4159070 2024-04-12T19:39:42.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.151+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2625045287 0 0) 0x7fedb8003520 con 0x7fedd40c1360 2024-04-12T19:39:42.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.151+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 >> v2:172.21.15.171:3300/0 conn(0x7fedd40c6960 msgr2=0x7fedd40c2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:42.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.152+0000 7fedd2a00640 1 --2- 172.21.15.131:0/3925990938 >> v2:172.21.15.171:3300/0 conn(0x7fedd40c6960 0x7fedd40c2e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.152+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 >> v1:172.21.15.171:6789/0 conn(0x7fedd4159070 legacy=0x7fedd415fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.152+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd406f6f0 con 0x7fedd40c1360 2024-04-12T19:39:42.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.152+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7fedc4001670 con 0x7fedd40c1360 2024-04-12T19:39:42.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.152+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 >> v1:172.21.15.131:6789/0 conn(0x7fedd40c1360 legacy=0x7fedd4158960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.152+0000 7fedd2a00640 1 --2- 172.21.15.131:0/3925990938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb8004bf0 0x7fedb8004ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.152+0000 7fedd2a00640 1 --2- 172.21.15.131:0/3925990938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb80037a0 0x7fedb8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.152+0000 7fedd2a00640 1 --2- 172.21.15.131:0/3925990938 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb8004160 0x7fedb800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.152+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fedd406f1c0 con 0x7fedb80037a0 2024-04-12T19:39:42.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.152+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fedb800c090 con 0x7fedb8004bf0 2024-04-12T19:39:42.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.152+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fedb800c290 con 0x7fedb8004160 2024-04-12T19:39:42.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.152+0000 7f52f0600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52e80a8100 0x7f52e81d8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.153+0000 7f52f0600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80be210 0x7f52e80b7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.153+0000 7f52f0600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52e8147280 0x7f52e81e6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.153+0000 7f52f0600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f52e80b71c0 con 0x7f52e80be210 2024-04-12T19:39:42.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.153+0000 7f52f0600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f52e80bdd90 con 0x7f52e80a8100 2024-04-12T19:39:42.154 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.153+0000 7f52f0600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f52e806e8c0 con 0x7f52e8147280 2024-04-12T19:39:42.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.153+0000 7fedd9000640 1 --2- 172.21.15.131:0/3925990938 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb8004160 0x7fedb800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.153+0000 7fedd3400640 1 --2- 172.21.15.131:0/3925990938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb80037a0 0x7fedb8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.153+0000 7f52edc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52e80a8100 0x7f52e81d8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7f52ed200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80be210 0x7f52e80b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7f52ed200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80be210 0x7f52e80b7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41276/0 (socket says 172.21.15.131:41276) 2024-04-12T19:39:42.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7f52edc00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52e80a8100 0x7f52e81d8ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:34990/0 (socket says 172.21.15.131:34990) 2024-04-12T19:39:42.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7f52ed200640 1 -- 172.21.15.131:0/714812855 learned_addr learned my addr 172.21.15.131:0/714812855 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:42.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7fedd3e00640 1 --2- 172.21.15.131:0/3925990938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb8004bf0 0x7fedb8004ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7f52ee600640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52e8147280 0x7f52e81e6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.155+0000 7f52ed200640 1 -- 172.21.15.131:0/714812855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52e8147280 msgr2=0x7f52e81e6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.155+0000 7f52ed200640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52e8147280 0x7f52e81e6350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.155+0000 7f52ed200640 1 -- 172.21.15.131:0/714812855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52e80a8100 msgr2=0x7f52e81d8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.155+0000 7f52ed200640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52e80a8100 0x7f52e81d8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.155+0000 7f52ed200640 1 -- 172.21.15.131:0/714812855 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e81d7400 con 0x7f52e80be210 2024-04-12T19:39:42.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7fedd3400640 1 -- 172.21.15.131:0/3925990938 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb8004160 msgr2=0x7fedb800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:42.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7fedd3400640 1 --2- 172.21.15.131:0/3925990938 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb8004160 0x7fedb800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7fedd3400640 1 -- 172.21.15.131:0/3925990938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb8004bf0 msgr2=0x7fedb8004ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:42.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7fedd3400640 1 --2- 172.21.15.131:0/3925990938 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedb8004bf0 0x7fedb8004ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.155+0000 7f52ed200640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80be210 0x7f52e80b7440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f52dc000c00 tx=0x7f52dc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7fedd3400640 1 -- 172.21.15.131:0/3925990938 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb8003520 con 0x7fedb80037a0 2024-04-12T19:39:42.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.156+0000 7fedd9000640 1 -- 172.21.15.131:0/3925990938 reap_dead start 2024-04-12T19:39:42.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.156+0000 7fedd3400640 1 --2- 172.21.15.131:0/3925990938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb80037a0 0x7fedb8003c20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009be0 tx=0x7fedb8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea83e1f546c37282 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.156+0000 7fc7f3000640 1 Processor -- start 2024-04-12T19:39:42.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.156+0000 7fc7f3000640 1 -- start start 2024-04-12T19:39:42.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7f77b9a00640 1 Processor -- start 2024-04-12T19:39:42.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.154+0000 7f77b9a00640 1 -- start start 2024-04-12T19:39:42.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.156+0000 7f77b9a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f77b414f8e0 0x7f77b406e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.156+0000 7f52e5600640 1 -- 172.21.15.131:0/714812855 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc048070 con 0x7f52e80be210 2024-04-12T19:39:42.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.156+0000 7f52e5600640 1 -- 172.21.15.131:0/714812855 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52dc030ae0 con 0x7f52e80be210 2024-04-12T19:39:42.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.157+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc0039070 con 0x7fedb80037a0 2024-04-12T19:39:42.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.157+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc002c7a0 con 0x7fedb80037a0 2024-04-12T19:39:42.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.157+0000 7fedd2a00640 1 -- 172.21.15.131:0/3925990938 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc00097e0 con 0x7fedb80037a0 2024-04-12T19:39:42.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.156+0000 7f77b9a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b40b8270 con 0x7f77b406e860 2024-04-12T19:39:42.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.156+0000 7f77b9a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77b40be3c0 con 0x7f77b406f300 2024-04-12T19:39:42.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.156+0000 7f77b9a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f77b40be6a0 con 0x7f77b414f8e0 2024-04-12T19:39:42.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.157+0000 7f52e5600640 1 -- 172.21.15.131:0/714812855 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc034050 con 0x7f52e80be210 2024-04-12T19:39:42.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.157+0000 7f77b9000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f77b406e860 0x7f77b415fcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34218/0 (socket says 172.21.15.131:34218) 2024-04-12T19:39:42.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.157+0000 7f77b9000640 1 -- 172.21.15.131:0/1894983276 learned_addr learned my addr 172.21.15.131:0/1894983276 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:42.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.158+0000 7f52f0600640 1 -- 172.21.15.131:0/714812855 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52e81e5d40 con 0x7f52e80be210 2024-04-12T19:39:42.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.158+0000 7f77b3e00640 1 --2- 172.21.15.131:0/1894983276 >> v2:172.21.15.171:3300/0 conn(0x7f77b414f8e0 0x7f77b406e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.158+0000 7f52f0600640 1 -- 172.21.15.131:0/714812855 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52e81d84a0 con 0x7f52e80be210 2024-04-12T19:39:42.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.159+0000 7feddb000640 1 -- 172.21.15.131:0/3925990938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb80037a0 msgr2=0x7fedb8003c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.159+0000 7feddb000640 1 --2- 172.21.15.131:0/3925990938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb80037a0 0x7fedb8003c20 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009be0 tx=0x7fedb8005830 comp rx=0 tx=0).stop 2024-04-12T19:39:42.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.159+0000 7feddb000640 1 -- 172.21.15.131:0/3925990938 shutdown_connections 2024-04-12T19:39:42.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.159+0000 7feddb000640 1 --2- 172.21.15.131:0/3925990938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedb80037a0 0x7fedb8003c20 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.159+0000 7feddb000640 1 -- 172.21.15.131:0/3925990938 >> 172.21.15.131:0/3925990938 conn(0x7fedd406b9e0 msgr2=0x7fedd406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.159+0000 7f77b2a00640 1 -- 172.21.15.131:0/1894983276 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3636348088 0 0) 0x7f77b40be3c0 con 0x7f77b406f300 2024-04-12T19:39:42.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.159+0000 7f77b2a00640 1 -- 172.21.15.131:0/1894983276 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7798003520 con 0x7f77b406f300 2024-04-12T19:39:42.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.157+0000 7fc7f3000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec14b260 0x7fc7ec06c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.157+0000 7fc7f3000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7ec0c6030 con 0x7fc7ec14ae80 2024-04-12T19:39:42.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.157+0000 7fc7f3000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7ec1518f0 con 0x7fc7ec0c2ae0 2024-04-12T19:39:42.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.157+0000 7fc7f3000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ec151e90 con 0x7fc7ec14b260 2024-04-12T19:39:42.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.158+0000 7fc7f1c00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc7ec14ae80 0x7fc7ec0c5600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34226/0 (socket says 172.21.15.131:34226) 2024-04-12T19:39:42.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.158+0000 7fc7f1c00640 1 -- 172.21.15.131:0/3392893825 learned_addr learned my addr 172.21.15.131:0/3392893825 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:42.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.159+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690070713 0 0) 0x7fc7ec0c6030 con 0x7fc7ec14ae80 2024-04-12T19:39:42.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.159+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7d4003520 con 0x7fc7ec14ae80 2024-04-12T19:39:42.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2910012657 0 0) 0x7fc7ec1518f0 con 0x7fc7ec0c2ae0 2024-04-12T19:39:42.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7ec0c6030 con 0x7fc7ec0c2ae0 2024-04-12T19:39:42.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3592658046 0 0) 0x7fc7d4003520 con 0x7fc7ec14ae80 2024-04-12T19:39:42.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec14b260 msgr2=0x7fc7ec06c300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T19:39:42.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7fc7ebe00640 1 --2- 172.21.15.131:0/3392893825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec14b260 0x7fc7ec06c300 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 >> v1:172.21.15.171:6789/0 conn(0x7fc7ec0c2ae0 legacy=0x7fc7ec0ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ec0ac570 con 0x7fc7ec14ae80 2024-04-12T19:39:42.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7fc7e00019f0 con 0x7fc7ec14ae80 2024-04-12T19:39:42.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 >> v1:172.21.15.131:6789/0 conn(0x7fc7ec14ae80 legacy=0x7fc7ec0c5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7fc7ebe00640 1 --2- 172.21.15.131:0/3392893825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d4003b70 0x7fc7d4003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7fc7ebe00640 1 --2- 172.21.15.131:0/3392893825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7d4004800 0x7fc7d4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7fc7ebe00640 1 --2- 172.21.15.131:0/3392893825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec14b260 0x7fc7d4005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.161+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec151e90 con 0x7fc7d4003b70 2024-04-12T19:39:42.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.161+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d401cbc0 con 0x7fc7d4004800 2024-04-12T19:39:42.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.161+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7d401cdc0 con 0x7fc7ec14b260 2024-04-12T19:39:42.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.161+0000 7f52f0600640 1 -- 172.21.15.131:0/714812855 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e804fd50 con 0x7f52e80be210 2024-04-12T19:39:42.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.159+0000 7feddb000640 1 -- 172.21.15.131:0/3925990938 shutdown_connections 2024-04-12T19:39:42.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7feddb000640 1 -- 172.21.15.131:0/3925990938 wait complete. 2024-04-12T19:39:42.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7f77b3e00640 1 -- 172.21.15.131:0/1894983276 >> v1:172.21.15.171:6789/0 conn(0x7f77b406f300 legacy=0x7f77b41555c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7f77b3e00640 1 -- 172.21.15.131:0/1894983276 >> v1:172.21.15.131:6789/0 conn(0x7f77b406e860 legacy=0x7f77b415fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.160+0000 7f77b3e00640 1 -- 172.21.15.131:0/1894983276 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b40be980 con 0x7f77b414f8e0 2024-04-12T19:39:42.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.161+0000 7fc7f2600640 1 --2- 172.21.15.131:0/3392893825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec14b260 0x7fc7d4005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.161+0000 7f52e5600640 1 -- 172.21.15.131:0/714812855 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f52dc037070 con 0x7f52e80be210 2024-04-12T19:39:42.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.162+0000 7fc7f1c00640 1 --2- 172.21.15.131:0/3392893825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d4003b70 0x7fc7d4003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.162+0000 7fc7f2600640 1 -- 172.21.15.131:0/3392893825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7d4004800 msgr2=0x7fc7d4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:42.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.162+0000 7fc7f2600640 1 --2- 172.21.15.131:0/3392893825 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7d4004800 0x7fc7d4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.162+0000 7fc7f2600640 1 -- 172.21.15.131:0/3392893825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d4003b70 msgr2=0x7fc7d4003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:42.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.162+0000 7fc7f2600640 1 --2- 172.21.15.131:0/3392893825 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7d4003b70 0x7fc7d4003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.169 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.162+0000 7fc7f2600640 1 -- 172.21.15.131:0/3392893825 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ec0ac570 con 0x7fc7ec14b260 2024-04-12T19:39:42.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.163+0000 7f52e5600640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f52c806c940 0x7f52c806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.163+0000 7f77b3e00640 1 --2- 172.21.15.131:0/1894983276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b414f8e0 0x7f77b406e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009d90 tx=0x7f77ac02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=30bae08db6eecbb server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.163+0000 7f52e5600640 1 -- 172.21.15.131:0/714812855 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f52dc0ad540 con 0x7f52e80be210 2024-04-12T19:39:42.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.163+0000 7f77b2a00640 1 -- 172.21.15.131:0/1894983276 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac039070 con 0x7f77b414f8e0 2024-04-12T19:39:42.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.163+0000 7f77b2a00640 1 -- 172.21.15.131:0/1894983276 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77ac02cd10 con 0x7f77b414f8e0 2024-04-12T19:39:42.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.164+0000 7f77b2a00640 1 -- 172.21.15.131:0/1894983276 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77ac034640 con 0x7f77b414f8e0 2024-04-12T19:39:42.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.164+0000 7fc7f2600640 1 --2- 172.21.15.131:0/3392893825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec14b260 0x7fc7d4005270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009860 tx=0x7fc7d4005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4ce803aaf4f2e5ea server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.164+0000 7f77b9a00640 1 -- 172.21.15.131:0/1894983276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b414f8e0 msgr2=0x7f77b406e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.164+0000 7f77b9a00640 1 --2- 172.21.15.131:0/1894983276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b414f8e0 0x7f77b406e320 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77ac009d90 tx=0x7f77ac02bf60 comp rx=0 tx=0).stop 2024-04-12T19:39:42.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.165+0000 7f77b9a00640 1 -- 172.21.15.131:0/1894983276 shutdown_connections 2024-04-12T19:39:42.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.165+0000 7f77b9a00640 1 --2- 172.21.15.131:0/1894983276 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b414f8e0 0x7f77b406e320 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.165+0000 7f77b9a00640 1 -- 172.21.15.131:0/1894983276 >> 172.21.15.131:0/1894983276 conn(0x7f77b40bef80 msgr2=0x7f77b40bf390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.165+0000 7f77b9a00640 1 -- 172.21.15.131:0/1894983276 shutdown_connections 2024-04-12T19:39:42.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.165+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4037070 con 0x7fc7ec14b260 2024-04-12T19:39:42.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.165+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e402be50 con 0x7fc7ec14b260 2024-04-12T19:39:42.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.165+0000 7fc7ebe00640 1 -- 172.21.15.131:0/3392893825 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e40093b0 con 0x7fc7ec14b260 2024-04-12T19:39:42.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.165+0000 7f77b9a00640 1 -- 172.21.15.131:0/1894983276 wait complete. 2024-04-12T19:39:42.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.165+0000 7feddb000640 1 Processor -- start 2024-04-12T19:39:42.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.166+0000 7feddb000640 1 -- start start 2024-04-12T19:39:42.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.165+0000 7f52edc00640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f52c806c940 0x7f52c806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.166+0000 7fc7f3000640 1 -- 172.21.15.131:0/3392893825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec14b260 msgr2=0x7fc7d4005270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.166+0000 7f0251600640 1 Processor -- start 2024-04-12T19:39:42.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.166+0000 7fc7f3000640 1 --2- 172.21.15.131:0/3392893825 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec14b260 0x7fc7d4005270 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc7e4009860 tx=0x7fc7d4005830 comp rx=0 tx=0).stop 2024-04-12T19:39:42.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.166+0000 7fc7f2600640 1 -- 172.21.15.131:0/3392893825 reap_dead start 2024-04-12T19:39:42.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.167+0000 7fc7f3000640 1 -- 172.21.15.131:0/3392893825 shutdown_connections 2024-04-12T19:39:42.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.167+0000 7fc7f3000640 1 -- 172.21.15.131:0/3392893825 >> 172.21.15.131:0/3392893825 conn(0x7fc7ec0c3170 msgr2=0x7fc7ec0c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.167+0000 7fc7f3000640 1 -- 172.21.15.131:0/3392893825 shutdown_connections 2024-04-12T19:39:42.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.167+0000 7f52edc00640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f52c806c940 0x7f52c806ee00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f52d4001920 tx=0x7f52d4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.167+0000 7f77b9a00640 1 Processor -- start 2024-04-12T19:39:42.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.166+0000 7f0251600640 1 -- start start 2024-04-12T19:39:42.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.168+0000 7fc7f3000640 1 -- 172.21.15.131:0/3392893825 wait complete. 2024-04-12T19:39:42.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.168+0000 7f0251600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0c28c0 0x7f024c0c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.168+0000 7f0251600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f024c0c3730 0x7f024c15ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.168+0000 7f0251600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f024c0c5e80 con 0x7f024c0c17a0 2024-04-12T19:39:42.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.168+0000 7f0251600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f024c0c59f0 con 0x7f024c0c3730 2024-04-12T19:39:42.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.168+0000 7f0251600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f024c0c2d20 con 0x7f024c0c28c0 2024-04-12T19:39:42.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.168+0000 7f2d11e00640 1 Processor -- start 2024-04-12T19:39:42.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.169+0000 7f2d11e00640 1 -- start start 2024-04-12T19:39:42.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.168+0000 7f77b9a00640 1 -- start start 2024-04-12T19:39:42.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.169+0000 7f024aa00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f024c0c17a0 0x7f024c1511e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34240/0 (socket says 172.21.15.131:34240) 2024-04-12T19:39:42.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.169+0000 7f024aa00640 1 -- 172.21.15.131:0/3037611703 learned_addr learned my addr 172.21.15.131:0/3037611703 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:42.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.169+0000 7f024b400640 1 --2- 172.21.15.131:0/3037611703 >> v2:172.21.15.171:3300/0 conn(0x7f024c0c3730 0x7f024c15ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7f024a000640 1 --2- 172.21.15.131:0/3037611703 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0c28c0 0x7f024c0c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7feddb000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb80037a0 0x7fedd41520a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7f024b400640 1 -- 172.21.15.131:0/3037611703 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0c28c0 msgr2=0x7f024c0c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:42.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7f024b400640 1 --2- 172.21.15.131:0/3037611703 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0c28c0 0x7f024c0c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7f024b400640 1 -- 172.21.15.131:0/3037611703 >> v1:172.21.15.131:6789/0 conn(0x7f024c0c17a0 legacy=0x7f024c1511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7f024b400640 1 -- 172.21.15.131:0/3037611703 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c0c4020 con 0x7f024c0c3730 2024-04-12T19:39:42.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7fd449000640 1 Processor -- start 2024-04-12T19:39:42.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7feddb000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedd4152940 0x7fedd41edae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.171+0000 7fd449000640 1 -- start start 2024-04-12T19:39:42.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7feddb000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd41f45e0 0x7fedd4155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7feddb000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fedd40c6160 con 0x7fedd41f45e0 2024-04-12T19:39:42.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7feddb000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fedd40c64d0 con 0x7fedd4152940 2024-04-12T19:39:42.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7feddb000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fedd4159520 con 0x7fedb80037a0 2024-04-12T19:39:42.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.171+0000 7f2d11e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d0c0a7670 0x7f2d0c150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.171+0000 7f2d11e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2d0c0bd9e0 0x7f2d0c0b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.171+0000 7fc7f3000640 1 Processor -- start 2024-04-12T19:39:42.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7f77b9a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77b406e860 0x7f77b41ef290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7f77b9a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77b406f300 0x7f77b41548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7f77b9a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b414f8e0 0x7f77b40bbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7f77b9a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f77b40b7fe0 con 0x7f77b406e860 2024-04-12T19:39:42.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7f77b9a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f77b40b7e60 con 0x7f77b414f8e0 2024-04-12T19:39:42.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.170+0000 7f77b9a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f77b4155cd0 con 0x7f77b406f300 2024-04-12T19:39:42.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.171+0000 7f77b3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77b406e860 0x7f77b41ef290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.171+0000 7f77b3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77b406e860 0x7f77b41ef290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41292/0 (socket says 172.21.15.131:41292) 2024-04-12T19:39:42.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.171+0000 7f77b3e00640 1 -- 172.21.15.131:0/1035301327 learned_addr learned my addr 172.21.15.131:0/1035301327 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.171+0000 7f77b9000640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b414f8e0 0x7f77b40bbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7f2d11e00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d0c0bd560 con 0x7f2d0c0b8620 2024-04-12T19:39:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7f2d11e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2d0c0bf7b0 con 0x7f2d0c0bd9e0 2024-04-12T19:39:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7f2d11e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0c0bfa90 con 0x7f2d0c0a7670 2024-04-12T19:39:42.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7f77b3400640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77b406f300 0x7f77b41548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7f2d0a000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2d0c0bd9e0 0x7f2d0c0b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7f2d0a000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2d0c0bd9e0 0x7f2d0c0b80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:35046/0 (socket says 172.21.15.131:35046) 2024-04-12T19:39:42.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7f2d0a000640 1 -- 172.21.15.131:0/2267687438 learned_addr learned my addr 172.21.15.131:0/2267687438 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:42.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7f2d0aa00640 1 --2- 172.21.15.131:0/2267687438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d0c0a7670 0x7f2d0c150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7fedd9000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd41f45e0 0x7fedd4155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7fedd3e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb80037a0 0x7fedd41520a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7fedd9000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd41f45e0 0x7fedd4155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41306/0 (socket says 172.21.15.131:41306) 2024-04-12T19:39:42.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7fedd9000640 1 -- 172.21.15.131:0/1186668470 learned_addr learned my addr 172.21.15.131:0/1186668470 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:42.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7fd449000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd4440a7670 0x7fd444150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7f024b400640 1 --2- 172.21.15.131:0/3037611703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c0c3730 0x7f024c15ba80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f023c0097a0 tx=0x7f023c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1c6743b90db62f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7fd449000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd444155ae0 0x7fd444157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fd449000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4440bd560 con 0x7fd4440bd9e0 2024-04-12T19:39:42.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7f77b9000640 1 -- 172.21.15.131:0/1035301327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77b406f300 msgr2=0x7f77b41548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7fc7f3000640 1 -- start start 2024-04-12T19:39:42.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fc7f3000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7ec14b260 0x7fc7ec0bf590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fc7f3000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7ec0bfad0 0x7fc7ec148c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fc7f3000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec1491a0 0x7fc7ec14d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fc7f3000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec0c5d10 con 0x7fc7ec14b260 2024-04-12T19:39:42.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fc7f3000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ec06be70 con 0x7fc7ec0bfad0 2024-04-12T19:39:42.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fc7f3000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ec0a5f40 con 0x7fc7ec1491a0 2024-04-12T19:39:42.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7f2d0a000640 1 -- 172.21.15.131:0/2267687438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d0c0a7670 msgr2=0x7f2d0c150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:42.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7f2d0a000640 1 --2- 172.21.15.131:0/2267687438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d0c0a7670 0x7f2d0c150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7f2d0a000640 1 -- 172.21.15.131:0/2267687438 >> v1:172.21.15.131:6789/0 conn(0x7f2d0c0b8620 legacy=0x7f2d0c0bdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.172+0000 7fedd3400640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedd4152940 0x7fedd41edae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7f2d0a000640 1 -- 172.21.15.131:0/2267687438 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0c0bfd70 con 0x7f2d0c0bd9e0 2024-04-12T19:39:42.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fedd9000640 1 -- 172.21.15.131:0/1186668470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb80037a0 msgr2=0x7fedd41520a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fedd9000640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb80037a0 0x7fedd41520a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fedd9000640 1 -- 172.21.15.131:0/1186668470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedd4152940 msgr2=0x7fedd41edae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fedd9000640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedd4152940 0x7fedd41edae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fedd9000640 1 -- 172.21.15.131:0/1186668470 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedd41525e0 con 0x7fedd41f45e0 2024-04-12T19:39:42.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fedd9000640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd41f45e0 0x7fedd4155510 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fedd40ad920 tx=0x7fedcc007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fd449000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd4440bf7b0 con 0x7fd4440a7670 2024-04-12T19:39:42.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fd449000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd4440bfa90 con 0x7fd444155ae0 2024-04-12T19:39:42.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7f77b9000640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77b406f300 0x7f77b41548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7f77b9000640 1 -- 172.21.15.131:0/1035301327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77b406e860 msgr2=0x7f77b41ef290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7f77b9000640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77b406e860 0x7f77b41ef290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7f77b9000640 1 -- 172.21.15.131:0/1035301327 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77b40a78d0 con 0x7f77b414f8e0 2024-04-12T19:39:42.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7fc7f1c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7ec14b260 0x7fc7ec0bf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7f0249600640 1 -- 172.21.15.131:0/3037611703 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c035020 con 0x7f024c0c3730 2024-04-12T19:39:42.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7f0249600640 1 -- 172.21.15.131:0/3037611703 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f023c031810 con 0x7f024c0c3730 2024-04-12T19:39:42.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7f0249600640 1 -- 172.21.15.131:0/3037611703 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f023c031be0 con 0x7f024c0c3730 2024-04-12T19:39:42.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fd441400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd4440bd9e0 0x7fd4440b80e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34250/0 (socket says 172.21.15.131:34250) 2024-04-12T19:39:42.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.173+0000 7fd441400640 1 -- 172.21.15.131:0/1210759838 learned_addr learned my addr 172.21.15.131:0/1210759838 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:42.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7fd442800640 1 --2- 172.21.15.131:0/1210759838 >> v2:172.21.15.171:3300/0 conn(0x7fd444155ae0 0x7fd444157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7f77b3e00640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77b406e860 0x7f77b41ef290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:39:42.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7fedcbe00640 1 -- 172.21.15.131:0/1186668470 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc00f8b0 con 0x7fedd41f45e0 2024-04-12T19:39:42.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7fedcbe00640 1 -- 172.21.15.131:0/1186668470 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedcc018070 con 0x7fedd41f45e0 2024-04-12T19:39:42.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7fedcbe00640 1 -- 172.21.15.131:0/1186668470 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedcc00fc70 con 0x7fedd41f45e0 2024-04-12T19:39:42.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7feddb000640 1 -- 172.21.15.131:0/1186668470 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedd40adbd0 con 0x7fedd41f45e0 2024-04-12T19:39:42.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7fc7f1c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7ec14b260 0x7fc7ec0bf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41324/0 (socket says 172.21.15.131:41324) 2024-04-12T19:39:42.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7fc7f1c00640 1 -- 172.21.15.131:0/534051852 learned_addr learned my addr 172.21.15.131:0/534051852 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:42.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7fc7f2600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec1491a0 0x7fc7ec14d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7fd441e00640 1 --2- 172.21.15.131:0/1210759838 >> v2:172.21.15.131:3300/0 conn(0x7fd4440a7670 0x7fd444150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7fd440a00640 1 -- 172.21.15.131:0/1210759838 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561048271 0 0) 0x7fd4440bd560 con 0x7fd4440bd9e0 2024-04-12T19:39:42.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7fd440a00640 1 -- 172.21.15.131:0/1210759838 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd428003520 con 0x7fd4440bd9e0 2024-04-12T19:39:42.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f77b9000640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b414f8e0 0x7f77b40bbcb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f77a000c390 tx=0x7f77a000c790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f0251600640 1 -- 172.21.15.131:0/3037611703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c0c3730 msgr2=0x7f024c15ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f0251600640 1 --2- 172.21.15.131:0/3037611703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c0c3730 0x7f024c15ba80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f023c0097a0 tx=0x7f023c02b8b0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f77abe00640 1 -- 172.21.15.131:0/1035301327 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a0017070 con 0x7f77b414f8e0 2024-04-12T19:39:42.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.174+0000 7fc7f1200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7ec0bfad0 0x7fc7ec148c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7fd442800640 1 -- 172.21.15.131:0/1210759838 >> v2:172.21.15.131:3300/0 conn(0x7fd4440a7670 msgr2=0x7fd444150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:42.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7fd440a00640 1 -- 172.21.15.131:0/1210759838 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1209536847 0 0) 0x7fd428003520 con 0x7fd4440bd9e0 2024-04-12T19:39:42.198 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7fd442800640 1 --2- 172.21.15.131:0/1210759838 >> v2:172.21.15.131:3300/0 conn(0x7fd4440a7670 0x7fd444150fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7fd442800640 1 -- 172.21.15.131:0/1210759838 >> v1:172.21.15.131:6789/0 conn(0x7fd4440bd9e0 legacy=0x7fd4440b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7fd442800640 1 -- 172.21.15.131:0/1210759838 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4440bfd70 con 0x7fd444155ae0 2024-04-12T19:39:42.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f0251600640 1 -- 172.21.15.131:0/3037611703 shutdown_connections 2024-04-12T19:39:42.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f0251600640 1 --2- 172.21.15.131:0/3037611703 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c0c3730 0x7f024c15ba80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f0251600640 1 --2- 172.21.15.131:0/3037611703 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0c28c0 0x7f024c0c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.199 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f52e5600640 1 -- 172.21.15.131:0/714812855 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f52dc07afd0 con 0x7f52e80be210 2024-04-12T19:39:42.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f0251600640 1 -- 172.21.15.131:0/3037611703 >> 172.21.15.131:0/3037611703 conn(0x7f024c0a8490 msgr2=0x7f024c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f0251600640 1 -- 172.21.15.131:0/3037611703 shutdown_connections 2024-04-12T19:39:42.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f77abe00640 1 -- 172.21.15.131:0/1035301327 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77a0005ce0 con 0x7f77b414f8e0 2024-04-12T19:39:42.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f77abe00640 1 -- 172.21.15.131:0/1035301327 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a00072f0 con 0x7f77b414f8e0 2024-04-12T19:39:42.200 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.176+0000 7fd441e00640 1 --2- 172.21.15.131:0/1210759838 >> v2:172.21.15.131:3300/0 conn(0x7fd4440a7670 0x7fd444150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:42.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.175+0000 7f2d0a000640 1 --2- 172.21.15.131:0/2267687438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d0c0bd9e0 0x7f2d0c0b80e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009870 tx=0x7f2cf802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1510ebe4bf9ab675 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.177+0000 7feddb000640 1 -- 172.21.15.131:0/1186668470 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedd40943c0 con 0x7fedd41f45e0 2024-04-12T19:39:42.201 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.177+0000 7f2d09600640 1 -- 172.21.15.131:0/2267687438 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8035020 con 0x7f2d0c0bd9e0 2024-04-12T19:39:42.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.177+0000 7f93a0e00640 1 Processor -- start 2024-04-12T19:39:42.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.176+0000 7f0251600640 1 -- 172.21.15.131:0/3037611703 wait complete. 2024-04-12T19:39:42.202 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.177+0000 7f93a0e00640 1 -- start start 2024-04-12T19:39:42.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.178+0000 7f0251600640 1 Processor -- start 2024-04-12T19:39:42.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.178+0000 7f2d09600640 1 -- 172.21.15.131:0/2267687438 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf8031640 con 0x7f2d0c0bd9e0 2024-04-12T19:39:42.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.178+0000 7f2d09600640 1 -- 172.21.15.131:0/2267687438 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf802d040 con 0x7f2d0c0bd9e0 2024-04-12T19:39:42.203 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.178+0000 7fc7f1c00640 1 -- 172.21.15.131:0/534051852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec1491a0 msgr2=0x7fc7ec14d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.176+0000 7f77b9a00640 1 -- 172.21.15.131:0/1035301327 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77b40a75f0 con 0x7f77b414f8e0 2024-04-12T19:39:42.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.176+0000 7f77b9a00640 1 -- 172.21.15.131:0/1035301327 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77b41eea90 con 0x7f77b414f8e0 2024-04-12T19:39:42.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.178+0000 7f93a0e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f939c0c2fd0 0x7f939c155f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.204 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.178+0000 7f77b9a00640 1 -- 172.21.15.131:0/1035301327 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77b404fd50 con 0x7f77b414f8e0 2024-04-12T19:39:42.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.178+0000 7f93a0e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f939c06b9e0 0x7f939c06f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.178+0000 7f93a0e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f939c06be40 0x7f939c06fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7f93a0e00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f939c0c33b0 con 0x7f939c0c2fd0 2024-04-12T19:39:42.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7f93a0e00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f939c0bf4f0 con 0x7f939c06be40 2024-04-12T19:39:42.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7f93a0e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f939c06f3c0 con 0x7f939c06b9e0 2024-04-12T19:39:42.205 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7feddb000640 1 -- 172.21.15.131:0/1186668470 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedd40c4d80 con 0x7fedd41f45e0 2024-04-12T19:39:42.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.178+0000 7fc7f1c00640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec1491a0 0x7fc7ec14d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7fc7f1c00640 1 -- 172.21.15.131:0/534051852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7ec0bfad0 msgr2=0x7fc7ec148c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7fc7f1c00640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7ec0bfad0 0x7fc7ec148c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7fc7f1c00640 1 -- 172.21.15.131:0/534051852 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ec1498d0 con 0x7fc7ec14b260 2024-04-12T19:39:42.206 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7fc7f2600640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec1491a0 0x7fc7ec14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T19:39:42.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7fc7f1200640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7ec0bfad0 0x7fc7ec148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:39:42.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.178+0000 7fd442800640 1 --2- 172.21.15.131:0/1210759838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd444155ae0 0x7fd444157ed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd4440736b0 tx=0x7fd43002ded0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a66cefc05a2f4566 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.207 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7f939a800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f939c06be40 0x7f939c06fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7f2d11e00640 1 -- 172.21.15.131:0/2267687438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d0c0bd9e0 msgr2=0x7f2d0c0b80e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7f2d11e00640 1 --2- 172.21.15.131:0/2267687438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d0c0bd9e0 0x7f2d0c0b80e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009870 tx=0x7f2cf802b8f0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7fc7f1c00640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7ec14b260 0x7fc7ec0bf590 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0001350 tx=0x7fc7e000c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.208 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.178+0000 7f0251600640 1 -- start start 2024-04-12T19:39:42.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7f9399400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f939c06b9e0 0x7f939c06f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.179+0000 7f9399e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f939c0c2fd0 0x7f939c155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f9399e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f939c0c2fd0 0x7f939c155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41336/0 (socket says 172.21.15.131:41336) 2024-04-12T19:39:42.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f9399e00640 1 -- 172.21.15.131:0/26726386 learned_addr learned my addr 172.21.15.131:0/26726386 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:42.209 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f939a800640 1 --2- 172.21.15.131:0/26726386 >> v2:172.21.15.171:3300/0 conn(0x7f939c06be40 0x7f939c06fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:35088/0 (socket says 172.21.15.131:35088) 2024-04-12T19:39:42.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f2d11e00640 1 -- 172.21.15.131:0/2267687438 shutdown_connections 2024-04-12T19:39:42.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f2d11e00640 1 --2- 172.21.15.131:0/2267687438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d0c0bd9e0 0x7f2d0c0b80e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f2d11e00640 1 --2- 172.21.15.131:0/2267687438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d0c0a7670 0x7f2d0c150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f2d11e00640 1 -- 172.21.15.131:0/2267687438 >> 172.21.15.131:0/2267687438 conn(0x7f2d0c06b9e0 msgr2=0x7f2d0c06bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f2d11e00640 1 -- 172.21.15.131:0/2267687438 shutdown_connections 2024-04-12T19:39:42.210 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7fc7e9600640 1 -- 172.21.15.131:0/534051852 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e000f040 con 0x7fc7ec14b260 2024-04-12T19:39:42.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7fc7e9600640 1 -- 172.21.15.131:0/534051852 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc7e000cd50 con 0x7fc7ec14b260 2024-04-12T19:39:42.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7fc7e9600640 1 -- 172.21.15.131:0/534051852 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0004d80 con 0x7fc7ec14b260 2024-04-12T19:39:42.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f2d11e00640 1 -- 172.21.15.131:0/2267687438 wait complete. 2024-04-12T19:39:42.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f939a800640 1 -- 172.21.15.131:0/26726386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f939c06b9e0 msgr2=0x7f939c06f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:42.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f939a800640 1 --2- 172.21.15.131:0/26726386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f939c06b9e0 0x7f939c06f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.211 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f939a800640 1 -- 172.21.15.131:0/26726386 >> v2:172.21.15.131:3300/0 conn(0x7f939c0c2fd0 msgr2=0x7f939c155f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:42.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f939a800640 1 --2- 172.21.15.131:0/26726386 >> v2:172.21.15.131:3300/0 conn(0x7f939c0c2fd0 0x7f939c155f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f939a800640 1 -- 172.21.15.131:0/26726386 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c0bf720 con 0x7f939c06be40 2024-04-12T19:39:42.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.180+0000 7f77abe00640 1 -- 172.21.15.131:0/1035301327 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f77a001a070 con 0x7f77b414f8e0 2024-04-12T19:39:42.212 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.181+0000 7f77abe00640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f779406c8f0 0x7f779406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.182+0000 7f77abe00640 1 -- 172.21.15.131:0/1035301327 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f77a0056d40 con 0x7f77b414f8e0 2024-04-12T19:39:42.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.182+0000 7f0251600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c0c17a0 0x7f024c06f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.182+0000 7f0251600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f024c0c28c0 0x7f024c070ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.213 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.182+0000 7f2d11e00640 1 Processor -- start 2024-04-12T19:39:42.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.182+0000 7f0251600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0c3730 0x7f024c0bd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.183+0000 7f0251600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f024c0c3ba0 con 0x7f024c0c28c0 2024-04-12T19:39:42.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.183+0000 7f0251600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f024c0c6540 con 0x7f024c0c17a0 2024-04-12T19:39:42.214 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.183+0000 7f0251600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f024c1518f0 con 0x7f024c0c3730 2024-04-12T19:39:42.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.183+0000 7f2d11e00640 1 -- start start 2024-04-12T19:39:42.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.183+0000 7f024aa00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c0c17a0 0x7f024c06f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.183+0000 7f024aa00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c0c17a0 0x7f024c06f980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:35102/0 (socket says 172.21.15.131:35102) 2024-04-12T19:39:42.215 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.183+0000 7f024aa00640 1 -- 172.21.15.131:0/509082563 learned_addr learned my addr 172.21.15.131:0/509082563 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:42.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.183+0000 7f77b3e00640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f779406c8f0 0x7f779406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.183+0000 7f024b400640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0c3730 0x7f024c0bd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f77b3e00640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f779406c8f0 0x7f779406edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000f80 tx=0x7f77ac030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f2d11e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d0c0a7670 0x7f2d0c1422f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f2d11e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d0c0b8620 0x7f2d0c0bba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f2d11e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d0c0bd9e0 0x7f2d0c148e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f024aa00640 1 -- 172.21.15.131:0/509082563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0c3730 msgr2=0x7f024c0bd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f024aa00640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0c3730 0x7f024c0bd0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f024aa00640 1 -- 172.21.15.131:0/509082563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f024c0c28c0 msgr2=0x7f024c070ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f024aa00640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f024c0c28c0 0x7f024c070ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f024aa00640 1 -- 172.21.15.131:0/509082563 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f024c0bd5f0 con 0x7f024c0c17a0 2024-04-12T19:39:42.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f939a800640 1 --2- 172.21.15.131:0/26726386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f939c06be40 0x7f939c06fd90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f939c0ba900 tx=0x7f939402be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f21ec40bbb4a3e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.183+0000 7fc7f3000640 1 -- 172.21.15.131:0/534051852 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ec0c0760 con 0x7fc7ec14b260 2024-04-12T19:39:42.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.183+0000 7fc7f3000640 1 -- 172.21.15.131:0/534051852 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ec155270 con 0x7fc7ec14b260 2024-04-12T19:39:42.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f2d0aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d0c0a7670 0x7f2d0c1422f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f024aa00640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c0c17a0 0x7f024c06f980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f024400cbd0 tx=0x7f024400a430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f2d0aa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d0c0a7670 0x7f2d0c1422f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41344/0 (socket says 172.21.15.131:41344) 2024-04-12T19:39:42.219 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f2d0aa00640 1 -- 172.21.15.131:0/1538476173 learned_addr learned my addr 172.21.15.131:0/1538476173 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:42.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7f2d0a000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d0c0b8620 0x7f2d0c0bba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.182+0000 7fedcbe00640 1 -- 172.21.15.131:0/1186668470 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fedcc01d460 con 0x7fedd41f45e0 2024-04-12T19:39:42.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.184+0000 7fc7f3000640 1 -- 172.21.15.131:0/534051852 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ec04fd50 con 0x7fc7ec14b260 2024-04-12T19:39:42.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.185+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c0a5850 con 0x7f2d0c0a7670 2024-04-12T19:39:42.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.185+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0c150aa0 con 0x7f2d0c0b8620 2024-04-12T19:39:42.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.185+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2d0c0b9550 con 0x7f2d0c0bd9e0 2024-04-12T19:39:42.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.185+0000 7f2d0b400640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d0c0bd9e0 0x7f2d0c148e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.185+0000 7fedcbe00640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fedb406c940 0x7fedb406ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.185+0000 7fedcbe00640 1 -- 172.21.15.131:0/1186668470 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fedcc08b420 con 0x7fedd41f45e0 2024-04-12T19:39:42.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.185+0000 7f2d0aa00640 1 -- 172.21.15.131:0/1538476173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d0c0bd9e0 msgr2=0x7f2d0c148e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.185+0000 7f2d0aa00640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d0c0bd9e0 0x7f2d0c148e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.185+0000 7f2d0aa00640 1 -- 172.21.15.131:0/1538476173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d0c0b8620 msgr2=0x7f2d0c0bba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.185+0000 7f2d0aa00640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d0c0b8620 0x7f2d0c0bba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.185+0000 7f2d0aa00640 1 -- 172.21.15.131:0/1538476173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d0c1e6da0 con 0x7f2d0c0a7670 2024-04-12T19:39:42.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.186+0000 7f2d0aa00640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d0c0a7670 0x7f2d0c1422f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00e9b0 tx=0x7f2cfc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.186+0000 7fedd3e00640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fedb406c940 0x7fedb406ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.187+0000 7fedd3e00640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fedb406c940 0x7fedb406ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fedd4051650 tx=0x7fedc4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.188+0000 7fedcbe00640 1 -- 172.21.15.131:0/1186668470 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fedd40c4d80 con 0x7fedd41f45e0 2024-04-12T19:39:42.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.188+0000 7f2d03400640 1 -- 172.21.15.131:0/1538476173 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc017070 con 0x7f2d0c0a7670 2024-04-12T19:39:42.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.189+0000 7f2d03400640 1 -- 172.21.15.131:0/1538476173 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cfc00c9a0 con 0x7f2d0c0a7670 2024-04-12T19:39:42.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.189+0000 7f2d03400640 1 -- 172.21.15.131:0/1538476173 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cfc00cd90 con 0x7f2d0c0a7670 2024-04-12T19:39:42.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.189+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d0c1e7060 con 0x7f2d0c0a7670 2024-04-12T19:39:42.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.189+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d0c0b9c60 con 0x7f2d0c0a7670 2024-04-12T19:39:42.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.190+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d0c0ba380 con 0x7f2d0c0a7670 2024-04-12T19:39:42.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.190+0000 7fc7e9600640 1 -- 172.21.15.131:0/534051852 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc7e001b020 con 0x7fc7ec14b260 2024-04-12T19:39:42.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.192+0000 7fc7e9600640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc7cc06c920 0x7fc7cc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.192+0000 7fc7e9600640 1 -- 172.21.15.131:0/534051852 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc7e008c700 con 0x7fc7ec14b260 2024-04-12T19:39:42.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.192+0000 7fc7f1200640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc7cc06c920 0x7fc7cc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.193+0000 7fc7f1200640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc7cc06c920 0x7fc7cc06ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0b9c20 tx=0x7fc7d8009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.195+0000 7fc7e9600640 1 -- 172.21.15.131:0/534051852 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc7e005a210 con 0x7fc7ec14b260 2024-04-12T19:39:42.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.196+0000 7fd440a00640 1 -- 172.21.15.131:0/1210759838 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd430034070 con 0x7fd444155ae0 2024-04-12T19:39:42.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.196+0000 7fd440a00640 1 -- 172.21.15.131:0/1210759838 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43002ea00 con 0x7fd444155ae0 2024-04-12T19:39:42.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.196+0000 7f0242a00640 1 -- 172.21.15.131:0/509082563 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244017070 con 0x7f024c0c17a0 2024-04-12T19:39:42.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.197+0000 7f2d03400640 1 -- 172.21.15.131:0/1538476173 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2cfc01a070 con 0x7f2d0c0a7670 2024-04-12T19:39:42.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.197+0000 7f77abe00640 1 -- 172.21.15.131:0/1035301327 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f77a0058ca0 con 0x7f77b414f8e0 2024-04-12T19:39:42.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.197+0000 7f0242a00640 1 -- 172.21.15.131:0/509082563 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f024400ad40 con 0x7f024c0c17a0 2024-04-12T19:39:42.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.197+0000 7f0242a00640 1 -- 172.21.15.131:0/509082563 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0244012600 con 0x7f024c0c17a0 2024-04-12T19:39:42.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.197+0000 7f0251600640 1 -- 172.21.15.131:0/509082563 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f024c072d20 con 0x7f024c0c17a0 2024-04-12T19:39:42.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.197+0000 7f0251600640 1 -- 172.21.15.131:0/509082563 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f024c06f180 con 0x7f024c0c17a0 2024-04-12T19:39:42.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.197+0000 7fd449000640 1 -- 172.21.15.131:0/1210759838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd444155ae0 msgr2=0x7fd444157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.197+0000 7fd440a00640 1 -- 172.21.15.131:0/1210759838 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd430034070 con 0x7fd444155ae0 2024-04-12T19:39:42.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.198+0000 7fd449000640 1 --2- 172.21.15.131:0/1210759838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd444155ae0 0x7fd444157ed0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd4440736b0 tx=0x7fd43002ded0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.198+0000 7fd449000640 1 -- 172.21.15.131:0/1210759838 shutdown_connections 2024-04-12T19:39:42.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.198+0000 7fd449000640 1 --2- 172.21.15.131:0/1210759838 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd444155ae0 0x7fd444157ed0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.198+0000 7fd449000640 1 --2- 172.21.15.131:0/1210759838 >> v2:172.21.15.131:3300/0 conn(0x7fd4440a7670 0x7fd444150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.198+0000 7fd449000640 1 -- 172.21.15.131:0/1210759838 >> 172.21.15.131:0/1210759838 conn(0x7fd44406b9e0 msgr2=0x7fd44406bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.198+0000 7f2d03400640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2cec06c9c0 0x7f2cec06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.198+0000 7f2d03400640 1 -- 172.21.15.131:0/1538476173 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2cfc08c600 con 0x7f2d0c0a7670 2024-04-12T19:39:42.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.198+0000 7f9398a00640 1 -- 172.21.15.131:0/26726386 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9394039070 con 0x7f939c06be40 2024-04-12T19:39:42.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.198+0000 7f9398a00640 1 -- 172.21.15.131:0/26726386 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f939402cc20 con 0x7f939c06be40 2024-04-12T19:39:42.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.198+0000 7f9398a00640 1 -- 172.21.15.131:0/26726386 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9394034660 con 0x7f939c06be40 2024-04-12T19:39:42.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.199+0000 7fd449000640 1 -- 172.21.15.131:0/1210759838 shutdown_connections 2024-04-12T19:39:42.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.198+0000 7f2d0a000640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2cec06c9c0 0x7f2cec06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.200+0000 7f2d0a000640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2cec06c9c0 0x7f2cec06ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8036000 tx=0x7f2cf803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.200+0000 7f0251600640 1 -- 172.21.15.131:0/509082563 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f024c04fd50 con 0x7f024c0c17a0 2024-04-12T19:39:42.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.199+0000 7f93a0e00640 1 -- 172.21.15.131:0/26726386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f939c06be40 msgr2=0x7f939c06fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.199+0000 7f93a0e00640 1 --2- 172.21.15.131:0/26726386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f939c06be40 0x7f939c06fd90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f939c0ba900 tx=0x7f939402be70 comp rx=0 tx=0).stop 2024-04-12T19:39:42.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.202+0000 7f93a0e00640 1 -- 172.21.15.131:0/26726386 shutdown_connections 2024-04-12T19:39:42.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.202+0000 7f93a0e00640 1 --2- 172.21.15.131:0/26726386 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f939c06be40 0x7f939c06fd90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.202+0000 7f93a0e00640 1 --2- 172.21.15.131:0/26726386 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f939c06b9e0 0x7f939c06f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.202+0000 7f93a0e00640 1 --2- 172.21.15.131:0/26726386 >> v2:172.21.15.131:3300/0 conn(0x7f939c0c2fd0 0x7f939c155f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.202+0000 7f93a0e00640 1 -- 172.21.15.131:0/26726386 >> 172.21.15.131:0/26726386 conn(0x7f939c0c00b0 msgr2=0x7f939c0c04c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.199+0000 7fd449000640 1 -- 172.21.15.131:0/1210759838 wait complete. 2024-04-12T19:39:42.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.201+0000 7fd449000640 1 Processor -- start 2024-04-12T19:39:42.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.202+0000 7f93a0e00640 1 -- 172.21.15.131:0/26726386 shutdown_connections 2024-04-12T19:39:42.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.202+0000 7fd449000640 1 -- start start 2024-04-12T19:39:42.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.202+0000 7f0242a00640 1 -- 172.21.15.131:0/509082563 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f024401a070 con 0x7f024c0c17a0 2024-04-12T19:39:42.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.204+0000 7fd449000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4440a7670 0x7fd4441e6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.204+0000 7f0242a00640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f022c06c8f0 0x7f022c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.204+0000 7f0242a00640 1 -- 172.21.15.131:0/509082563 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f024408bb00 con 0x7f024c0c17a0 2024-04-12T19:39:42.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.204+0000 7f2d03400640 1 -- 172.21.15.131:0/1538476173 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2cfc05a110 con 0x7f2d0c0a7670 2024-04-12T19:39:42.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.204+0000 7fd449000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4440bd9e0 0x7fd4441f6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.205+0000 7fd449000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd444155ae0 0x7fd4441478a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.205+0000 7fd449000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd4440a5850 con 0x7fd444155ae0 2024-04-12T19:39:42.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.205+0000 7fd449000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd444150aa0 con 0x7fd4440a7670 2024-04-12T19:39:42.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.205+0000 7f93a0e00640 1 -- 172.21.15.131:0/26726386 wait complete. 2024-04-12T19:39:42.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.205+0000 7fd442800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd444155ae0 0x7fd4441478a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.206+0000 7fd442800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd444155ae0 0x7fd4441478a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41346/0 (socket says 172.21.15.131:41346) 2024-04-12T19:39:42.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.206+0000 7fd442800640 1 -- 172.21.15.131:0/1293051932 learned_addr learned my addr 172.21.15.131:0/1293051932 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:42.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.205+0000 7fd441400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4440bd9e0 0x7fd4441f6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.205+0000 7f024a000640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f022c06c8f0 0x7f022c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.206+0000 7fd441e00640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4440a7670 0x7fd4441e6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.206+0000 7fd449000640 1 -- 172.21.15.131:0/1293051932 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd4440b9550 con 0x7fd4440bd9e0 2024-04-12T19:39:42.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.207+0000 7f024a000640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f022c06c8f0 0x7f022c06edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0238006a90 tx=0x7f0238006a20 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.207+0000 7f93a0e00640 1 Processor -- start 2024-04-12T19:39:42.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.208+0000 7fd441400640 1 -- 172.21.15.131:0/1293051932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4440a7670 msgr2=0x7fd4441e6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.208+0000 7fd441400640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4440a7670 0x7fd4441e6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.208+0000 7fd441400640 1 -- 172.21.15.131:0/1293051932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd444155ae0 msgr2=0x7fd4441478a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.207+0000 7f93a0e00640 1 -- start start 2024-04-12T19:39:42.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.208+0000 7fd441400640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd444155ae0 0x7fd4441478a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.208+0000 7fd441400640 1 -- 172.21.15.131:0/1293051932 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4441e77d0 con 0x7fd4440bd9e0 2024-04-12T19:39:42.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.209+0000 7f93a0e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f939c06b9e0 0x7f939c0bacc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.209+0000 7f93a0e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f939c06be40 0x7f939c152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.209+0000 7f93a0e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f939c0c2fd0 0x7f939c14ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.209+0000 7f93a0e00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f939c0a8950 con 0x7f939c0c2fd0 2024-04-12T19:39:42.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.209+0000 7f93a0e00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f939c0bfce0 con 0x7f939c06b9e0 2024-04-12T19:39:42.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.209+0000 7f93a0e00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f939c070950 con 0x7f939c06be40 2024-04-12T19:39:42.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.209+0000 7f9399e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f939c06b9e0 0x7f939c0bacc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.209+0000 7fd441400640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4440bd9e0 0x7fd4441f6e70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd434004d20 tx=0x7fd43400dd90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.209+0000 7f939a800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f939c0c2fd0 0x7f939c14ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.209+0000 7f9399e00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f939c06b9e0 0x7f939c0bacc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:35132/0 (socket says 172.21.15.131:35132) 2024-04-12T19:39:42.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.209+0000 7f9399e00640 1 -- 172.21.15.131:0/4184555726 learned_addr learned my addr 172.21.15.131:0/4184555726 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:42.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.210+0000 7f9399400640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f939c06be40 0x7f939c152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.210+0000 7fd43a000640 1 -- 172.21.15.131:0/1293051932 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43400b7c0 con 0x7fd4440bd9e0 2024-04-12T19:39:42.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.210+0000 7fd43a000640 1 -- 172.21.15.131:0/1293051932 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd434015020 con 0x7fd4440bd9e0 2024-04-12T19:39:42.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.210+0000 7fd43a000640 1 -- 172.21.15.131:0/1293051932 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43400bbe0 con 0x7fd4440bd9e0 2024-04-12T19:39:42.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.210+0000 7f9399e00640 1 -- 172.21.15.131:0/4184555726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f939c06be40 msgr2=0x7f939c152360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.210+0000 7f9399e00640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f939c06be40 0x7f939c152360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.210+0000 7f9399e00640 1 -- 172.21.15.131:0/4184555726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f939c0c2fd0 msgr2=0x7f939c14ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.210+0000 7f9399e00640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f939c0c2fd0 0x7f939c14ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.210+0000 7f9399e00640 1 -- 172.21.15.131:0/4184555726 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f939c1528a0 con 0x7f939c06b9e0 2024-04-12T19:39:42.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.210+0000 7fd449000640 1 -- 172.21.15.131:0/1293051932 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4441e7ac0 con 0x7fd4440bd9e0 2024-04-12T19:39:42.243 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.211+0000 7fd449000640 1 -- 172.21.15.131:0/1293051932 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4441f7900 con 0x7fd4440bd9e0 2024-04-12T19:39:42.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.211+0000 7f9399e00640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f939c06b9e0 0x7f939c0bacc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f938c00e7e0 tx=0x7f938c00eca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.244 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.213+0000 7fd449000640 1 -- 172.21.15.131:0/1293051932 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd44404fd50 con 0x7fd4440bd9e0 2024-04-12T19:39:42.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.215+0000 7fd43a000640 1 -- 172.21.15.131:0/1293051932 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd434010410 con 0x7fd4440bd9e0 2024-04-12T19:39:42.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.216+0000 7fd43a000640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd42406c920 0x7fd42406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.217+0000 7fd43a000640 1 -- 172.21.15.131:0/1293051932 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd43408c3d0 con 0x7fd4440bd9e0 2024-04-12T19:39:42.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.218+0000 7fd441e00640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd42406c920 0x7fd42406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.245 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.219+0000 7fd441e00640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd42406c920 0x7fd42406ede0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00d620 tx=0x7fd43c007810 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.219+0000 7f9392000640 1 -- 172.21.15.131:0/4184555726 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c017070 con 0x7f939c06b9e0 2024-04-12T19:39:42.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.219+0000 7f9392000640 1 -- 172.21.15.131:0/4184555726 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f938c00c8d0 con 0x7f939c06b9e0 2024-04-12T19:39:42.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.219+0000 7f9392000640 1 -- 172.21.15.131:0/4184555726 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938c00f040 con 0x7f939c06b9e0 2024-04-12T19:39:42.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.219+0000 7f93a0e00640 1 -- 172.21.15.131:0/4184555726 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f939c1ee590 con 0x7f939c06b9e0 2024-04-12T19:39:42.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.220+0000 7f93a0e00640 1 -- 172.21.15.131:0/4184555726 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f939c150280 con 0x7f939c06b9e0 2024-04-12T19:39:42.246 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.220+0000 7f0242a00640 1 -- 172.21.15.131:0/509082563 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0244059630 con 0x7f024c0c17a0 2024-04-12T19:39:42.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.221+0000 7f93a0e00640 1 -- 172.21.15.131:0/4184555726 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f939c04fd50 con 0x7f939c06b9e0 2024-04-12T19:39:42.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.224+0000 7f9392000640 1 -- 172.21.15.131:0/4184555726 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f938c01a070 con 0x7f939c06b9e0 2024-04-12T19:39:42.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.225+0000 7f9392000640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f937c06c9c0 0x7f937c06ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:42.247 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.226+0000 7f9392000640 1 -- 172.21.15.131:0/4184555726 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f938c08b9a0 con 0x7f939c06b9e0 2024-04-12T19:39:42.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.227+0000 7f9399400640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f937c06c9c0 0x7f937c06ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:42.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.228+0000 7f9399400640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f937c06c9c0 0x7f937c06ee80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f939c14e740 tx=0x7f9388008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:42.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.233+0000 7fd43a000640 1 -- 172.21.15.131:0/1293051932 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd43401f030 con 0x7fd4440bd9e0 2024-04-12T19:39:42.248 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.240+0000 7f9392000640 1 -- 172.21.15.131:0/4184555726 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f938c0594b0 con 0x7f939c06b9e0 2024-04-12T19:39:42.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.598+0000 7f52f0600640 1 -- 172.21.15.131:0/714812855 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f52e80bc710 con 0x7f52e80be210 2024-04-12T19:39:42.602 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-04-12T19:39:42.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.599+0000 7f52e5600640 1 -- 172.21.15.131:0/714812855 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f52dc07f2d0 con 0x7f52e80be210 2024-04-12T19:39:42.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.603+0000 7f52daa00640 1 -- 172.21.15.131:0/714812855 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f52c806c940 msgr2=0x7f52c806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.603+0000 7f52daa00640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f52c806c940 0x7f52c806ee00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f52d4001920 tx=0x7f52d4009040 comp rx=0 tx=0).stop 2024-04-12T19:39:42.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.603+0000 7f52daa00640 1 -- 172.21.15.131:0/714812855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80be210 msgr2=0x7f52e80b7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.603+0000 7f52daa00640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80be210 0x7f52e80b7440 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f52dc000c00 tx=0x7f52dc0046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.604+0000 7f52daa00640 1 -- 172.21.15.131:0/714812855 shutdown_connections 2024-04-12T19:39:42.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.604+0000 7f52daa00640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f52c806c940 0x7f52c806ee00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.604+0000 7f52daa00640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f52e8147280 0x7f52e81e6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.604+0000 7f52daa00640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52e80be210 0x7f52e80b7440 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.604+0000 7f52daa00640 1 --2- 172.21.15.131:0/714812855 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f52e80a8100 0x7f52e81d8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.604+0000 7f52daa00640 1 -- 172.21.15.131:0/714812855 >> 172.21.15.131:0/714812855 conn(0x7f52e806cce0 msgr2=0x7f52e80749b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.605+0000 7f52daa00640 1 -- 172.21.15.131:0/714812855 shutdown_connections 2024-04-12T19:39:42.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.605+0000 7f52daa00640 1 -- 172.21.15.131:0/714812855 wait complete. 2024-04-12T19:39:42.616 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.616+0000 7fc7f3000640 1 -- 172.21.15.131:0/534051852 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fc7ec0c3ca0 con 0x7fc7ec14b260 2024-04-12T19:39:42.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.617+0000 7fc7e9600640 1 -- 172.21.15.131:0/534051852 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fc7e005e510 con 0x7fc7ec14b260 2024-04-12T19:39:42.620 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-04-12T19:39:42.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.621+0000 7feddb000640 1 -- 172.21.15.131:0/1186668470 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fedd404fd50 con 0x7fedd41f45e0 2024-04-12T19:39:42.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.622+0000 7fc7dea00640 1 -- 172.21.15.131:0/534051852 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc7cc06c920 msgr2=0x7fc7cc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.622+0000 7fc7dea00640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc7cc06c920 0x7fc7cc06ede0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc7ec0b9c20 tx=0x7fc7d8009040 comp rx=0 tx=0).stop 2024-04-12T19:39:42.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.622+0000 7fc7dea00640 1 -- 172.21.15.131:0/534051852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7ec14b260 msgr2=0x7fc7ec0bf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.622+0000 7fc7dea00640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7ec14b260 0x7fc7ec0bf590 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0001350 tx=0x7fc7e000c580 comp rx=0 tx=0).stop 2024-04-12T19:39:42.622 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.622+0000 7fedcbe00640 1 -- 172.21.15.131:0/1186668470 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fedcc059590 con 0x7fedd41f45e0 2024-04-12T19:39:42.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.623+0000 7fc7dea00640 1 -- 172.21.15.131:0/534051852 shutdown_connections 2024-04-12T19:39:42.623 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.623+0000 7fc7dea00640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc7cc06c920 0x7fc7cc06ede0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.625 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-04-12T19:39:42.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.623+0000 7fc7dea00640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc7ec0bfad0 0x7fc7ec148c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.623+0000 7fc7dea00640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc7ec1491a0 0x7fc7ec14d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.623+0000 7fc7dea00640 1 --2- 172.21.15.131:0/534051852 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc7ec14b260 0x7fc7ec0bf590 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.623+0000 7fc7dea00640 1 -- 172.21.15.131:0/534051852 >> 172.21.15.131:0/534051852 conn(0x7fc7ec0c3170 msgr2=0x7fc7ec0c4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.626+0000 7fc7dea00640 1 -- 172.21.15.131:0/534051852 shutdown_connections 2024-04-12T19:39:42.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.626+0000 7feddb000640 1 -- 172.21.15.131:0/1186668470 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fedb406c940 msgr2=0x7fedb406ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.626+0000 7feddb000640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fedb406c940 0x7fedb406ee00 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fedd4051650 tx=0x7fedc4009040 comp rx=0 tx=0).stop 2024-04-12T19:39:42.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.626+0000 7feddb000640 1 -- 172.21.15.131:0/1186668470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd41f45e0 msgr2=0x7fedd4155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.626+0000 7feddb000640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd41f45e0 0x7fedd4155510 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fedd40ad920 tx=0x7fedcc007a90 comp rx=0 tx=0).stop 2024-04-12T19:39:42.627 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.627+0000 7fc7dea00640 1 -- 172.21.15.131:0/534051852 wait complete. 2024-04-12T19:39:42.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.626+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f2d0c0712e0 con 0x7f2d0c0a7670 2024-04-12T19:39:42.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.627+0000 7feddb000640 1 -- 172.21.15.131:0/1186668470 shutdown_connections 2024-04-12T19:39:42.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.627+0000 7feddb000640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fedb406c940 0x7fedb406ee00 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.627+0000 7feddb000640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fedd4152940 0x7fedd41edae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.627+0000 7feddb000640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fedd41f45e0 0x7fedd4155510 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.627+0000 7feddb000640 1 --2- 172.21.15.131:0/1186668470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fedb80037a0 0x7fedd41520a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.627+0000 7feddb000640 1 -- 172.21.15.131:0/1186668470 >> 172.21.15.131:0/1186668470 conn(0x7fedd406b9e0 msgr2=0x7fedd4072dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.628+0000 7feddb000640 1 -- 172.21.15.131:0/1186668470 shutdown_connections 2024-04-12T19:39:42.629 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-04-12T19:39:42.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.628+0000 7f2d03400640 1 -- 172.21.15.131:0/1538476173 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2cfc05e410 con 0x7f2d0c0a7670 2024-04-12T19:39:42.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.628+0000 7feddb000640 1 -- 172.21.15.131:0/1186668470 wait complete. 2024-04-12T19:39:42.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.631+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2cec06c9c0 msgr2=0x7f2cec06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.631+0000 7f2d11e00640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2cec06c9c0 0x7f2cec06ee80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8036000 tx=0x7f2cf803c040 comp rx=0 tx=0).stop 2024-04-12T19:39:42.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.631+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d0c0a7670 msgr2=0x7f2d0c1422f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.631+0000 7f2d11e00640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d0c0a7670 0x7f2d0c1422f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2cfc00e9b0 tx=0x7f2cfc00ee70 comp rx=0 tx=0).stop 2024-04-12T19:39:42.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.632+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 shutdown_connections 2024-04-12T19:39:42.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.632+0000 7f2d11e00640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2cec06c9c0 0x7f2cec06ee80 secure :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8036000 tx=0x7f2cf803c040 comp rx=0 tx=0).stop 2024-04-12T19:39:42.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.632+0000 7f2d11e00640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d0c0b8620 0x7f2d0c0bba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.632+0000 7f2d11e00640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d0c0bd9e0 0x7f2d0c148e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.632+0000 7f2d11e00640 1 --2- 172.21.15.131:0/1538476173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d0c0a7670 0x7f2d0c1422f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.632+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 >> 172.21.15.131:0/1538476173 conn(0x7f2d0c06b9e0 msgr2=0x7f2d0c0a5d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.633+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 shutdown_connections 2024-04-12T19:39:42.634 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.634+0000 7f2d11e00640 1 -- 172.21.15.131:0/1538476173 wait complete. 2024-04-12T19:39:42.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.1 2024-04-12T19:39:42.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.635+0000 7f77b9a00640 1 -- 172.21.15.131:0/1035301327 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f77b406f070 con 0x7f77b414f8e0 2024-04-12T19:39:42.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.636+0000 7f77abe00640 1 -- 172.21.15.131:0/1035301327 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f77a005cfa0 con 0x7f77b414f8e0 2024-04-12T19:39:42.637 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-04-12T19:39:42.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.639+0000 7f77b9a00640 1 -- 172.21.15.131:0/1035301327 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f779406c8f0 msgr2=0x7f779406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.639+0000 7f77b9a00640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f779406c8f0 0x7f779406edb0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f77ac000f80 tx=0x7f77ac030000 comp rx=0 tx=0).stop 2024-04-12T19:39:42.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.639+0000 7f77b9a00640 1 -- 172.21.15.131:0/1035301327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b414f8e0 msgr2=0x7f77b40bbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.639+0000 7f77b9a00640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b414f8e0 0x7f77b40bbcb0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f77a000c390 tx=0x7f77a000c790 comp rx=0 tx=0).stop 2024-04-12T19:39:42.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.640+0000 7f77b9a00640 1 -- 172.21.15.131:0/1035301327 shutdown_connections 2024-04-12T19:39:42.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.640+0000 7f77b9a00640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f779406c8f0 0x7f779406edb0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.640+0000 7f77b9a00640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f77b414f8e0 0x7f77b40bbcb0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.640+0000 7f77b9a00640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f77b406f300 0x7f77b41548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.640+0000 7f77b9a00640 1 --2- 172.21.15.131:0/1035301327 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f77b406e860 0x7f77b41ef290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.640+0000 7f77b9a00640 1 -- 172.21.15.131:0/1035301327 >> 172.21.15.131:0/1035301327 conn(0x7f77b40bef80 msgr2=0x7f77b40b8600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.640+0000 7f77b9a00640 1 -- 172.21.15.131:0/1035301327 shutdown_connections 2024-04-12T19:39:42.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.640+0000 7f77b9a00640 1 -- 172.21.15.131:0/1035301327 wait complete. 2024-04-12T19:39:42.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.655+0000 7f0251600640 1 -- 172.21.15.131:0/509082563 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f024c0c4280 con 0x7f024c0c17a0 2024-04-12T19:39:42.656 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.3 2024-04-12T19:39:42.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.657+0000 7f0242a00640 1 -- 172.21.15.131:0/509082563 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f024405d930 con 0x7f024c0c17a0 2024-04-12T19:39:42.657 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-04-12T19:39:42.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.659+0000 7fd449000640 1 -- 172.21.15.131:0/1293051932 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fd4440bd070 con 0x7fd4440bd9e0 2024-04-12T19:39:42.660 INFO:teuthology.orchestra.run.smithi131.stdout:55834574856 2024-04-12T19:39:42.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.660+0000 7f0251600640 1 -- 172.21.15.131:0/509082563 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f022c06c8f0 msgr2=0x7f022c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.660+0000 7f0251600640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f022c06c8f0 0x7f022c06edb0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0238006a90 tx=0x7f0238006a20 comp rx=0 tx=0).stop 2024-04-12T19:39:42.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.660+0000 7f0251600640 1 -- 172.21.15.131:0/509082563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c0c17a0 msgr2=0x7f024c06f980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.660+0000 7f0251600640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c0c17a0 0x7f024c06f980 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f024400cbd0 tx=0x7f024400a430 comp rx=0 tx=0).stop 2024-04-12T19:39:42.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.660+0000 7fd43a000640 1 -- 172.21.15.131:0/1293051932 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd4441e7ac0 con 0x7fd4440bd9e0 2024-04-12T19:39:42.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.660+0000 7f0251600640 1 -- 172.21.15.131:0/509082563 shutdown_connections 2024-04-12T19:39:42.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.660+0000 7f0251600640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f022c06c8f0 0x7f022c06edb0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.660+0000 7f0251600640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f024c0c3730 0x7f024c0bd0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.660+0000 7f0251600640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f024c0c28c0 0x7f024c070ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.660+0000 7f0251600640 1 --2- 172.21.15.131:0/509082563 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f024c0c17a0 0x7f024c06f980 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.660+0000 7f0251600640 1 -- 172.21.15.131:0/509082563 >> 172.21.15.131:0/509082563 conn(0x7f024c0a8490 msgr2=0x7f024c0c6f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.662 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.0 2024-04-12T19:39:42.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.662+0000 7f0251600640 1 -- 172.21.15.131:0/509082563 shutdown_connections 2024-04-12T19:39:42.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.662+0000 7f0251600640 1 -- 172.21.15.131:0/509082563 wait complete. 2024-04-12T19:39:42.663 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.6 2024-04-12T19:39:42.664 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.2 2024-04-12T19:39:42.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.664+0000 7fd449000640 1 -- 172.21.15.131:0/1293051932 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd42406c920 msgr2=0x7fd42406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.664+0000 7fd449000640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd42406c920 0x7fd42406ede0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00d620 tx=0x7fd43c007810 comp rx=0 tx=0).stop 2024-04-12T19:39:42.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.664+0000 7fd449000640 1 -- 172.21.15.131:0/1293051932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4440bd9e0 msgr2=0x7fd4441f6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.664+0000 7fd449000640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4440bd9e0 0x7fd4441f6e70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd434004d20 tx=0x7fd43400dd90 comp rx=0 tx=0).stop 2024-04-12T19:39:42.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.664+0000 7fd449000640 1 -- 172.21.15.131:0/1293051932 shutdown_connections 2024-04-12T19:39:42.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.664+0000 7fd449000640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd42406c920 0x7fd42406ede0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.664+0000 7fd449000640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd444155ae0 0x7fd4441478a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.664+0000 7fd449000640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd4440bd9e0 0x7fd4441f6e70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.664+0000 7fd449000640 1 --2- 172.21.15.131:0/1293051932 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd4440a7670 0x7fd4441e6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.664+0000 7fd449000640 1 -- 172.21.15.131:0/1293051932 >> 172.21.15.131:0/1293051932 conn(0x7fd44406b9e0 msgr2=0x7fd44414d970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.664+0000 7fd449000640 1 -- 172.21.15.131:0/1293051932 shutdown_connections 2024-04-12T19:39:42.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.664+0000 7fd449000640 1 -- 172.21.15.131:0/1293051932 wait complete. 2024-04-12T19:39:42.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.666+0000 7f93a0e00640 1 -- 172.21.15.131:0/4184555726 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f939c06c7b0 con 0x7f939c06b9e0 2024-04-12T19:39:42.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.667+0000 7f9392000640 1 -- 172.21.15.131:0/4184555726 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f938c05d7b0 con 0x7f939c06b9e0 2024-04-12T19:39:42.667 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-04-12T19:39:42.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.670+0000 7f93a0e00640 1 -- 172.21.15.131:0/4184555726 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f937c06c9c0 msgr2=0x7f937c06ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.670+0000 7f93a0e00640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f937c06c9c0 0x7f937c06ee80 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f939c14e740 tx=0x7f9388008040 comp rx=0 tx=0).stop 2024-04-12T19:39:42.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.670+0000 7f93a0e00640 1 -- 172.21.15.131:0/4184555726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f939c06b9e0 msgr2=0x7f939c0bacc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:42.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.670+0000 7f93a0e00640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f939c06b9e0 0x7f939c0bacc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f938c00e7e0 tx=0x7f938c00eca0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.670+0000 7f93a0e00640 1 -- 172.21.15.131:0/4184555726 shutdown_connections 2024-04-12T19:39:42.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.670+0000 7f93a0e00640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f937c06c9c0 0x7f937c06ee80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.670+0000 7f93a0e00640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f939c0c2fd0 0x7f939c14ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.670+0000 7f93a0e00640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f939c06be40 0x7f939c152360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.670+0000 7f93a0e00640 1 --2- 172.21.15.131:0/4184555726 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f939c06b9e0 0x7f939c0bacc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:42.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.670+0000 7f93a0e00640 1 -- 172.21.15.131:0/4184555726 >> 172.21.15.131:0/4184555726 conn(0x7f939c0c00b0 msgr2=0x7f939c06f750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:42.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.670+0000 7f93a0e00640 1 -- 172.21.15.131:0/4184555726 shutdown_connections 2024-04-12T19:39:42.671 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:42.670+0000 7f93a0e00640 1 -- 172.21.15.131:0/4184555726 wait complete. 2024-04-12T19:39:42.680 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.7 2024-04-12T19:39:42.683 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574856 for osd.5 2024-04-12T19:39:42.686 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-04-12T19:39:43.635 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-12T19:39:43.657 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-12T19:39:43.663 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-12T19:39:43.664 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-12T19:39:43.665 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-12T19:39:43.681 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-12T19:39:43.683 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-12T19:39:43.687 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-12T19:39:43.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.924+0000 7fde5d200640 1 Processor -- start 2024-04-12T19:39:43.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.925+0000 7fde5d200640 1 -- start start 2024-04-12T19:39:43.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.927+0000 7fde5d200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fde50006e00 0x7fde500071e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.928+0000 7fde56a00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fde500263e0 0x7fde500d1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.131:41336/0 (socket says 172.21.15.131:41336) 2024-04-12T19:39:43.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.928+0000 7fde57e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fde500da4a0 0x7fde500dc890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34264/0 (socket says 172.21.15.131:34264) 2024-04-12T19:39:43.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.928+0000 7fde56a00640 1 -- 172.21.15.131:0/645057692 learned_addr learned my addr 172.21.15.131:0/645057692 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:43.928 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.928+0000 7fde5d200640 1 -- 172.21.15.131:0/645057692 --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde500d2240 con 0x7fde500da4a0 2024-04-12T19:39:43.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.929+0000 7fde57400640 1 --2- 172.21.15.131:0/645057692 >> v2:172.21.15.171:3300/0 conn(0x7fde50006e00 0x7fde500071e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.929+0000 7fde5d200640 1 -- 172.21.15.131:0/645057692 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde50042360 con 0x7fde500263e0 2024-04-12T19:39:43.929 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.929+0000 7fde5d200640 1 -- 172.21.15.131:0/645057692 --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fde50042110 con 0x7fde50006e00 2024-04-12T19:39:43.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.930+0000 7fde56000640 1 -- 172.21.15.131:0/645057692 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288104131 0 0) 0x7fde50042360 con 0x7fde500263e0 2024-04-12T19:39:43.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.930+0000 7fde56000640 1 -- 172.21.15.131:0/645057692 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde40003520 con 0x7fde500263e0 2024-04-12T19:39:43.930 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.930+0000 7fde56000640 1 -- 172.21.15.131:0/645057692 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321892099 0 0) 0x7fde500d2240 con 0x7fde500da4a0 2024-04-12T19:39:43.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.930+0000 7fde56000640 1 -- 172.21.15.131:0/645057692 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde50042360 con 0x7fde500da4a0 2024-04-12T19:39:43.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.931+0000 7fde57400640 1 -- 172.21.15.131:0/645057692 >> v1:172.21.15.171:6789/0 conn(0x7fde500263e0 legacy=0x7fde500d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.931+0000 7fde56000640 1 -- 172.21.15.131:0/645057692 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4172127085 0 0) 0x7fde50042360 con 0x7fde500da4a0 2024-04-12T19:39:43.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.931+0000 7fde57400640 1 -- 172.21.15.131:0/645057692 >> v1:172.21.15.131:6789/0 conn(0x7fde500da4a0 legacy=0x7fde500dc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.931+0000 7fde57400640 1 -- 172.21.15.131:0/645057692 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde50041800 con 0x7fde50006e00 2024-04-12T19:39:43.933 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.933+0000 7fde57400640 1 --2- 172.21.15.131:0/645057692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde50006e00 0x7fde500071e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097a0 tx=0x7fde4c02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee099e463ac95889 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.934+0000 7fde56000640 1 -- 172.21.15.131:0/645057692 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c037070 con 0x7fde50006e00 2024-04-12T19:39:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.934+0000 7fde56000640 1 -- 172.21.15.131:0/645057692 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde4c030510 con 0x7fde50006e00 2024-04-12T19:39:43.934 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.934+0000 7fde56000640 1 -- 172.21.15.131:0/645057692 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44001670 con 0x7fde50006e00 2024-04-12T19:39:43.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.935+0000 7fde5d200640 1 -- 172.21.15.131:0/645057692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde50006e00 msgr2=0x7fde500071e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.935 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.935+0000 7fde5d200640 1 --2- 172.21.15.131:0/645057692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde50006e00 0x7fde500071e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097a0 tx=0x7fde4c02b710 comp rx=0 tx=0).stop 2024-04-12T19:39:43.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.936+0000 7fde5d200640 1 -- 172.21.15.131:0/645057692 shutdown_connections 2024-04-12T19:39:43.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.936+0000 7fde5d200640 1 --2- 172.21.15.131:0/645057692 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde50006e00 0x7fde500071e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.936+0000 7fde5d200640 1 -- 172.21.15.131:0/645057692 >> 172.21.15.131:0/645057692 conn(0x7fde50005e90 msgr2=0x7fde500062a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:43.936 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.937+0000 7fde5d200640 1 -- 172.21.15.131:0/645057692 shutdown_connections 2024-04-12T19:39:43.937 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.937+0000 7fde5d200640 1 -- 172.21.15.131:0/645057692 wait complete. 2024-04-12T19:39:43.939 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.940+0000 7fde5d200640 1 Processor -- start 2024-04-12T19:39:43.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.940+0000 7fde5d200640 1 -- start start 2024-04-12T19:39:43.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.942+0000 7fde5d200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde50006e00 0x7fde500d2f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.942 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.942+0000 7fde5d200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde500263e0 0x7fde500d34a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.943+0000 7fde5d200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde500da4a0 0x7fde5002bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.943+0000 7fde5d200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fde50046060 con 0x7fde500263e0 2024-04-12T19:39:43.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.943+0000 7fde5d200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fde5000c0e0 con 0x7fde500da4a0 2024-04-12T19:39:43.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.943+0000 7fde5d200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fde500410c0 con 0x7fde50006e00 2024-04-12T19:39:43.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.943+0000 7fde57400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde50006e00 0x7fde500d2f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.943+0000 7fde57400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde50006e00 0x7fde500d2f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:46352/0 (socket says 172.21.15.131:46352) 2024-04-12T19:39:43.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.943+0000 7fde57400640 1 -- 172.21.15.131:0/1330516438 learned_addr learned my addr 172.21.15.131:0/1330516438 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:43.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.944+0000 7fde57e00640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde500da4a0 0x7fde5002bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.945+0000 7fde57e00640 1 -- 172.21.15.131:0/1330516438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde50006e00 msgr2=0x7fde500d2f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.945+0000 7fde57e00640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde50006e00 0x7fde500d2f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.945 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.945+0000 7fde57e00640 1 -- 172.21.15.131:0/1330516438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde500263e0 msgr2=0x7fde500d34a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-12T19:39:43.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.946+0000 7fde56a00640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde500263e0 0x7fde500d34a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.946+0000 7fde57e00640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde500263e0 0x7fde500d34a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.946+0000 7fde57e00640 1 -- 172.21.15.131:0/1330516438 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5003a4c0 con 0x7fde500da4a0 2024-04-12T19:39:43.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.946+0000 7fde56a00640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde500263e0 0x7fde500d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:43.946 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.946+0000 7fde57e00640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde500da4a0 0x7fde5002bb20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fde440011e0 tx=0x7fde4400c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:43.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.947+0000 7fde4b400640 1 -- 172.21.15.131:0/1330516438 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44017070 con 0x7fde500da4a0 2024-04-12T19:39:43.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.947+0000 7fde5d200640 1 -- 172.21.15.131:0/1330516438 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde500399d0 con 0x7fde500da4a0 2024-04-12T19:39:43.947 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.947+0000 7fde5d200640 1 -- 172.21.15.131:0/1330516438 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde5003d240 con 0x7fde500da4a0 2024-04-12T19:39:43.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.948+0000 7fde4b400640 1 -- 172.21.15.131:0/1330516438 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fde44007500 con 0x7fde500da4a0 2024-04-12T19:39:43.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.948+0000 7fde4b400640 1 -- 172.21.15.131:0/1330516438 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde44005a50 con 0x7fde500da4a0 2024-04-12T19:39:43.949 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.949+0000 7fde5d200640 1 -- 172.21.15.131:0/1330516438 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde34005290 con 0x7fde500da4a0 2024-04-12T19:39:43.952 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.952+0000 7fde4b400640 1 -- 172.21.15.131:0/1330516438 <== mon.1 v2:172.21.15.171:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fde4401a070 con 0x7fde500da4a0 2024-04-12T19:39:43.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.954+0000 7fde4b400640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fde3806c920 0x7fde3806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.954 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.954+0000 7fde4b400640 1 -- 172.21.15.131:0/1330516438 <== mon.1 v2:172.21.15.171:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fde4408b2c0 con 0x7fde500da4a0 2024-04-12T19:39:43.955 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.955+0000 7fde57400640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fde3806c920 0x7fde3806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.960 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.960+0000 7fde57400640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fde3806c920 0x7fde3806ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097a0 tx=0x7fde4c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:43.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.967+0000 7fde4b400640 1 -- 172.21.15.131:0/1330516438 <== mon.1 v2:172.21.15.171:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fde44059310 con 0x7fde500da4a0 2024-04-12T19:39:43.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.975+0000 7f400d600640 1 Processor -- start 2024-04-12T19:39:43.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.975+0000 7f400d600640 1 -- start start 2024-04-12T19:39:43.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.976+0000 7f400d600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f40080a7670 0x7f4008150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.976+0000 7f400d600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080bd9e0 0x7f40080b80e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.976+0000 7f400d600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40080bd560 con 0x7f40080b8620 2024-04-12T19:39:43.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.976+0000 7f400d600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f40080bf7b0 con 0x7f40080a7670 2024-04-12T19:39:43.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.976+0000 7f400d600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40080bfa90 con 0x7f40080bd9e0 2024-04-12T19:39:43.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.978+0000 7f4006a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f40080a7670 0x7f4008150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.978+0000 7f35c3200640 1 Processor -- start 2024-04-12T19:39:43.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.978+0000 7f4006000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080bd9e0 0x7f40080b80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.978+0000 7f4006000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080bd9e0 0x7f40080b80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:46364/0 (socket says 172.21.15.131:46364) 2024-04-12T19:39:43.978 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.978+0000 7f4006000640 1 -- 172.21.15.131:0/1865573445 learned_addr learned my addr 172.21.15.131:0/1865573445 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:43.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.979+0000 7f4006a00640 1 -- 172.21.15.131:0/1865573445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080bd9e0 msgr2=0x7f40080b80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:43.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.979+0000 7f4006a00640 1 --2- 172.21.15.131:0/1865573445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080bd9e0 0x7f40080b80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.979+0000 7f4006a00640 1 -- 172.21.15.131:0/1865573445 >> v1:172.21.15.171:6789/0 conn(0x7f40080b8620 legacy=0x7f40080bdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.979+0000 7f4006a00640 1 -- 172.21.15.131:0/1865573445 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40080bfd70 con 0x7f40080a7670 2024-04-12T19:39:43.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.980+0000 7f2d20c00640 1 Processor -- start 2024-04-12T19:39:43.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.978+0000 7f35c3200640 1 -- start start 2024-04-12T19:39:43.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.980+0000 7f2d20c00640 1 -- start start 2024-04-12T19:39:43.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.980+0000 7f35c3200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f35bc049040 0x7f35bc0cfdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.980+0000 7f35c3200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f35bc049650 0x7f35bc0071b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.980+0000 7f35c3200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35bc049cc0 con 0x7f35bc0cf9d0 2024-04-12T19:39:43.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.980+0000 7f35c3200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f35bc049a80 con 0x7f35bc049650 2024-04-12T19:39:43.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.980+0000 7f35c3200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f35bc0311f0 con 0x7f35bc049040 2024-04-12T19:39:43.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.981+0000 7f4006a00640 1 --2- 172.21.15.131:0/1865573445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080a7670 0x7f4008150fc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8008260 tx=0x7f3ff802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a651e9bbfe4b7c23 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:43.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.981+0000 7f4005600640 1 -- 172.21.15.131:0/1865573445 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8008df0 con 0x7f40080a7670 2024-04-12T19:39:43.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.981+0000 7f4005600640 1 -- 172.21.15.131:0/1865573445 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff800a0d0 con 0x7f40080a7670 2024-04-12T19:39:43.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.981+0000 7f35c1400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f35bc049040 0x7f35bc0cfdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.981+0000 7f35c1400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f35bc049040 0x7f35bc0cfdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:35154/0 (socket says 172.21.15.131:35154) 2024-04-12T19:39:43.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.981+0000 7f35c1400640 1 -- 172.21.15.131:0/3110617457 learned_addr learned my addr 172.21.15.131:0/3110617457 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:43.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.981+0000 7f4005600640 1 -- 172.21.15.131:0/1865573445 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8008df0 con 0x7f40080a7670 2024-04-12T19:39:43.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.982+0000 7f35c2800640 1 --2- 172.21.15.131:0/3110617457 >> v2:172.21.15.131:3300/0 conn(0x7f35bc049650 0x7f35bc0071b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.982+0000 7f2d20c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d140cdbd0 0x7f2d140d77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.982+0000 7f2d20c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2d140d4d70 0x7f2d14043920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.982+0000 7f35c2800640 1 -- 172.21.15.131:0/3110617457 >> v2:172.21.15.171:3300/0 conn(0x7f35bc049040 msgr2=0x7f35bc0cfdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:43.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.982+0000 7f35c2800640 1 --2- 172.21.15.131:0/3110617457 >> v2:172.21.15.171:3300/0 conn(0x7f35bc049040 0x7f35bc0cfdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.982+0000 7f35c2800640 1 -- 172.21.15.131:0/3110617457 >> v1:172.21.15.171:6789/0 conn(0x7f35bc0cf9d0 legacy=0x7f35bc04a070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.982+0000 7f35c2800640 1 -- 172.21.15.131:0/3110617457 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35bc0d5ce0 con 0x7f35bc049650 2024-04-12T19:39:43.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.983+0000 7f400d600640 1 -- 172.21.15.131:0/1865573445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080a7670 msgr2=0x7f4008150fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.983+0000 7f400d600640 1 --2- 172.21.15.131:0/1865573445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080a7670 0x7f4008150fc0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8008260 tx=0x7f3ff802b8f0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.983+0000 7f2d20c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d140070a0 con 0x7f2d14043e60 2024-04-12T19:39:43.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.983+0000 7f2d20c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f2d14007380 con 0x7f2d140d4d70 2024-04-12T19:39:43.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.983+0000 7f2d20c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2d140d6ff0 con 0x7f2d140cdbd0 2024-04-12T19:39:43.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.983+0000 7f400d600640 1 -- 172.21.15.131:0/1865573445 shutdown_connections 2024-04-12T19:39:43.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.983+0000 7f400d600640 1 --2- 172.21.15.131:0/1865573445 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080bd9e0 0x7f40080b80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.983+0000 7f400d600640 1 --2- 172.21.15.131:0/1865573445 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080a7670 0x7f4008150fc0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.983+0000 7f400d600640 1 -- 172.21.15.131:0/1865573445 >> 172.21.15.131:0/1865573445 conn(0x7f400806b9e0 msgr2=0x7f400806bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:43.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.983+0000 7f2d1aa00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2d140d4d70 0x7f2d14043920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.983+0000 7f2d1aa00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f2d140d4d70 0x7f2d14043920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:35168/0 (socket says 172.21.15.131:35168) 2024-04-12T19:39:43.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.983+0000 7f2d1aa00640 1 -- 172.21.15.131:0/377275356 learned_addr learned my addr 172.21.15.131:0/377275356 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:43.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.984+0000 7f2d1aa00640 1 -- 172.21.15.131:0/377275356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d140cdbd0 msgr2=0x7f2d140d77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:43.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.984+0000 7f2d1aa00640 1 --2- 172.21.15.131:0/377275356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d140cdbd0 0x7f2d140d77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.984+0000 7f2d1aa00640 1 -- 172.21.15.131:0/377275356 >> v1:172.21.15.171:6789/0 conn(0x7f2d14043e60 legacy=0x7f2d140d61d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-12T19:39:43.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.984+0000 7f2d1aa00640 1 -- 172.21.15.131:0/377275356 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d14045780 con 0x7f2d140d4d70 2024-04-12T19:39:43.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.985+0000 7f35c2800640 1 --2- 172.21.15.131:0/3110617457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35bc049650 0x7f35bc0071b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35c40758c0 tx=0x7f35c40a7260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd75f2e41f7b3bf server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:43.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.985+0000 7f35c0a00640 1 -- 172.21.15.131:0/3110617457 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c40b4070 con 0x7f35bc049650 2024-04-12T19:39:43.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.986+0000 7f35c0a00640 1 -- 172.21.15.131:0/3110617457 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35c40af640 con 0x7f35bc049650 2024-04-12T19:39:43.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.986+0000 7f35c0a00640 1 -- 172.21.15.131:0/3110617457 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35c40afa70 con 0x7f35bc049650 2024-04-12T19:39:43.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.985+0000 7f400d600640 1 -- 172.21.15.131:0/1865573445 shutdown_connections 2024-04-12T19:39:43.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.985+0000 7f400d600640 1 -- 172.21.15.131:0/1865573445 wait complete. 2024-04-12T19:39:43.988 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.986+0000 7f2d1aa00640 1 --2- 172.21.15.131:0/377275356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d140d4d70 0x7f2d14043920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009870 tx=0x7f2d0802b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e0c12a55d0a8200 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:43.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f35c3200640 1 -- 172.21.15.131:0/3110617457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35bc049650 msgr2=0x7f35bc0071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f5ff3800640 1 Processor -- start 2024-04-12T19:39:43.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f35c3200640 1 --2- 172.21.15.131:0/3110617457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35bc049650 0x7f35bc0071b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f35c40758c0 tx=0x7f35c40a7260 comp rx=0 tx=0).stop 2024-04-12T19:39:43.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f2d1a000640 1 -- 172.21.15.131:0/377275356 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d08035020 con 0x7f2d140d4d70 2024-04-12T19:39:43.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f2d1a000640 1 -- 172.21.15.131:0/377275356 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d08031640 con 0x7f2d140d4d70 2024-04-12T19:39:43.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f2d1a000640 1 -- 172.21.15.131:0/377275356 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d0802d040 con 0x7f2d140d4d70 2024-04-12T19:39:43.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f35c3200640 1 -- 172.21.15.131:0/3110617457 shutdown_connections 2024-04-12T19:39:43.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f35c3200640 1 --2- 172.21.15.131:0/3110617457 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35bc049650 0x7f35bc0071b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f35c3200640 1 --2- 172.21.15.131:0/3110617457 >> v2:172.21.15.171:3300/0 conn(0x7f35bc049040 0x7f35bc0cfdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f35c3200640 1 -- 172.21.15.131:0/3110617457 >> 172.21.15.131:0/3110617457 conn(0x7f35bc047cc0 msgr2=0x7f35bc0480d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:43.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f400d600640 1 Processor -- start 2024-04-12T19:39:43.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f400d600640 1 -- start start 2024-04-12T19:39:43.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.987+0000 7f5ff3800640 1 -- start start 2024-04-12T19:39:43.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.988+0000 7f35c3200640 1 -- 172.21.15.131:0/3110617457 shutdown_connections 2024-04-12T19:39:43.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.988+0000 7f2d20c00640 1 -- 172.21.15.131:0/377275356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d140d4d70 msgr2=0x7f2d14043920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.988+0000 7f2d20c00640 1 --2- 172.21.15.131:0/377275356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d140d4d70 0x7f2d14043920 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2d08009870 tx=0x7f2d0802b8f0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.991+0000 7f2d20c00640 1 -- 172.21.15.131:0/377275356 shutdown_connections 2024-04-12T19:39:43.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.991+0000 7f2d20c00640 1 --2- 172.21.15.131:0/377275356 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d140d4d70 0x7f2d14043920 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.991+0000 7f2d20c00640 1 --2- 172.21.15.131:0/377275356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d140cdbd0 0x7f2d140d77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.991+0000 7f2d20c00640 1 -- 172.21.15.131:0/377275356 >> 172.21.15.131:0/377275356 conn(0x7f2d140061a0 msgr2=0x7f2d140065b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:43.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.989+0000 7f400d600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080a7670 0x7f40080c08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.989+0000 7f400d600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40080b8620 0x7f40081ebbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.989+0000 7f400d600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080bd9e0 0x7f40080a3a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.989+0000 7f400d600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f40080a5850 con 0x7f40080bd9e0 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.989+0000 7f400d600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4008150aa0 con 0x7f40080b8620 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.989+0000 7f400d600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f40080b9550 con 0x7f40080a7670 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f4006a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080a7670 0x7f40080c08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f4006a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080a7670 0x7f40080c08e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:46370/0 (socket says 172.21.15.131:46370) 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f4006a00640 1 -- 172.21.15.131:0/1335120238 learned_addr learned my addr 172.21.15.131:0/1335120238 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f4006000640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40080b8620 0x7f40081ebbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f4007400640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080bd9e0 0x7f40080a3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f4006a00640 1 -- 172.21.15.131:0/1335120238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40080b8620 msgr2=0x7f40081ebbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f4006a00640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40080b8620 0x7f40081ebbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f4006a00640 1 -- 172.21.15.131:0/1335120238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080bd9e0 msgr2=0x7f40080a3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f4006a00640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080bd9e0 0x7f40080a3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:43.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f4006a00640 1 -- 172.21.15.131:0/1335120238 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40080c0e20 con 0x7f40080a7670 2024-04-12T19:39:43.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f4007400640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080bd9e0 0x7f40080a3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:43.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.989+0000 7f5ff3800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5fec0a4d60 0x7f5fec1591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.989+0000 7f5ff3800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fec06e380 con 0x7f5fec159710 2024-04-12T19:39:43.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.989+0000 7f5ff3800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fec0bd660 con 0x7f5fec0bf720 2024-04-12T19:39:43.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.989+0000 7f5ff3800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f5fec06e660 con 0x7f5fec0a4d60 2024-04-12T19:39:43.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.989+0000 7f5ff1800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f5fec159710 0x7f5fec15ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34280/0 (socket says 172.21.15.131:34280) 2024-04-12T19:39:43.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.989+0000 7f5ff1800640 1 -- 172.21.15.131:0/1562262559 learned_addr learned my addr 172.21.15.131:0/1562262559 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:43.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f5febe00640 1 --2- 172.21.15.131:0/1562262559 >> v2:172.21.15.131:3300/0 conn(0x7f5fec0a4d60 0x7f5fec1591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:43.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.990+0000 7f5feb400640 1 -- 172.21.15.131:0/1562262559 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24388376 0 0) 0x7f5fec06e380 con 0x7f5fec159710 2024-04-12T19:39:43.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.991+0000 7f5feb400640 1 -- 172.21.15.131:0/1562262559 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fd4003520 con 0x7f5fec159710 2024-04-12T19:39:43.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.991+0000 7f2d20c00640 1 -- 172.21.15.131:0/377275356 shutdown_connections 2024-04-12T19:39:43.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.991+0000 7f2d20c00640 1 -- 172.21.15.131:0/377275356 wait complete. 2024-04-12T19:39:43.995 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.988+0000 7f35c3200640 1 -- 172.21.15.131:0/3110617457 wait complete. 2024-04-12T19:39:43.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.991+0000 7f35c3200640 1 Processor -- start 2024-04-12T19:39:43.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.992+0000 7f5feb400640 1 -- 172.21.15.131:0/1562262559 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258349971 0 0) 0x7f5fec0bd660 con 0x7f5fec0bf720 2024-04-12T19:39:43.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.992+0000 7f5feb400640 1 -- 172.21.15.131:0/1562262559 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fec06e380 con 0x7f5fec0bf720 2024-04-12T19:39:43.996 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.991+0000 7f4006a00640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080a7670 0x7f40080c08e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8008350 tx=0x7f3ff80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:43.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.992+0000 7f5febe00640 1 -- 172.21.15.131:0/1562262559 >> v1:172.21.15.171:6789/0 conn(0x7f5fec0bf720 legacy=0x7f5fec0be140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.992+0000 7f5febe00640 1 -- 172.21.15.131:0/1562262559 >> v1:172.21.15.131:6789/0 conn(0x7f5fec159710 legacy=0x7f5fec15ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:43.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.992+0000 7f5febe00640 1 -- 172.21.15.131:0/1562262559 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fec0bd940 con 0x7f5fec0a4d60 2024-04-12T19:39:43.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.992+0000 7f3ffea00640 1 -- 172.21.15.131:0/1335120238 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8040030 con 0x7f40080a7670 2024-04-12T19:39:43.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.992+0000 7f3ffea00640 1 -- 172.21.15.131:0/1335120238 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ff8004020 con 0x7f40080a7670 2024-04-12T19:39:43.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.992+0000 7f3ffea00640 1 -- 172.21.15.131:0/1335120238 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80043d0 con 0x7f40080a7670 2024-04-12T19:39:43.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.992+0000 7f400d600640 1 -- 172.21.15.131:0/1335120238 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40081ec130 con 0x7f40080a7670 2024-04-12T19:39:43.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.992+0000 7f400d600640 1 -- 172.21.15.131:0/1335120238 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f40080a48b0 con 0x7f40080a7670 2024-04-12T19:39:43.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.993+0000 7f400d600640 1 -- 172.21.15.131:0/1335120238 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40080a3640 con 0x7f40080a7670 2024-04-12T19:39:43.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.993+0000 7f2d20c00640 1 Processor -- start 2024-04-12T19:39:43.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.994+0000 7f35c3200640 1 -- start start 2024-04-12T19:39:43.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.995+0000 7f35c3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35bc049040 0x7f35bc03deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.995+0000 7f35c3200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35bc049650 0x7f35bc040160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.995+0000 7f35c3200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35bc0cf9d0 0x7f35bc044fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:43.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.995+0000 7f5febe00640 1 --2- 172.21.15.131:0/1562262559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0a4d60 0x7f5fec1591d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80097a0 tx=0x7f5fd802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a846c5c9dbae028b server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.996+0000 7f35c1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35bc049040 0x7f35bc03deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.996+0000 7f2d20c00640 1 -- start start 2024-04-12T19:39:44.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f35c1e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35bc049040 0x7f35bc03deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41430/0 (socket says 172.21.15.131:41430) 2024-04-12T19:39:44.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f35c1e00640 1 -- 172.21.15.131:0/3339689163 learned_addr learned my addr 172.21.15.131:0/3339689163 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:44.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc0d5990 con 0x7f35bc049040 2024-04-12T19:39:44.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f5feb400640 1 -- 172.21.15.131:0/1562262559 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8034070 con 0x7f5fec0a4d60 2024-04-12T19:39:44.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f5feb400640 1 -- 172.21.15.131:0/1562262559 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fd8030840 con 0x7f5fec0a4d60 2024-04-12T19:39:44.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f5feb400640 1 -- 172.21.15.131:0/1562262559 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fd8030c50 con 0x7f5fec0a4d60 2024-04-12T19:39:44.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.996+0000 7f3ffea00640 1 -- 172.21.15.131:0/1335120238 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ff803a040 con 0x7f40080a7670 2024-04-12T19:39:44.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f9220600640 1 Processor -- start 2024-04-12T19:39:44.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f2d20c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d14043e60 0x7f2d14173a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f2d20c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d140cdbd0 0x7f2d140d3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.002 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f2d20c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d140d4d70 0x7f2d14029da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f9220600640 1 -- start start 2024-04-12T19:39:44.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f35bc0d62a0 con 0x7f35bc0cf9d0 2024-04-12T19:39:44.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f35bc0d67c0 con 0x7f35bc049650 2024-04-12T19:39:44.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f35c1400640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35bc049650 0x7f35bc040160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.997+0000 7f35c2800640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35bc0cf9d0 0x7f35bc044fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f3ffea00640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f3fe806c940 0x7f3fe806ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f2d20c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f2d140cdfb0 con 0x7f2d140d4d70 2024-04-12T19:39:44.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f2d20c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f2d140d7d30 con 0x7f2d140cdbd0 2024-04-12T19:39:44.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f2d20c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f2d14006cc0 con 0x7f2d14043e60 2024-04-12T19:39:44.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f3ffea00640 1 -- 172.21.15.131:0/1335120238 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3ff80adea0 con 0x7f40080a7670 2024-04-12T19:39:44.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f2d1b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d14043e60 0x7f2d14173a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f2d1be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d140d4d70 0x7f2d14029da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f35c1400640 1 -- 172.21.15.131:0/3339689163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35bc0cf9d0 msgr2=0x7f35bc044fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f35c1400640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35bc0cf9d0 0x7f35bc044fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f35c1400640 1 -- 172.21.15.131:0/3339689163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35bc049040 msgr2=0x7f35bc03deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.005 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f35c1400640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35bc049040 0x7f35bc03deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f35c1400640 1 -- 172.21.15.131:0/3339689163 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35bc0d3200 con 0x7f35bc049650 2024-04-12T19:39:44.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f5ff3800640 1 -- 172.21.15.131:0/1562262559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0a4d60 msgr2=0x7f5fec1591d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f5ff3800640 1 --2- 172.21.15.131:0/1562262559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0a4d60 0x7f5fec1591d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5fd80097a0 tx=0x7f5fd802b980 comp rx=0 tx=0).stop 2024-04-12T19:39:44.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f2d1b400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d14043e60 0x7f2d14173a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:46400/0 (socket says 172.21.15.131:46400) 2024-04-12T19:39:44.006 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f2d1b400640 1 -- 172.21.15.131:0/2370299414 learned_addr learned my addr 172.21.15.131:0/2370299414 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:44.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f35c1e00640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35bc049040 0x7f35bc03deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:39:44.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.998+0000 7f4006000640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f3fe806c940 0x7f3fe806ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f2d1aa00640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d140cdbd0 0x7f2d140d3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.007 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f9220600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92180c17a0 0x7f92180c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f9220600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f92181511e0 0x7f9218151640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f9220600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92180c5e80 con 0x7f92180c31f0 2024-04-12T19:39:44.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f9220600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f92180c59f0 con 0x7f92181511e0 2024-04-12T19:39:44.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f9220600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f92180c4020 con 0x7f92180c17a0 2024-04-12T19:39:44.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f35c1400640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35bc049650 0x7f35bc040160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e600 tx=0x7f35b000eac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f5ff3800640 1 -- 172.21.15.131:0/1562262559 shutdown_connections 2024-04-12T19:39:44.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f5ff3800640 1 --2- 172.21.15.131:0/1562262559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0a4d60 0x7f5fec1591d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.008 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f5ff3800640 1 -- 172.21.15.131:0/1562262559 >> 172.21.15.131:0/1562262559 conn(0x7f5fec06be00 msgr2=0x7f5fec06c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f3916800640 1 Processor -- start 2024-04-12T19:39:44.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f5ff3800640 1 -- 172.21.15.131:0/1562262559 shutdown_connections 2024-04-12T19:39:44.009 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.000+0000 7f3916800640 1 -- start start 2024-04-12T19:39:44.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.000+0000 7f921dc00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92180c17a0 0x7f92180c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.000+0000 7f921e600640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f92180c31f0 0x7f92180c36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.131:41384/0 (socket says 172.21.15.131:41384) 2024-04-12T19:39:44.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.000+0000 7f4006000640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f3fe806c940 0x7f3fe806ee00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400f4c0 tx=0x7f3ff4011040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.000+0000 7f921e600640 1 -- 172.21.15.131:0/1239020211 learned_addr learned my addr 172.21.15.131:0/1239020211 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:44.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:43.999+0000 7f5ff3800640 1 -- 172.21.15.131:0/1562262559 wait complete. 2024-04-12T19:39:44.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.000+0000 7f2d1b400640 1 -- 172.21.15.131:0/2370299414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d140cdbd0 msgr2=0x7f2d140d3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.000+0000 7f2d1b400640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d140cdbd0 0x7f2d140d3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.000+0000 7f2d1b400640 1 -- 172.21.15.131:0/2370299414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d140d4d70 msgr2=0x7f2d14029da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.000+0000 7f2d1b400640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d140d4d70 0x7f2d14029da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.011 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.000+0000 7f2d1b400640 1 -- 172.21.15.131:0/2370299414 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d140096f0 con 0x7f2d14043e60 2024-04-12T19:39:44.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.000+0000 7f921d200640 1 --2- 172.21.15.131:0/1239020211 >> v2:172.21.15.131:3300/0 conn(0x7f92181511e0 0x7f9218151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.001+0000 7f2d1b400640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d14043e60 0x7f2d14173a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000b440 tx=0x7f2d1000b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.001+0000 7f921d200640 1 -- 172.21.15.131:0/1239020211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92180c17a0 msgr2=0x7f92180c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:44.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.001+0000 7f921d200640 1 --2- 172.21.15.131:0/1239020211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92180c17a0 0x7f92180c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.001+0000 7f921d200640 1 -- 172.21.15.131:0/1239020211 >> v1:172.21.15.171:6789/0 conn(0x7f92180c31f0 legacy=0x7f92180c36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.001+0000 7f921d200640 1 -- 172.21.15.131:0/1239020211 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92180c6260 con 0x7f92181511e0 2024-04-12T19:39:44.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.001+0000 7f921dc00640 1 --2- 172.21.15.131:0/1239020211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92180c17a0 0x7f92180c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:39:44.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.001+0000 7f3916800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f39100c17a0 0x7f39100c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.002+0000 7f3916800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39100c5e80 con 0x7f39101511e0 2024-04-12T19:39:44.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.002+0000 7f390ea00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f39101511e0 0x7f39100c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34282/0 (socket says 172.21.15.131:34282) 2024-04-12T19:39:44.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.002+0000 7f390ea00640 1 -- 172.21.15.131:0/488484039 learned_addr learned my addr 172.21.15.131:0/488484039 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:44.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.002+0000 7f5ff3800640 1 Processor -- start 2024-04-12T19:39:44.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.002+0000 7f390f400640 1 --2- 172.21.15.131:0/488484039 >> v2:172.21.15.131:3300/0 conn(0x7f39100c17a0 0x7f39100c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.002+0000 7f3916800640 1 -- 172.21.15.131:0/488484039 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39100c4020 con 0x7f39100c3900 2024-04-12T19:39:44.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.002+0000 7f3916800640 1 -- 172.21.15.131:0/488484039 --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f39100c59f0 con 0x7f39100c17a0 2024-04-12T19:39:44.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f390f400640 1 -- 172.21.15.131:0/488484039 >> v1:172.21.15.171:6789/0 conn(0x7f39100c3900 legacy=0x7f391015ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:44.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f921d200640 1 --2- 172.21.15.131:0/1239020211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92181511e0 0x7f9218151640 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f920c0097a0 tx=0x7f920c02b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57c74728d905ed7d server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.002+0000 7f5ff3800640 1 -- start start 2024-04-12T19:39:44.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f9217e00640 1 -- 172.21.15.131:0/1239020211 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c035020 con 0x7f92181511e0 2024-04-12T19:39:44.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f9217e00640 1 -- 172.21.15.131:0/1239020211 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920c031810 con 0x7f92181511e0 2024-04-12T19:39:44.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f9217e00640 1 -- 172.21.15.131:0/1239020211 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f920c031be0 con 0x7f92181511e0 2024-04-12T19:39:44.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f390f400640 1 -- 172.21.15.131:0/488484039 >> v1:172.21.15.131:6789/0 conn(0x7f39101511e0 legacy=0x7f39100c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f390f400640 1 -- 172.21.15.131:0/488484039 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39100c6260 con 0x7f39100c17a0 2024-04-12T19:39:44.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f5ff3800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0bf720 0x7f5fec150ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f5ff3800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fec159710 0x7f5fec0a6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f5ff3800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fec0b9990 0x7f5fec14b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f5ff3800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec0bee20 con 0x7f5fec0bf720 2024-04-12T19:39:44.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f5ff3800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5fec0bdcb0 con 0x7f5fec159710 2024-04-12T19:39:44.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.003+0000 7f5ff3800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5fec0bfb00 con 0x7f5fec0b9990 2024-04-12T19:39:44.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f5ff0e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0bf720 0x7f5fec150ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f5ff0e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0bf720 0x7f5fec150ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41448/0 (socket says 172.21.15.131:41448) 2024-04-12T19:39:44.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f5ff0e00640 1 -- 172.21.15.131:0/4106745250 learned_addr learned my addr 172.21.15.131:0/4106745250 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:44.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f9220600640 1 -- 172.21.15.131:0/1239020211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92181511e0 msgr2=0x7f9218151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.017 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f9220600640 1 --2- 172.21.15.131:0/1239020211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92181511e0 0x7f9218151640 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f920c0097a0 tx=0x7f920c02b8b0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f5febe00640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fec159710 0x7f5fec0a6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.018 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f390f400640 1 --2- 172.21.15.131:0/488484039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39100c17a0 0x7f39100c28c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0097a0 tx=0x7f38fc02b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ceb8886e319210 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f5ff1800640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fec0b9990 0x7f5fec14b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f5ff0e00640 1 -- 172.21.15.131:0/4106745250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fec0b9990 msgr2=0x7f5fec14b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f5ff0e00640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fec0b9990 0x7f5fec14b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f5ff0e00640 1 -- 172.21.15.131:0/4106745250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fec159710 msgr2=0x7f5fec0a6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f5ff0e00640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fec159710 0x7f5fec0a6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f5ff0e00640 1 -- 172.21.15.131:0/4106745250 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fec150ff0 con 0x7f5fec0bf720 2024-04-12T19:39:44.019 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f9220600640 1 -- 172.21.15.131:0/1239020211 shutdown_connections 2024-04-12T19:39:44.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f9220600640 1 --2- 172.21.15.131:0/1239020211 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92181511e0 0x7f9218151640 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.004+0000 7f390e000640 1 -- 172.21.15.131:0/488484039 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc037070 con 0x7f39100c17a0 2024-04-12T19:39:44.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f9220600640 1 --2- 172.21.15.131:0/1239020211 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92180c17a0 0x7f92180c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f9220600640 1 -- 172.21.15.131:0/1239020211 >> 172.21.15.131:0/1239020211 conn(0x7f92180a8490 msgr2=0x7f92180a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f390e000640 1 -- 172.21.15.131:0/488484039 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38fc030710 con 0x7f39100c17a0 2024-04-12T19:39:44.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f390e000640 1 -- 172.21.15.131:0/488484039 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38fc030ae0 con 0x7f39100c17a0 2024-04-12T19:39:44.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f9220600640 1 -- 172.21.15.131:0/1239020211 shutdown_connections 2024-04-12T19:39:44.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f5ff0e00640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0bf720 0x7f5fec150ab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000c4c0 tx=0x7f5fe000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f9220600640 1 -- 172.21.15.131:0/1239020211 wait complete. 2024-04-12T19:39:44.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f5fe8c00640 1 -- 172.21.15.131:0/4106745250 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe00052d0 con 0x7f5fec0bf720 2024-04-12T19:39:44.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f5fe8c00640 1 -- 172.21.15.131:0/4106745250 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fe0005470 con 0x7f5fec0bf720 2024-04-12T19:39:44.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f5fe8c00640 1 -- 172.21.15.131:0/4106745250 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fe0012930 con 0x7f5fec0bf720 2024-04-12T19:39:44.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f3916800640 1 -- 172.21.15.131:0/488484039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39100c17a0 msgr2=0x7f39100c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f5ff3800640 1 -- 172.21.15.131:0/4106745250 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fec0a5970 con 0x7f5fec0bf720 2024-04-12T19:39:44.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.006+0000 7f5ff3800640 1 -- 172.21.15.131:0/4106745250 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fec0a5c10 con 0x7f5fec0bf720 2024-04-12T19:39:44.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.005+0000 7f3916800640 1 --2- 172.21.15.131:0/488484039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39100c17a0 0x7f39100c28c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f38fc0097a0 tx=0x7f38fc02b790 comp rx=0 tx=0).stop 2024-04-12T19:39:44.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.006+0000 7f3916800640 1 -- 172.21.15.131:0/488484039 shutdown_connections 2024-04-12T19:39:44.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.006+0000 7f3916800640 1 --2- 172.21.15.131:0/488484039 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39100c17a0 0x7f39100c28c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.006+0000 7f3916800640 1 -- 172.21.15.131:0/488484039 >> 172.21.15.131:0/488484039 conn(0x7f39100a8490 msgr2=0x7f39100a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.006+0000 7f3916800640 1 -- 172.21.15.131:0/488484039 shutdown_connections 2024-04-12T19:39:44.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.007+0000 7f9220600640 1 Processor -- start 2024-04-12T19:39:44.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.007+0000 7f5ff3800640 1 -- 172.21.15.131:0/4106745250 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fec04fd50 con 0x7f5fec0bf720 2024-04-12T19:39:44.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.007+0000 7f9220600640 1 -- start start 2024-04-12T19:39:44.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.006+0000 7f3916800640 1 -- 172.21.15.131:0/488484039 wait complete. 2024-04-12T19:39:44.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.008+0000 7f3916800640 1 Processor -- start 2024-04-12T19:39:44.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.008+0000 7f3916800640 1 -- start start 2024-04-12T19:39:44.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.008+0000 7f9220600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92180c17a0 0x7f92180bc390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.008+0000 7f9220600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92180c31f0 0x7f92180a4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.008+0000 7f9220600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92181511e0 0x7f92180bb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.008+0000 7f9220600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f92180c48e0 con 0x7f92180c17a0 2024-04-12T19:39:44.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.008+0000 7f9220600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f92180c4760 con 0x7f92181511e0 2024-04-12T19:39:44.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.008+0000 7f9220600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f92180c1b80 con 0x7f92180c31f0 2024-04-12T19:39:44.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f921dc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92180c17a0 0x7f92180bc390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f921dc00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92180c17a0 0x7f92180bc390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41452/0 (socket says 172.21.15.131:41452) 2024-04-12T19:39:44.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f921dc00640 1 -- 172.21.15.131:0/869157976 learned_addr learned my addr 172.21.15.131:0/869157976 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:44.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f3916800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39100c17a0 0x7f39101e4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f921d200640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92180c31f0 0x7f92180a4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f921e600640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92181511e0 0x7f92180bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f921dc00640 1 -- 172.21.15.131:0/869157976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92180c31f0 msgr2=0x7f92180a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f3916800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39100c3900 0x7f39101f4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.010+0000 7f3916800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39101511e0 0x7f39101e2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f921dc00640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92180c31f0 0x7f92180a4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f921dc00640 1 -- 172.21.15.131:0/869157976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92181511e0 msgr2=0x7f92180bb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f921dc00640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92181511e0 0x7f92180bb310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f921dc00640 1 -- 172.21.15.131:0/869157976 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92180a4e50 con 0x7f92180c17a0 2024-04-12T19:39:44.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.010+0000 7f921d200640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92180c31f0 0x7f92180a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:44.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.010+0000 7f921e600640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92181511e0 0x7f92180bb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T19:39:44.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.010+0000 7f390fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39101511e0 0x7f39101e2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.010+0000 7f390fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39101511e0 0x7f39101e2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41454/0 (socket says 172.21.15.131:41454) 2024-04-12T19:39:44.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.010+0000 7f390ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39100c3900 0x7f39101f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.010+0000 7f390ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39100c3900 0x7f39101f4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:46434/0 (socket says 172.21.15.131:46434) 2024-04-12T19:39:44.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.010+0000 7f390fe00640 1 -- 172.21.15.131:0/4123428150 learned_addr learned my addr 172.21.15.131:0/4123428150 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:44.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.010+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f39100c48e0 con 0x7f39101511e0 2024-04-12T19:39:44.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.010+0000 7f390f400640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39100c17a0 0x7f39101e4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.010+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f39100c4760 con 0x7f39100c17a0 2024-04-12T19:39:44.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.010+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f39100c1b80 con 0x7f39100c3900 2024-04-12T19:39:44.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.011+0000 7f921dc00640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92180c17a0 0x7f92180bc390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f920400ec10 tx=0x7f920400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.009+0000 7f5fe8c00640 1 -- 172.21.15.131:0/4106745250 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5fe0012ad0 con 0x7f5fec0bf720 2024-04-12T19:39:44.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.011+0000 7f5fe8c00640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5fcc06c8f0 0x7f5fcc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.011+0000 7f5fe8c00640 1 -- 172.21.15.131:0/4106745250 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5fe008bb50 con 0x7f5fec0bf720 2024-04-12T19:39:44.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.011+0000 7f3ffea00640 1 -- 172.21.15.131:0/1335120238 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3ff807ba20 con 0x7f40080a7670 2024-04-12T19:39:44.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.011+0000 7f35ba000640 1 -- 172.21.15.131:0/3339689163 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b0017070 con 0x7f35bc049650 2024-04-12T19:39:44.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.011+0000 7f35ba000640 1 -- 172.21.15.131:0/3339689163 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b000c620 con 0x7f35bc049650 2024-04-12T19:39:44.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.012+0000 7f35ba000640 1 -- 172.21.15.131:0/3339689163 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b000f040 con 0x7f35bc049650 2024-04-12T19:39:44.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.012+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35bc02a920 con 0x7f35bc049650 2024-04-12T19:39:44.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.011+0000 7f5febe00640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5fcc06c8f0 0x7f5fcc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.012+0000 7f390ea00640 1 -- 172.21.15.131:0/4123428150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39100c17a0 msgr2=0x7f39101e4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.012+0000 7f390ea00640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39100c17a0 0x7f39101e4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.012+0000 7f390ea00640 1 -- 172.21.15.131:0/4123428150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39101511e0 msgr2=0x7f39101e2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.012+0000 7f390ea00640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39101511e0 0x7f39101e2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.012+0000 7f390ea00640 1 -- 172.21.15.131:0/4123428150 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39101e4640 con 0x7f39100c3900 2024-04-12T19:39:44.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.012+0000 7f390fe00640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39101511e0 0x7f39101e2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:39:44.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.013+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f35bc0d2080 con 0x7f35bc049650 2024-04-12T19:39:44.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.014+0000 7f2d0f400640 1 -- 172.21.15.131:0/2370299414 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10015020 con 0x7f2d14043e60 2024-04-12T19:39:44.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.014+0000 7f2d0f400640 1 -- 172.21.15.131:0/2370299414 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d10011890 con 0x7f2d14043e60 2024-04-12T19:39:44.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.015+0000 7f2d0f400640 1 -- 172.21.15.131:0/2370299414 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d10011c80 con 0x7f2d14043e60 2024-04-12T19:39:44.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.015+0000 7f2d20c00640 1 -- 172.21.15.131:0/2370299414 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d140479a0 con 0x7f2d14043e60 2024-04-12T19:39:44.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.015+0000 7f2d20c00640 1 -- 172.21.15.131:0/2370299414 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d140d6310 con 0x7f2d14043e60 2024-04-12T19:39:44.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.015+0000 7f5febe00640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5fcc06c8f0 0x7f5fcc06edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8036000 tx=0x7f5fd803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.015+0000 7f390ea00640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39100c3900 0x7f39101f4140 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f390000c500 tx=0x7f390000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.015+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35bc044ca0 con 0x7f35bc049650 2024-04-12T19:39:44.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.016+0000 7f3907400640 1 -- 172.21.15.131:0/4123428150 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3900018070 con 0x7f39100c3900 2024-04-12T19:39:44.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.016+0000 7f3907400640 1 -- 172.21.15.131:0/4123428150 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3900007560 con 0x7f39100c3900 2024-04-12T19:39:44.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.016+0000 7f3907400640 1 -- 172.21.15.131:0/4123428150 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39000049e0 con 0x7f39100c3900 2024-04-12T19:39:44.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.016+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39101f4680 con 0x7f39100c3900 2024-04-12T19:39:44.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.016+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f39101f6d40 con 0x7f39100c3900 2024-04-12T19:39:44.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.016+0000 7f2d20c00640 1 -- 172.21.15.131:0/2370299414 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d140057e0 con 0x7f2d14043e60 2024-04-12T19:39:44.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.016+0000 7f35ba000640 1 -- 172.21.15.131:0/3339689163 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f35b001a070 con 0x7f35bc049650 2024-04-12T19:39:44.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.018+0000 7f35ba000640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f35a406c9c0 0x7f35a406ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.018+0000 7f35ba000640 1 -- 172.21.15.131:0/3339689163 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f35b008af80 con 0x7f35bc049650 2024-04-12T19:39:44.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.018+0000 7f9215600640 1 -- 172.21.15.131:0/869157976 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204017070 con 0x7f92180c17a0 2024-04-12T19:39:44.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.018+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f391004fd50 con 0x7f39100c3900 2024-04-12T19:39:44.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.018+0000 7f9215600640 1 -- 172.21.15.131:0/869157976 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f920400cc30 con 0x7f92180c17a0 2024-04-12T19:39:44.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.018+0000 7f9215600640 1 -- 172.21.15.131:0/869157976 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9204013470 con 0x7f92180c17a0 2024-04-12T19:39:44.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.019+0000 7f5fe8c00640 1 -- 172.21.15.131:0/4106745250 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5fe0059c30 con 0x7f5fec0bf720 2024-04-12T19:39:44.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.019+0000 7f2d0f400640 1 -- 172.21.15.131:0/2370299414 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f2d10018020 con 0x7f2d14043e60 2024-04-12T19:39:44.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.019+0000 7f35c1e00640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f35a406c9c0 0x7f35a406ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.018+0000 7f9220600640 1 -- 172.21.15.131:0/869157976 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92180ba830 con 0x7f92180c17a0 2024-04-12T19:39:44.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.019+0000 7f9220600640 1 -- 172.21.15.131:0/869157976 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92180badf0 con 0x7f92180c17a0 2024-04-12T19:39:44.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.020+0000 7f35c1e00640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f35a406c9c0 0x7f35a406ee80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f35bc041e70 tx=0x7f35b4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.020+0000 7f2d0f400640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2cfc06c940 0x7f2cfc06ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.021+0000 7f2d0f400640 1 -- 172.21.15.131:0/2370299414 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f2d100565a0 con 0x7f2d14043e60 2024-04-12T19:39:44.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.021+0000 7f2d1aa00640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2cfc06c940 0x7f2cfc06ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.021+0000 7f9220600640 1 -- 172.21.15.131:0/869157976 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f921804fd50 con 0x7f92180c17a0 2024-04-12T19:39:44.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.022+0000 7f2d1aa00640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2cfc06c940 0x7f2cfc06ee00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2d08036000 tx=0x7f2d0803c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.024+0000 7f9215600640 1 -- 172.21.15.131:0/869157976 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f920401a070 con 0x7f92180c17a0 2024-04-12T19:39:44.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.025+0000 7f9215600640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f91f806c8f0 0x7f91f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.025+0000 7f9215600640 1 -- 172.21.15.131:0/869157976 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f920408c660 con 0x7f92180c17a0 2024-04-12T19:39:44.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.025+0000 7f921d200640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f91f806c8f0 0x7f91f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.026+0000 7f921d200640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f91f806c8f0 0x7f91f806edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f920c036000 tx=0x7f920c03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.030+0000 7f309f800640 1 Processor -- start 2024-04-12T19:39:44.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.030+0000 7f309f800640 1 -- start start 2024-04-12T19:39:44.042 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.031+0000 7f309f800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f30980c17a0 0x7f30980c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.031+0000 7f309f800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f30980c3900 0x7f309815ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.031+0000 7f309f800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30980c5e80 con 0x7f30981511e0 2024-04-12T19:39:44.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.031+0000 7f309f800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f30980c59f0 con 0x7f30980c17a0 2024-04-12T19:39:44.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.031+0000 7f309f800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f30980c4020 con 0x7f30980c3900 2024-04-12T19:39:44.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.031+0000 7f309d800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f30980c3900 0x7f309815ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.031+0000 7f309d800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f30980c3900 0x7f309815ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:35248/0 (socket says 172.21.15.131:35248) 2024-04-12T19:39:44.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.031+0000 7f309d800640 1 -- 172.21.15.131:0/895196203 learned_addr learned my addr 172.21.15.131:0/895196203 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:44.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.031+0000 7f3097e00640 1 --1- 172.21.15.131:0/895196203 >> v1:172.21.15.171:6789/0 conn(0x7f30981511e0 0x7f30980c31f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.131:41406/0 (socket says 172.21.15.131:41406) 2024-04-12T19:39:44.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.032+0000 7f309ce00640 1 --2- 172.21.15.131:0/895196203 >> v2:172.21.15.131:3300/0 conn(0x7f30980c17a0 0x7f30980c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.043 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.032+0000 7f9215600640 1 -- 172.21.15.131:0/869157976 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f920405a730 con 0x7f92180c17a0 2024-04-12T19:39:44.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.032+0000 7f35ba000640 1 -- 172.21.15.131:0/3339689163 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f35bc044ca0 con 0x7f35bc049650 2024-04-12T19:39:44.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.032+0000 7f309d800640 1 -- 172.21.15.131:0/895196203 >> v2:172.21.15.131:3300/0 conn(0x7f30980c17a0 msgr2=0x7f30980c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:44.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.032+0000 7f309d800640 1 --2- 172.21.15.131:0/895196203 >> v2:172.21.15.131:3300/0 conn(0x7f30980c17a0 0x7f30980c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.032+0000 7f309d800640 1 -- 172.21.15.131:0/895196203 >> v1:172.21.15.171:6789/0 conn(0x7f30981511e0 legacy=0x7f30980c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.032+0000 7f309d800640 1 -- 172.21.15.131:0/895196203 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30980c6260 con 0x7f30980c3900 2024-04-12T19:39:44.044 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.032+0000 7f309ce00640 1 --2- 172.21.15.131:0/895196203 >> v2:172.21.15.131:3300/0 conn(0x7f30980c17a0 0x7f30980c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:39:44.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.036+0000 7f3907400640 1 -- 172.21.15.131:0/4123428150 <== mon.2 v2:172.21.15.171:3301/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3900004b80 con 0x7f39100c3900 2024-04-12T19:39:44.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.036+0000 7f309d800640 1 --2- 172.21.15.131:0/895196203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30980c3900 0x7f309815ba80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f30980a6070 tx=0x7f309002bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d12cced4e4ce2f9f server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.036+0000 7f3097400640 1 -- 172.21.15.131:0/895196203 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f309002cb20 con 0x7f30980c3900 2024-04-12T19:39:44.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.036+0000 7f3097400640 1 -- 172.21.15.131:0/895196203 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309002ccc0 con 0x7f30980c3900 2024-04-12T19:39:44.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.036+0000 7f3097400640 1 -- 172.21.15.131:0/895196203 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090034610 con 0x7f30980c3900 2024-04-12T19:39:44.046 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.037+0000 7f3907400640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f38f006c8f0 0x7f38f006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.037+0000 7f309f800640 1 -- 172.21.15.131:0/895196203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30980c3900 msgr2=0x7f309815ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.037+0000 7f309f800640 1 --2- 172.21.15.131:0/895196203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30980c3900 0x7f309815ba80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f30980a6070 tx=0x7f309002bf80 comp rx=0 tx=0).stop 2024-04-12T19:39:44.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.038+0000 7f309f800640 1 -- 172.21.15.131:0/895196203 shutdown_connections 2024-04-12T19:39:44.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.038+0000 7f309f800640 1 --2- 172.21.15.131:0/895196203 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30980c3900 0x7f309815ba80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.038+0000 7f309f800640 1 --2- 172.21.15.131:0/895196203 >> v2:172.21.15.131:3300/0 conn(0x7f30980c17a0 0x7f30980c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.038+0000 7f309f800640 1 -- 172.21.15.131:0/895196203 >> 172.21.15.131:0/895196203 conn(0x7f30980a8490 msgr2=0x7f30980a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.038+0000 7f390f400640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f38f006c8f0 0x7f38f006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.047 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.041+0000 7f390f400640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f38f006c8f0 0x7f38f006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f38fc034000 tx=0x7f38fc02f000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.040+0000 7f309f800640 1 -- 172.21.15.131:0/895196203 shutdown_connections 2024-04-12T19:39:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.041+0000 7f309f800640 1 -- 172.21.15.131:0/895196203 wait complete. 2024-04-12T19:39:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.042+0000 7f309f800640 1 Processor -- start 2024-04-12T19:39:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.042+0000 7f309f800640 1 -- start start 2024-04-12T19:39:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.043+0000 7f309f800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30980c17a0 0x7f30980bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.043+0000 7f309f800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30980c3900 0x7f309814a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.043+0000 7f309f800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30981511e0 0x7f30980bb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.043+0000 7f309f800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f30980c48e0 con 0x7f30981511e0 2024-04-12T19:39:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.043+0000 7f309f800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f30980c4760 con 0x7f30980c17a0 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.043+0000 7f309f800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f30980c1b80 con 0x7f30980c3900 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.044+0000 7f309d800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30981511e0 0x7f30980bb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.044+0000 7f309ce00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30980c17a0 0x7f30980bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.044+0000 7f309d800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30981511e0 0x7f30980bb2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41464/0 (socket says 172.21.15.131:41464) 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.044+0000 7f309d800640 1 -- 172.21.15.131:0/1851030922 learned_addr learned my addr 172.21.15.131:0/1851030922 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.044+0000 7f3097e00640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30980c3900 0x7f309814a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.045+0000 7f309d800640 1 -- 172.21.15.131:0/1851030922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30980c3900 msgr2=0x7f309814a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.045+0000 7f309d800640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30980c3900 0x7f309814a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.045+0000 7f309d800640 1 -- 172.21.15.131:0/1851030922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30980c17a0 msgr2=0x7f30980bbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.045+0000 7f309d800640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30980c17a0 0x7f30980bbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.045+0000 7f309d800640 1 -- 172.21.15.131:0/1851030922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30980ba7f0 con 0x7f30981511e0 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.045+0000 7f309ce00640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30980c17a0 0x7f30980bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.045+0000 7f309d800640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30981511e0 0x7f30980bb2a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3090036040 tx=0x7f3090004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.046+0000 7f3094c00640 1 -- 172.21.15.131:0/1851030922 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090043020 con 0x7f30981511e0 2024-04-12T19:39:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.046+0000 7f3094c00640 1 -- 172.21.15.131:0/1851030922 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f309003e450 con 0x7f30981511e0 2024-04-12T19:39:44.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.046+0000 7f3094c00640 1 -- 172.21.15.131:0/1851030922 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3090009510 con 0x7f30981511e0 2024-04-12T19:39:44.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.046+0000 7f309f800640 1 -- 172.21.15.131:0/1851030922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30980ba550 con 0x7f30981511e0 2024-04-12T19:39:44.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.046+0000 7f309f800640 1 -- 172.21.15.131:0/1851030922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f309814bdf0 con 0x7f30981511e0 2024-04-12T19:39:44.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.047+0000 7f3907400640 1 -- 172.21.15.131:0/4123428150 <== mon.2 v2:172.21.15.171:3301/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f3900013df0 con 0x7f39100c3900 2024-04-12T19:39:44.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.049+0000 7f2d0f400640 1 -- 172.21.15.131:0/2370299414 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f2d1001f020 con 0x7f2d14043e60 2024-04-12T19:39:44.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.049+0000 7f309f800640 1 -- 172.21.15.131:0/1851030922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f309804fd50 con 0x7f30981511e0 2024-04-12T19:39:44.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.051+0000 7f3094c00640 1 -- 172.21.15.131:0/1851030922 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3090046020 con 0x7f30981511e0 2024-04-12T19:39:44.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.052+0000 7f3094c00640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f307806c8f0 0x7f307806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.054 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.053+0000 7f3094c00640 1 -- 172.21.15.131:0/1851030922 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f30900ae590 con 0x7f30981511e0 2024-04-12T19:39:44.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.053+0000 7f309ce00640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f307806c8f0 0x7f307806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.054+0000 7f309ce00640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f307806c8f0 0x7f307806edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f308c009560 tx=0x7f308c009190 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.063 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.063+0000 7f3907400640 1 -- 172.21.15.131:0/4123428150 <== mon.2 v2:172.21.15.171:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3900059470 con 0x7f39100c3900 2024-04-12T19:39:44.064 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.065+0000 7f3094c00640 1 -- 172.21.15.131:0/1851030922 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f309004d030 con 0x7f30981511e0 2024-04-12T19:39:44.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.408+0000 7fde5d200640 1 -- 172.21.15.131:0/1330516438 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fde34005580 con 0x7fde500da4a0 2024-04-12T19:39:44.408 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.409+0000 7fde4b400640 1 -- 172.21.15.131:0/1330516438 <== mon.1 v2:172.21.15.171:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fde44058c10 con 0x7fde500da4a0 2024-04-12T19:39:44.409 INFO:teuthology.orchestra.run.smithi131.stdout:55834574858 2024-04-12T19:39:44.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.412+0000 7fde5d200640 1 -- 172.21.15.131:0/1330516438 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fde3806c920 msgr2=0x7fde3806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.412+0000 7fde5d200640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fde3806c920 0x7fde3806ede0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0097a0 tx=0x7fde4c008030 comp rx=0 tx=0).stop 2024-04-12T19:39:44.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.413+0000 7fde5d200640 1 -- 172.21.15.131:0/1330516438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde500da4a0 msgr2=0x7fde5002bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.413+0000 7fde5d200640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde500da4a0 0x7fde5002bb20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fde440011e0 tx=0x7fde4400c8e0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.413+0000 7fde5d200640 1 -- 172.21.15.131:0/1330516438 shutdown_connections 2024-04-12T19:39:44.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.413+0000 7fde5d200640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fde3806c920 0x7fde3806ede0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.413+0000 7fde5d200640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fde500da4a0 0x7fde5002bb20 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.413+0000 7fde5d200640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fde500263e0 0x7fde500d34a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.413+0000 7fde5d200640 1 --2- 172.21.15.131:0/1330516438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fde50006e00 0x7fde500d2f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.413+0000 7fde5d200640 1 -- 172.21.15.131:0/1330516438 >> 172.21.15.131:0/1330516438 conn(0x7fde50005e90 msgr2=0x7fde5003ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.413+0000 7fde5d200640 1 -- 172.21.15.131:0/1330516438 shutdown_connections 2024-04-12T19:39:44.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.414+0000 7fde5d200640 1 -- 172.21.15.131:0/1330516438 wait complete. 2024-04-12T19:39:44.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.425+0000 7f400d600640 1 -- 172.21.15.131:0/1335120238 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f400804fd50 con 0x7f40080a7670 2024-04-12T19:39:44.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.426+0000 7f3ffea00640 1 -- 172.21.15.131:0/1335120238 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ff807fd20 con 0x7f40080a7670 2024-04-12T19:39:44.429 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-04-12T19:39:44.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.429+0000 7f3ff3e00640 1 -- 172.21.15.131:0/1335120238 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f3fe806c940 msgr2=0x7f3fe806ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.429+0000 7f3ff3e00640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f3fe806c940 0x7f3fe806ee00 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400f4c0 tx=0x7f3ff4011040 comp rx=0 tx=0).stop 2024-04-12T19:39:44.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.429+0000 7f3ff3e00640 1 -- 172.21.15.131:0/1335120238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080a7670 msgr2=0x7f40080c08e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.429+0000 7f3ff3e00640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080a7670 0x7f40080c08e0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8008350 tx=0x7f3ff80046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.430+0000 7f3ff3e00640 1 -- 172.21.15.131:0/1335120238 shutdown_connections 2024-04-12T19:39:44.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.430+0000 7f3ff3e00640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f3fe806c940 0x7f3fe806ee00 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.430+0000 7f3ff3e00640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f40080b8620 0x7f40081ebbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.430+0000 7f3ff3e00640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080bd9e0 0x7f40080a3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.430+0000 7f3ff3e00640 1 --2- 172.21.15.131:0/1335120238 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f40080a7670 0x7f40080c08e0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.430+0000 7f3ff3e00640 1 -- 172.21.15.131:0/1335120238 >> 172.21.15.131:0/1335120238 conn(0x7f400806b9e0 msgr2=0x7f400814ff70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.431+0000 7f3ff3e00640 1 -- 172.21.15.131:0/1335120238 shutdown_connections 2024-04-12T19:39:44.431 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.431+0000 7f3ff3e00640 1 -- 172.21.15.131:0/1335120238 wait complete. 2024-04-12T19:39:44.432 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.433+0000 7f5ff3800640 1 -- 172.21.15.131:0/4106745250 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f5fec0a5de0 con 0x7f5fec0bf720 2024-04-12T19:39:44.435 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.435+0000 7f5fe8c00640 1 -- 172.21.15.131:0/4106745250 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5fe0059530 con 0x7f5fec0bf720 2024-04-12T19:39:44.438 INFO:teuthology.orchestra.run.smithi131.stdout:55834574858 2024-04-12T19:39:44.439 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.440+0000 7f5ff3800640 1 -- 172.21.15.131:0/4106745250 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5fcc06c8f0 msgr2=0x7f5fcc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.440+0000 7f5ff3800640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5fcc06c8f0 0x7f5fcc06edb0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8036000 tx=0x7f5fd803b040 comp rx=0 tx=0).stop 2024-04-12T19:39:44.440 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.440+0000 7f5ff3800640 1 -- 172.21.15.131:0/4106745250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0bf720 msgr2=0x7f5fec150ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.440+0000 7f5ff3800640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0bf720 0x7f5fec150ab0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000c4c0 tx=0x7f5fe000c980 comp rx=0 tx=0).stop 2024-04-12T19:39:44.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.440+0000 7f5ff3800640 1 -- 172.21.15.131:0/4106745250 shutdown_connections 2024-04-12T19:39:44.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.440+0000 7f5ff3800640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5fcc06c8f0 0x7f5fcc06edb0 secure :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f5fd8036000 tx=0x7f5fd803b040 comp rx=0 tx=0).stop 2024-04-12T19:39:44.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.440+0000 7f5ff3800640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5fec159710 0x7f5fec0a6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.440+0000 7f5ff3800640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5fec0b9990 0x7f5fec14b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.440+0000 7f5ff3800640 1 --2- 172.21.15.131:0/4106745250 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5fec0bf720 0x7f5fec150ab0 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5fe000c4c0 tx=0x7f5fe000c980 comp rx=0 tx=0).stop 2024-04-12T19:39:44.441 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.440+0000 7f5ff3800640 1 -- 172.21.15.131:0/4106745250 >> 172.21.15.131:0/4106745250 conn(0x7f5fec06be00 msgr2=0x7f5fec071240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.442 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.1 2024-04-12T19:39:44.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.442+0000 7f5ff3800640 1 -- 172.21.15.131:0/4106745250 shutdown_connections 2024-04-12T19:39:44.442 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.442+0000 7f5ff3800640 1 -- 172.21.15.131:0/4106745250 wait complete. 2024-04-12T19:39:44.442 DEBUG:teuthology.parallel:result is None 2024-04-12T19:39:44.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.452+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f35bc0057e0 con 0x7f35bc049650 2024-04-12T19:39:44.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.453+0000 7f35ba000640 1 -- 172.21.15.131:0/3339689163 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f35b0058a90 con 0x7f35bc049650 2024-04-12T19:39:44.453 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-04-12T19:39:44.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.456+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f35a406c9c0 msgr2=0x7f35a406ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.456+0000 7f35c3200640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f35a406c9c0 0x7f35a406ee80 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f35bc041e70 tx=0x7f35b4009040 comp rx=0 tx=0).stop 2024-04-12T19:39:44.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.456+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35bc049650 msgr2=0x7f35bc040160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.456+0000 7f35c3200640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35bc049650 0x7f35bc040160 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f35b000e600 tx=0x7f35b000eac0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.456+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 shutdown_connections 2024-04-12T19:39:44.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.456+0000 7f35c3200640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f35a406c9c0 0x7f35a406ee80 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f35bc041e70 tx=0x7f35b4009040 comp rx=0 tx=0).stop 2024-04-12T19:39:44.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.456+0000 7f35c3200640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f35bc0cf9d0 0x7f35bc044fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.456+0000 7f35c3200640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f35bc049650 0x7f35bc040160 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.456 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.456+0000 7f35c3200640 1 --2- 172.21.15.131:0/3339689163 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f35bc049040 0x7f35bc03deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.456+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 >> 172.21.15.131:0/3339689163 conn(0x7f35bc047cc0 msgr2=0x7f35bc02c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.457+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 shutdown_connections 2024-04-12T19:39:44.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.457+0000 7f35c3200640 1 -- 172.21.15.131:0/3339689163 wait complete. 2024-04-12T19:39:44.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.6 2024-04-12T19:39:44.460 DEBUG:teuthology.parallel:result is None 2024-04-12T19:39:44.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.2 2024-04-12T19:39:44.468 DEBUG:teuthology.parallel:result is None 2024-04-12T19:39:44.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.470+0000 7f9220600640 1 -- 172.21.15.131:0/869157976 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f92180c4280 con 0x7f92180c17a0 2024-04-12T19:39:44.470 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.470+0000 7f9215600640 1 -- 172.21.15.131:0/869157976 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f920405a030 con 0x7f92180c17a0 2024-04-12T19:39:44.470 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-04-12T19:39:44.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.474+0000 7f9220600640 1 -- 172.21.15.131:0/869157976 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f91f806c8f0 msgr2=0x7f91f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.474+0000 7f9220600640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f91f806c8f0 0x7f91f806edb0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f920c036000 tx=0x7f920c03c040 comp rx=0 tx=0).stop 2024-04-12T19:39:44.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.474+0000 7f9220600640 1 -- 172.21.15.131:0/869157976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92180c17a0 msgr2=0x7f92180bc390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.474+0000 7f9220600640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92180c17a0 0x7f92180bc390 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f920400ec10 tx=0x7f920400c520 comp rx=0 tx=0).stop 2024-04-12T19:39:44.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.474+0000 7f9220600640 1 -- 172.21.15.131:0/869157976 shutdown_connections 2024-04-12T19:39:44.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.474+0000 7f9220600640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f91f806c8f0 0x7f91f806edb0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.474+0000 7f9220600640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f92181511e0 0x7f92180bb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.474+0000 7f9220600640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f92180c31f0 0x7f92180a4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.474 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.474+0000 7f9220600640 1 --2- 172.21.15.131:0/869157976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f92180c17a0 0x7f92180bc390 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.474+0000 7f9220600640 1 -- 172.21.15.131:0/869157976 >> 172.21.15.131:0/869157976 conn(0x7f92180a8490 msgr2=0x7f92180a6890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.474+0000 7f9220600640 1 -- 172.21.15.131:0/869157976 shutdown_connections 2024-04-12T19:39:44.475 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.474+0000 7f9220600640 1 -- 172.21.15.131:0/869157976 wait complete. 2024-04-12T19:39:44.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.0 2024-04-12T19:39:44.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.476+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f39101f6f40 con 0x7f39100c3900 2024-04-12T19:39:44.476 DEBUG:teuthology.parallel:result is None 2024-04-12T19:39:44.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.476+0000 7f3907400640 1 -- 172.21.15.131:0/4123428150 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f390005d770 con 0x7f39100c3900 2024-04-12T19:39:44.477 INFO:teuthology.orchestra.run.smithi131.stdout:55834574857 2024-04-12T19:39:44.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.478+0000 7f309f800640 1 -- 172.21.15.131:0/1851030922 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f30980c4280 con 0x7f30981511e0 2024-04-12T19:39:44.478 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.479+0000 7f3094c00640 1 -- 172.21.15.131:0/1851030922 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f309007c670 con 0x7f30981511e0 2024-04-12T19:39:44.479 INFO:teuthology.orchestra.run.smithi131.stdout:55834574858 2024-04-12T19:39:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.479+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f38f006c8f0 msgr2=0x7f38f006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.479+0000 7f3916800640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f38f006c8f0 0x7f38f006edb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f38fc034000 tx=0x7f38fc02f000 comp rx=0 tx=0).stop 2024-04-12T19:39:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.479+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39100c3900 msgr2=0x7f39101f4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.479+0000 7f3916800640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39100c3900 0x7f39101f4140 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f390000c500 tx=0x7f390000c9c0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.479+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 shutdown_connections 2024-04-12T19:39:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.479+0000 7f3916800640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f38f006c8f0 0x7f38f006edb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.479+0000 7f3916800640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39101511e0 0x7f39101e2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.479+0000 7f3916800640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f39100c3900 0x7f39101f4140 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.479+0000 7f3916800640 1 --2- 172.21.15.131:0/4123428150 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f39100c17a0 0x7f39101e4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.479+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 >> 172.21.15.131:0/4123428150 conn(0x7f39100a8490 msgr2=0x7f39100a7a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.480+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 shutdown_connections 2024-04-12T19:39:44.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.480+0000 7f3916800640 1 -- 172.21.15.131:0/4123428150 wait complete. 2024-04-12T19:39:44.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.482+0000 7f309f800640 1 -- 172.21.15.131:0/1851030922 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f307806c8f0 msgr2=0x7f307806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.482+0000 7f309f800640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f307806c8f0 0x7f307806edb0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f308c009560 tx=0x7f308c009190 comp rx=0 tx=0).stop 2024-04-12T19:39:44.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.482+0000 7f309f800640 1 -- 172.21.15.131:0/1851030922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30981511e0 msgr2=0x7f30980bb2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.482+0000 7f309f800640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30981511e0 0x7f30980bb2a0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3090036040 tx=0x7f3090004a40 comp rx=0 tx=0).stop 2024-04-12T19:39:44.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.482+0000 7f309f800640 1 -- 172.21.15.131:0/1851030922 shutdown_connections 2024-04-12T19:39:44.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.482+0000 7f309f800640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f307806c8f0 0x7f307806edb0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.482+0000 7f309f800640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30981511e0 0x7f30980bb2a0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.482 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.482+0000 7f309f800640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f30980c3900 0x7f309814a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.482+0000 7f309f800640 1 --2- 172.21.15.131:0/1851030922 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f30980c17a0 0x7f30980bbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.482+0000 7f309f800640 1 -- 172.21.15.131:0/1851030922 >> 172.21.15.131:0/1851030922 conn(0x7f30980a8490 msgr2=0x7f30981dd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.482+0000 7f309f800640 1 -- 172.21.15.131:0/1851030922 shutdown_connections 2024-04-12T19:39:44.483 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.482+0000 7f309f800640 1 -- 172.21.15.131:0/1851030922 wait complete. 2024-04-12T19:39:44.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.489+0000 7f2d20c00640 1 -- 172.21.15.131:0/2370299414 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f2d14042e10 con 0x7f2d14043e60 2024-04-12T19:39:44.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.490+0000 7f2d0f400640 1 -- 172.21.15.131:0/2370299414 <== mon.2 v2:172.21.15.171:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2d1005c090 con 0x7f2d14043e60 2024-04-12T19:39:44.489 INFO:teuthology.orchestra.run.smithi131.stdout:55834574858 2024-04-12T19:39:44.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.492+0000 7f2d20c00640 1 -- 172.21.15.131:0/2370299414 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2cfc06c940 msgr2=0x7f2cfc06ee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.492+0000 7f2d20c00640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2cfc06c940 0x7f2cfc06ee00 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2d08036000 tx=0x7f2d0803c040 comp rx=0 tx=0).stop 2024-04-12T19:39:44.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.492+0000 7f2d20c00640 1 -- 172.21.15.131:0/2370299414 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d14043e60 msgr2=0x7f2d14173a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.492+0000 7f2d20c00640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d14043e60 0x7f2d14173a30 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d1000b440 tx=0x7f2d1000b900 comp rx=0 tx=0).stop 2024-04-12T19:39:44.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.492+0000 7f2d20c00640 1 -- 172.21.15.131:0/2370299414 shutdown_connections 2024-04-12T19:39:44.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.492+0000 7f2d20c00640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f2cfc06c940 0x7f2cfc06ee00 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.492+0000 7f2d20c00640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f2d140cdbd0 0x7f2d140d3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.492+0000 7f2d20c00640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2d140d4d70 0x7f2d14029da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.492+0000 7f2d20c00640 1 --2- 172.21.15.131:0/2370299414 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f2d14043e60 0x7f2d14173a30 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.492+0000 7f2d20c00640 1 -- 172.21.15.131:0/2370299414 >> 172.21.15.131:0/2370299414 conn(0x7f2d140061a0 msgr2=0x7f2d140cce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.492+0000 7f2d20c00640 1 -- 172.21.15.131:0/2370299414 shutdown_connections 2024-04-12T19:39:44.493 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.492+0000 7f2d20c00640 1 -- 172.21.15.131:0/2370299414 wait complete. 2024-04-12T19:39:44.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.7 2024-04-12T19:39:44.497 DEBUG:teuthology.parallel:result is None 2024-04-12T19:39:44.499 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574857 got 55834574857 for osd.5 2024-04-12T19:39:44.499 DEBUG:teuthology.parallel:result is None 2024-04-12T19:39:44.502 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-04-12T19:39:44.502 DEBUG:teuthology.parallel:result is None 2024-04-12T19:39:44.510 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.3 2024-04-12T19:39:44.510 DEBUG:teuthology.parallel:result is None 2024-04-12T19:39:44.510 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-12T19:39:44.510 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-12T19:39:44.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.742+0000 7fd107200640 1 Processor -- start 2024-04-12T19:39:44.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.742+0000 7fd107200640 1 -- start start 2024-04-12T19:39:44.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.743+0000 7fd107200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd1080bdfb0 0x7fd1080a71a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.743+0000 7fd107200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd10806dee0 0x7fd108158560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.743+0000 7fd107200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd10806e690 con 0x7fd1080a76e0 2024-04-12T19:39:44.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.743+0000 7fd107200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd1080b75a0 con 0x7fd1080bdfb0 2024-04-12T19:39:44.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.743+0000 7fd107200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd1080a5c50 con 0x7fd10806dee0 2024-04-12T19:39:44.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.744+0000 7fd0ffe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd1080a76e0 0x7fd1080bcc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34292/0 (socket says 172.21.15.131:34292) 2024-04-12T19:39:44.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.744+0000 7fd0ffe00640 1 -- 172.21.15.131:0/3291730681 learned_addr learned my addr 172.21.15.131:0/3291730681 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:44.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.744+0000 7fd106800640 1 --2- 172.21.15.131:0/3291730681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd10806dee0 0x7fd108158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.744+0000 7fd105e00640 1 --2- 172.21.15.131:0/3291730681 >> v2:172.21.15.171:3300/0 conn(0x7fd1080bdfb0 0x7fd1080a71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.744+0000 7fd105400640 1 -- 172.21.15.131:0/3291730681 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1226113606 0 0) 0x7fd10806e690 con 0x7fd1080a76e0 2024-04-12T19:39:44.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.744+0000 7fd105400640 1 -- 172.21.15.131:0/3291730681 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0e8003520 con 0x7fd1080a76e0 2024-04-12T19:39:44.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.744+0000 7fd105400640 1 -- 172.21.15.131:0/3291730681 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2304076567 0 0) 0x7fd0e8003520 con 0x7fd1080a76e0 2024-04-12T19:39:44.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.744+0000 7fd106800640 1 -- 172.21.15.131:0/3291730681 >> v2:172.21.15.171:3300/0 conn(0x7fd1080bdfb0 msgr2=0x7fd1080a71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:44.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.744+0000 7fd106800640 1 --2- 172.21.15.131:0/3291730681 >> v2:172.21.15.171:3300/0 conn(0x7fd1080bdfb0 0x7fd1080a71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.744+0000 7fd106800640 1 -- 172.21.15.131:0/3291730681 >> v1:172.21.15.131:6789/0 conn(0x7fd1080a76e0 legacy=0x7fd1080bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.744+0000 7fd106800640 1 -- 172.21.15.131:0/3291730681 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10814e790 con 0x7fd10806dee0 2024-04-12T19:39:44.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.746+0000 7fd106800640 1 --2- 172.21.15.131:0/3291730681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd10806dee0 0x7fd108158560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd100009d90 tx=0x7fd10002bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=11a38104c4492e31 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.746+0000 7fd105400640 1 -- 172.21.15.131:0/3291730681 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100039070 con 0x7fd10806dee0 2024-04-12T19:39:44.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.746+0000 7fd105400640 1 -- 172.21.15.131:0/3291730681 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd10002c810 con 0x7fd10806dee0 2024-04-12T19:39:44.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.746+0000 7fd105400640 1 -- 172.21.15.131:0/3291730681 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f0001670 con 0x7fd10806dee0 2024-04-12T19:39:44.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.747+0000 7fd107200640 1 -- 172.21.15.131:0/3291730681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd10806dee0 msgr2=0x7fd108158560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.747+0000 7fd107200640 1 --2- 172.21.15.131:0/3291730681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd10806dee0 0x7fd108158560 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd100009d90 tx=0x7fd10002bce0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.747+0000 7fd107200640 1 -- 172.21.15.131:0/3291730681 shutdown_connections 2024-04-12T19:39:44.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.747+0000 7fd107200640 1 --2- 172.21.15.131:0/3291730681 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd10806dee0 0x7fd108158560 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.747+0000 7fd107200640 1 --2- 172.21.15.131:0/3291730681 >> v2:172.21.15.171:3300/0 conn(0x7fd1080bdfb0 0x7fd1080a71a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.747+0000 7fd107200640 1 -- 172.21.15.131:0/3291730681 >> 172.21.15.131:0/3291730681 conn(0x7fd1080c24d0 msgr2=0x7fd1080c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.747+0000 7fd107200640 1 -- 172.21.15.131:0/3291730681 shutdown_connections 2024-04-12T19:39:44.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.747+0000 7fd107200640 1 -- 172.21.15.131:0/3291730681 wait complete. 2024-04-12T19:39:44.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.748+0000 7fd107200640 1 Processor -- start 2024-04-12T19:39:44.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.748+0000 7fd107200640 1 -- start start 2024-04-12T19:39:44.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.749+0000 7fd107200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd10806dee0 0x7fd10814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.749+0000 7fd107200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1080a76e0 0x7fd1081e9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.749+0000 7fd107200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1080bdfb0 0x7fd1081460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.749+0000 7fd107200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd1080be390 con 0x7fd1080bdfb0 2024-04-12T19:39:44.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.749+0000 7fd107200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd1080a5450 con 0x7fd1080a76e0 2024-04-12T19:39:44.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.749+0000 7fd107200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd1080b7250 con 0x7fd10806dee0 2024-04-12T19:39:44.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.749+0000 7fd106800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1080bdfb0 0x7fd1081460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.749+0000 7fd106800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1080bdfb0 0x7fd1081460f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41470/0 (socket says 172.21.15.131:41470) 2024-04-12T19:39:44.750 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.749+0000 7fd106800640 1 -- 172.21.15.131:0/515885530 learned_addr learned my addr 172.21.15.131:0/515885530 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:44.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.750+0000 7fd105e00640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd10806dee0 0x7fd10814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.750+0000 7fd106800640 1 -- 172.21.15.131:0/515885530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd10806dee0 msgr2=0x7fd10814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.750+0000 7fd0ffe00640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1080a76e0 0x7fd1081e9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.750+0000 7fd106800640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd10806dee0 0x7fd10814eda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.750+0000 7fd106800640 1 -- 172.21.15.131:0/515885530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1080a76e0 msgr2=0x7fd1081e9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.750+0000 7fd106800640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1080a76e0 0x7fd1081e9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.750+0000 7fd106800640 1 -- 172.21.15.131:0/515885530 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd10814f2e0 con 0x7fd1080bdfb0 2024-04-12T19:39:44.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.750+0000 7fd106800640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1080bdfb0 0x7fd1081460f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd100009d90 tx=0x7fd100004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.751 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.750+0000 7fd0fe000640 1 -- 172.21.15.131:0/515885530 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100039050 con 0x7fd1080bdfb0 2024-04-12T19:39:44.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.750+0000 7fd0fe000640 1 -- 172.21.15.131:0/515885530 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd100045070 con 0x7fd1080bdfb0 2024-04-12T19:39:44.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.750+0000 7fd0fe000640 1 -- 172.21.15.131:0/515885530 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd100009450 con 0x7fd1080bdfb0 2024-04-12T19:39:44.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.750+0000 7fd107200640 1 -- 172.21.15.131:0/515885530 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1080b96d0 con 0x7fd1080bdfb0 2024-04-12T19:39:44.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.751+0000 7fd107200640 1 -- 172.21.15.131:0/515885530 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1081eaa50 con 0x7fd1080bdfb0 2024-04-12T19:39:44.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.751+0000 7fd107200640 1 -- 172.21.15.131:0/515885530 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd108075c30 con 0x7fd1080bdfb0 2024-04-12T19:39:44.752 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.752+0000 7fd0fe000640 1 -- 172.21.15.131:0/515885530 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd100040690 con 0x7fd1080bdfb0 2024-04-12T19:39:44.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.753+0000 7fd0fe000640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd0e406c8f0 0x7fd0e406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:44.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.753+0000 7fd0fe000640 1 -- 172.21.15.131:0/515885530 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fd1000ae670 con 0x7fd1080bdfb0 2024-04-12T19:39:44.753 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.753+0000 7fd105e00640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd0e406c8f0 0x7fd0e406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:44.754 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.754+0000 7fd105e00640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd0e406c8f0 0x7fd0e406edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800baf0 tx=0x7fd0f8008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:44.757 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.757+0000 7fd0fe000640 1 -- 172.21.15.131:0/515885530 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd10007c750 con 0x7fd1080bdfb0 2024-04-12T19:39:44.941 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.941+0000 7fd107200640 1 -- 172.21.15.131:0/515885530 --> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd108075540 con 0x7fd0e406c8f0 2024-04-12T19:39:44.950 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.950+0000 7fd0fe000640 1 -- 172.21.15.131:0/515885530 <== mgr.4101 v2:172.21.15.131:6832/873500205 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332614 (secure 0 0 0) 0x7fd108075540 con 0x7fd0e406c8f0 2024-04-12T19:39:44.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:44.956 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-12T19:39:44.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.955+0000 7fd107200640 1 -- 172.21.15.131:0/515885530 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd0e406c8f0 msgr2=0x7fd0e406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.955+0000 7fd107200640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd0e406c8f0 0x7fd0e406edb0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd0f800baf0 tx=0x7fd0f8008040 comp rx=0 tx=0).stop 2024-04-12T19:39:44.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.955+0000 7fd107200640 1 -- 172.21.15.131:0/515885530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1080bdfb0 msgr2=0x7fd1081460f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:44.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.955+0000 7fd107200640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1080bdfb0 0x7fd1081460f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd100009d90 tx=0x7fd100004a40 comp rx=0 tx=0).stop 2024-04-12T19:39:44.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.956+0000 7fd107200640 1 -- 172.21.15.131:0/515885530 shutdown_connections 2024-04-12T19:39:44.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.956+0000 7fd107200640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd0e406c8f0 0x7fd0e406edb0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.956+0000 7fd107200640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd1080a76e0 0x7fd1081e9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.956+0000 7fd107200640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd1080bdfb0 0x7fd1081460f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.956+0000 7fd107200640 1 --2- 172.21.15.131:0/515885530 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd10806dee0 0x7fd10814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:44.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.956+0000 7fd107200640 1 -- 172.21.15.131:0/515885530 >> 172.21.15.131:0/515885530 conn(0x7fd1080c24d0 msgr2=0x7fd1080b7930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:44.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.956+0000 7fd107200640 1 -- 172.21.15.131:0/515885530 shutdown_connections 2024-04-12T19:39:44.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:44.956+0000 7fd107200640 1 -- 172.21.15.131:0/515885530 wait complete. 2024-04-12T19:39:44.975 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-12T19:39:44.831237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218532,"kb_used_data":2368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756188,"statfs":{"total":773094113280,"available":772870336512,"internally_reserved":0,"allocated":2424832,"data_stored":2086528,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004909"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585758+0000","last_change":"2024-04-12T19:39:10.436376+0000","last_active":"2024-04-12T19:39:18.585758+0000","last_peered":"2024-04-12T19:39:18.585758+0000","last_clean":"2024-04-12T19:39:18.585758+0000","last_became_active":"2024-04-12T19:39:10.436052+0000","last_became_peered":"2024-04-12T19:39:10.436052+0000","last_unstale":"2024-04-12T19:39:18.585758+0000","last_undegraded":"2024-04-12T19:39:18.585758+0000","last_fullsized":"2024-04-12T19:39:18.585758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:25:54.417979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489106+0000","last_change":"2024-04-12T19:39:11.476500+0000","last_active":"2024-04-12T19:39:17.489106+0000","last_peered":"2024-04-12T19:39:17.489106+0000","last_clean":"2024-04-12T19:39:17.489106+0000","last_became_active":"2024-04-12T19:39:11.476227+0000","last_became_peered":"2024-04-12T19:39:11.476227+0000","last_unstale":"2024-04-12T19:39:17.489106+0000","last_undegraded":"2024-04-12T19:39:17.489106+0000","last_fullsized":"2024-04-12T19:39:17.489106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:10:23.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488071+0000","last_change":"2024-04-12T19:39:16.130127+0000","last_active":"2024-04-12T19:39:17.488071+0000","last_peered":"2024-04-12T19:39:17.488071+0000","last_clean":"2024-04-12T19:39:17.488071+0000","last_became_active":"2024-04-12T19:39:16.128965+0000","last_became_peered":"2024-04-12T19:39:16.128965+0000","last_unstale":"2024-04-12T19:39:17.488071+0000","last_undegraded":"2024-04-12T19:39:17.488071+0000","last_fullsized":"2024-04-12T19:39:17.488071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:05:40.753433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489202+0000","last_change":"2024-04-12T19:39:10.434713+0000","last_active":"2024-04-12T19:39:17.489202+0000","last_peered":"2024-04-12T19:39:17.489202+0000","last_clean":"2024-04-12T19:39:17.489202+0000","last_became_active":"2024-04-12T19:39:10.434206+0000","last_became_peered":"2024-04-12T19:39:10.434206+0000","last_unstale":"2024-04-12T19:39:17.489202+0000","last_undegraded":"2024-04-12T19:39:17.489202+0000","last_fullsized":"2024-04-12T19:39:17.489202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:35:32.075423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585573+0000","last_change":"2024-04-12T19:39:11.468967+0000","last_active":"2024-04-12T19:39:18.585573+0000","last_peered":"2024-04-12T19:39:18.585573+0000","last_clean":"2024-04-12T19:39:18.585573+0000","last_became_active":"2024-04-12T19:39:11.468506+0000","last_became_peered":"2024-04-12T19:39:11.468506+0000","last_unstale":"2024-04-12T19:39:18.585573+0000","last_undegraded":"2024-04-12T19:39:18.585573+0000","last_fullsized":"2024-04-12T19:39:18.585573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:34:33.700728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490493+0000","last_change":"2024-04-12T19:39:15.514844+0000","last_active":"2024-04-12T19:39:17.490493+0000","last_peered":"2024-04-12T19:39:17.490493+0000","last_clean":"2024-04-12T19:39:17.490493+0000","last_became_active":"2024-04-12T19:39:15.514389+0000","last_became_peered":"2024-04-12T19:39:15.514389+0000","last_unstale":"2024-04-12T19:39:17.490493+0000","last_undegraded":"2024-04-12T19:39:17.490493+0000","last_fullsized":"2024-04-12T19:39:17.490493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:13.334480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493030+0000","last_change":"2024-04-12T19:39:10.449208+0000","last_active":"2024-04-12T19:39:18.493030+0000","last_peered":"2024-04-12T19:39:18.493030+0000","last_clean":"2024-04-12T19:39:18.493030+0000","last_became_active":"2024-04-12T19:39:10.447087+0000","last_became_peered":"2024-04-12T19:39:10.447087+0000","last_unstale":"2024-04-12T19:39:18.493030+0000","last_undegraded":"2024-04-12T19:39:18.493030+0000","last_fullsized":"2024-04-12T19:39:18.493030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:15.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493393+0000","last_change":"2024-04-12T19:39:11.453798+0000","last_active":"2024-04-12T19:39:17.493393+0000","last_peered":"2024-04-12T19:39:17.493393+0000","last_clean":"2024-04-12T19:39:17.493393+0000","last_became_active":"2024-04-12T19:39:11.451146+0000","last_became_peered":"2024-04-12T19:39:11.451146+0000","last_unstale":"2024-04-12T19:39:17.493393+0000","last_undegraded":"2024-04-12T19:39:17.493393+0000","last_fullsized":"2024-04-12T19:39:17.493393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:21:53.745025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491302+0000","last_change":"2024-04-12T19:39:15.516232+0000","last_active":"2024-04-12T19:39:17.491302+0000","last_peered":"2024-04-12T19:39:17.491302+0000","last_clean":"2024-04-12T19:39:17.491302+0000","last_became_active":"2024-04-12T19:39:15.515675+0000","last_became_peered":"2024-04-12T19:39:15.515675+0000","last_unstale":"2024-04-12T19:39:17.491302+0000","last_undegraded":"2024-04-12T19:39:17.491302+0000","last_fullsized":"2024-04-12T19:39:17.491302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:39:36.033443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.492973+0000","last_change":"2024-04-12T19:39:10.448666+0000","last_active":"2024-04-12T19:39:18.492973+0000","last_peered":"2024-04-12T19:39:18.492973+0000","last_clean":"2024-04-12T19:39:18.492973+0000","last_became_active":"2024-04-12T19:39:10.447506+0000","last_became_peered":"2024-04-12T19:39:10.447506+0000","last_unstale":"2024-04-12T19:39:18.492973+0000","last_undegraded":"2024-04-12T19:39:18.492973+0000","last_fullsized":"2024-04-12T19:39:18.492973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493463+0000","last_change":"2024-04-12T19:39:11.444311+0000","last_active":"2024-04-12T19:39:17.493463+0000","last_peered":"2024-04-12T19:39:17.493463+0000","last_clean":"2024-04-12T19:39:17.493463+0000","last_became_active":"2024-04-12T19:39:11.443691+0000","last_became_peered":"2024-04-12T19:39:11.443691+0000","last_unstale":"2024-04-12T19:39:17.493463+0000","last_undegraded":"2024-04-12T19:39:17.493463+0000","last_fullsized":"2024-04-12T19:39:17.493463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:37.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491425+0000","last_change":"2024-04-12T19:39:15.512394+0000","last_active":"2024-04-12T19:39:17.491425+0000","last_peered":"2024-04-12T19:39:17.491425+0000","last_clean":"2024-04-12T19:39:17.491425+0000","last_became_active":"2024-04-12T19:39:15.511995+0000","last_became_peered":"2024-04-12T19:39:15.511995+0000","last_unstale":"2024-04-12T19:39:17.491425+0000","last_undegraded":"2024-04-12T19:39:17.491425+0000","last_fullsized":"2024-04-12T19:39:17.491425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:25:21.809067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.173497+0000","last_change":"2024-04-12T19:39:11.466978+0000","last_active":"2024-04-12T19:39:18.173497+0000","last_peered":"2024-04-12T19:39:18.173497+0000","last_clean":"2024-04-12T19:39:18.173497+0000","last_became_active":"2024-04-12T19:39:11.462526+0000","last_became_peered":"2024-04-12T19:39:11.462526+0000","last_unstale":"2024-04-12T19:39:18.173497+0000","last_undegraded":"2024-04-12T19:39:18.173497+0000","last_fullsized":"2024-04-12T19:39:18.173497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493020+0000","last_change":"2024-04-12T19:39:10.449545+0000","last_active":"2024-04-12T19:39:18.493020+0000","last_peered":"2024-04-12T19:39:18.493020+0000","last_clean":"2024-04-12T19:39:18.493020+0000","last_became_active":"2024-04-12T19:39:10.449218+0000","last_became_peered":"2024-04-12T19:39:10.449218+0000","last_unstale":"2024-04-12T19:39:18.493020+0000","last_undegraded":"2024-04-12T19:39:18.493020+0000","last_fullsized":"2024-04-12T19:39:18.493020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:51.431359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492072+0000","last_change":"2024-04-12T19:39:15.520316+0000","last_active":"2024-04-12T19:39:17.492072+0000","last_peered":"2024-04-12T19:39:17.492072+0000","last_clean":"2024-04-12T19:39:17.492072+0000","last_became_active":"2024-04-12T19:39:15.519733+0000","last_became_peered":"2024-04-12T19:39:15.519733+0000","last_unstale":"2024-04-12T19:39:17.492072+0000","last_undegraded":"2024-04-12T19:39:17.492072+0000","last_fullsized":"2024-04-12T19:39:17.492072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:45:30.872970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488363+0000","last_change":"2024-04-12T19:39:11.468457+0000","last_active":"2024-04-12T19:39:17.488363+0000","last_peered":"2024-04-12T19:39:17.488363+0000","last_clean":"2024-04-12T19:39:17.488363+0000","last_became_active":"2024-04-12T19:39:11.467315+0000","last_became_peered":"2024-04-12T19:39:11.467315+0000","last_unstale":"2024-04-12T19:39:17.488363+0000","last_undegraded":"2024-04-12T19:39:17.488363+0000","last_fullsized":"2024-04-12T19:39:17.488363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103926+0000","last_change":"2024-04-12T19:39:10.440820+0000","last_active":"2024-04-12T19:39:18.103926+0000","last_peered":"2024-04-12T19:39:18.103926+0000","last_clean":"2024-04-12T19:39:18.103926+0000","last_became_active":"2024-04-12T19:39:10.440389+0000","last_became_peered":"2024-04-12T19:39:10.440389+0000","last_unstale":"2024-04-12T19:39:18.103926+0000","last_undegraded":"2024-04-12T19:39:18.103926+0000","last_fullsized":"2024-04-12T19:39:18.103926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490713+0000","last_change":"2024-04-12T19:39:15.512849+0000","last_active":"2024-04-12T19:39:17.490713+0000","last_peered":"2024-04-12T19:39:17.490713+0000","last_clean":"2024-04-12T19:39:17.490713+0000","last_became_active":"2024-04-12T19:39:15.512484+0000","last_became_peered":"2024-04-12T19:39:15.512484+0000","last_unstale":"2024-04-12T19:39:17.490713+0000","last_undegraded":"2024-04-12T19:39:17.490713+0000","last_fullsized":"2024-04-12T19:39:17.490713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:41.709345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487788+0000","last_change":"2024-04-12T19:39:11.467478+0000","last_active":"2024-04-12T19:39:17.487788+0000","last_peered":"2024-04-12T19:39:17.487788+0000","last_clean":"2024-04-12T19:39:17.487788+0000","last_became_active":"2024-04-12T19:39:11.467119+0000","last_became_peered":"2024-04-12T19:39:11.467119+0000","last_unstale":"2024-04-12T19:39:17.487788+0000","last_undegraded":"2024-04-12T19:39:17.487788+0000","last_fullsized":"2024-04-12T19:39:17.487788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103760+0000","last_change":"2024-04-12T19:39:10.445133+0000","last_active":"2024-04-12T19:39:18.103760+0000","last_peered":"2024-04-12T19:39:18.103760+0000","last_clean":"2024-04-12T19:39:18.103760+0000","last_became_active":"2024-04-12T19:39:10.444813+0000","last_became_peered":"2024-04-12T19:39:10.444813+0000","last_unstale":"2024-04-12T19:39:18.103760+0000","last_undegraded":"2024-04-12T19:39:18.103760+0000","last_fullsized":"2024-04-12T19:39:18.103760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:28:58.315840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104936+0000","last_change":"2024-04-12T19:39:16.128749+0000","last_active":"2024-04-12T19:39:18.104936+0000","last_peered":"2024-04-12T19:39:18.104936+0000","last_clean":"2024-04-12T19:39:18.104936+0000","last_became_active":"2024-04-12T19:39:16.127560+0000","last_became_peered":"2024-04-12T19:39:16.127560+0000","last_unstale":"2024-04-12T19:39:18.104936+0000","last_undegraded":"2024-04-12T19:39:18.104936+0000","last_fullsized":"2024-04-12T19:39:18.104936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:27:00.174133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491573+0000","last_change":"2024-04-12T19:39:11.460532+0000","last_active":"2024-04-12T19:39:17.491573+0000","last_peered":"2024-04-12T19:39:17.491573+0000","last_clean":"2024-04-12T19:39:17.491573+0000","last_became_active":"2024-04-12T19:39:11.460027+0000","last_became_peered":"2024-04-12T19:39:11.460027+0000","last_unstale":"2024-04-12T19:39:17.491573+0000","last_undegraded":"2024-04-12T19:39:17.491573+0000","last_fullsized":"2024-04-12T19:39:17.491573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:16.676989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493544+0000","last_change":"2024-04-12T19:39:10.447746+0000","last_active":"2024-04-12T19:39:18.493544+0000","last_peered":"2024-04-12T19:39:18.493544+0000","last_clean":"2024-04-12T19:39:18.493544+0000","last_became_active":"2024-04-12T19:39:10.446264+0000","last_became_peered":"2024-04-12T19:39:10.446264+0000","last_unstale":"2024-04-12T19:39:18.493544+0000","last_undegraded":"2024-04-12T19:39:18.493544+0000","last_fullsized":"2024-04-12T19:39:18.493544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492578+0000","last_change":"2024-04-12T19:39:15.514854+0000","last_active":"2024-04-12T19:39:17.492578+0000","last_peered":"2024-04-12T19:39:17.492578+0000","last_clean":"2024-04-12T19:39:17.492578+0000","last_became_active":"2024-04-12T19:39:15.514469+0000","last_became_peered":"2024-04-12T19:39:15.514469+0000","last_unstale":"2024-04-12T19:39:17.492578+0000","last_undegraded":"2024-04-12T19:39:17.492578+0000","last_fullsized":"2024-04-12T19:39:17.492578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:02:18.119234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.586125+0000","last_change":"2024-04-12T19:39:11.455415+0000","last_active":"2024-04-12T19:39:18.586125+0000","last_peered":"2024-04-12T19:39:18.586125+0000","last_clean":"2024-04-12T19:39:18.586125+0000","last_became_active":"2024-04-12T19:39:11.455042+0000","last_became_peered":"2024-04-12T19:39:11.455042+0000","last_unstale":"2024-04-12T19:39:18.586125+0000","last_undegraded":"2024-04-12T19:39:18.586125+0000","last_fullsized":"2024-04-12T19:39:18.586125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175136+0000","last_change":"2024-04-12T19:39:10.447580+0000","last_active":"2024-04-12T19:39:18.175136+0000","last_peered":"2024-04-12T19:39:18.175136+0000","last_clean":"2024-04-12T19:39:18.175136+0000","last_became_active":"2024-04-12T19:39:10.447234+0000","last_became_peered":"2024-04-12T19:39:10.447234+0000","last_unstale":"2024-04-12T19:39:18.175136+0000","last_undegraded":"2024-04-12T19:39:18.175136+0000","last_fullsized":"2024-04-12T19:39:18.175136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490950+0000","last_change":"2024-04-12T19:39:16.129529+0000","last_active":"2024-04-12T19:39:17.490950+0000","last_peered":"2024-04-12T19:39:17.490950+0000","last_clean":"2024-04-12T19:39:17.490950+0000","last_became_active":"2024-04-12T19:39:16.128296+0000","last_became_peered":"2024-04-12T19:39:16.128296+0000","last_unstale":"2024-04-12T19:39:17.490950+0000","last_undegraded":"2024-04-12T19:39:17.490950+0000","last_fullsized":"2024-04-12T19:39:17.490950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:30.579330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489090+0000","last_change":"2024-04-12T19:39:11.474331+0000","last_active":"2024-04-12T19:39:17.489090+0000","last_peered":"2024-04-12T19:39:17.489090+0000","last_clean":"2024-04-12T19:39:17.489090+0000","last_became_active":"2024-04-12T19:39:11.474034+0000","last_became_peered":"2024-04-12T19:39:11.474034+0000","last_unstale":"2024-04-12T19:39:17.489090+0000","last_undegraded":"2024-04-12T19:39:17.489090+0000","last_fullsized":"2024-04-12T19:39:17.489090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104698+0000","last_change":"2024-04-12T19:39:10.441909+0000","last_active":"2024-04-12T19:39:18.104698+0000","last_peered":"2024-04-12T19:39:18.104698+0000","last_clean":"2024-04-12T19:39:18.104698+0000","last_became_active":"2024-04-12T19:39:10.441461+0000","last_became_peered":"2024-04-12T19:39:10.441461+0000","last_unstale":"2024-04-12T19:39:18.104698+0000","last_undegraded":"2024-04-12T19:39:18.104698+0000","last_fullsized":"2024-04-12T19:39:18.104698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487914+0000","last_change":"2024-04-12T19:39:16.121582+0000","last_active":"2024-04-12T19:39:17.487914+0000","last_peered":"2024-04-12T19:39:17.487914+0000","last_clean":"2024-04-12T19:39:17.487914+0000","last_became_active":"2024-04-12T19:39:16.120301+0000","last_became_peered":"2024-04-12T19:39:16.120301+0000","last_unstale":"2024-04-12T19:39:17.487914+0000","last_undegraded":"2024-04-12T19:39:17.487914+0000","last_fullsized":"2024-04-12T19:39:17.487914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:08:52.349202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104233+0000","last_change":"2024-04-12T19:39:11.454547+0000","last_active":"2024-04-12T19:39:18.104233+0000","last_peered":"2024-04-12T19:39:18.104233+0000","last_clean":"2024-04-12T19:39:18.104233+0000","last_became_active":"2024-04-12T19:39:11.454183+0000","last_became_peered":"2024-04-12T19:39:11.454183+0000","last_unstale":"2024-04-12T19:39:18.104233+0000","last_undegraded":"2024-04-12T19:39:18.104233+0000","last_fullsized":"2024-04-12T19:39:18.104233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495290+0000","last_change":"2024-04-12T19:39:10.450615+0000","last_active":"2024-04-12T19:39:18.495290+0000","last_peered":"2024-04-12T19:39:18.495290+0000","last_clean":"2024-04-12T19:39:18.495290+0000","last_became_active":"2024-04-12T19:39:10.450161+0000","last_became_peered":"2024-04-12T19:39:10.450161+0000","last_unstale":"2024-04-12T19:39:18.495290+0000","last_undegraded":"2024-04-12T19:39:18.495290+0000","last_fullsized":"2024-04-12T19:39:18.495290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:28:58.315840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585091+0000","last_change":"2024-04-12T19:39:16.130720+0000","last_active":"2024-04-12T19:39:18.585091+0000","last_peered":"2024-04-12T19:39:18.585091+0000","last_clean":"2024-04-12T19:39:18.585091+0000","last_became_active":"2024-04-12T19:39:16.127733+0000","last_became_peered":"2024-04-12T19:39:16.127733+0000","last_unstale":"2024-04-12T19:39:18.585091+0000","last_undegraded":"2024-04-12T19:39:18.585091+0000","last_fullsized":"2024-04-12T19:39:18.585091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:25:21.809067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493689+0000","last_change":"2024-04-12T19:39:11.478915+0000","last_active":"2024-04-12T19:39:17.493689+0000","last_peered":"2024-04-12T19:39:17.493689+0000","last_clean":"2024-04-12T19:39:17.493689+0000","last_became_active":"2024-04-12T19:39:11.478570+0000","last_became_peered":"2024-04-12T19:39:11.478570+0000","last_unstale":"2024-04-12T19:39:17.493689+0000","last_undegraded":"2024-04-12T19:39:17.493689+0000","last_fullsized":"2024-04-12T19:39:17.493689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:26.512414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104346+0000","last_change":"2024-04-12T19:39:10.430117+0000","last_active":"2024-04-12T19:39:18.104346+0000","last_peered":"2024-04-12T19:39:18.104346+0000","last_clean":"2024-04-12T19:39:18.104346+0000","last_became_active":"2024-04-12T19:39:10.429533+0000","last_became_peered":"2024-04-12T19:39:10.429533+0000","last_unstale":"2024-04-12T19:39:18.104346+0000","last_undegraded":"2024-04-12T19:39:18.104346+0000","last_fullsized":"2024-04-12T19:39:18.104346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103455+0000","last_change":"2024-04-12T19:39:15.516618+0000","last_active":"2024-04-12T19:39:18.103455+0000","last_peered":"2024-04-12T19:39:18.103455+0000","last_clean":"2024-04-12T19:39:18.103455+0000","last_became_active":"2024-04-12T19:39:15.516233+0000","last_became_peered":"2024-04-12T19:39:15.516233+0000","last_unstale":"2024-04-12T19:39:18.103455+0000","last_undegraded":"2024-04-12T19:39:18.103455+0000","last_fullsized":"2024-04-12T19:39:18.103455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:45:30.872970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491846+0000","last_change":"2024-04-12T19:39:11.459045+0000","last_active":"2024-04-12T19:39:17.491846+0000","last_peered":"2024-04-12T19:39:17.491846+0000","last_clean":"2024-04-12T19:39:17.491846+0000","last_became_active":"2024-04-12T19:39:11.458714+0000","last_became_peered":"2024-04-12T19:39:11.458714+0000","last_unstale":"2024-04-12T19:39:17.491846+0000","last_undegraded":"2024-04-12T19:39:17.491846+0000","last_fullsized":"2024-04-12T19:39:17.491846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:33.845598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491628+0000","last_change":"2024-04-12T19:39:10.437425+0000","last_active":"2024-04-12T19:39:17.491628+0000","last_peered":"2024-04-12T19:39:17.491628+0000","last_clean":"2024-04-12T19:39:17.491628+0000","last_became_active":"2024-04-12T19:39:10.437004+0000","last_became_peered":"2024-04-12T19:39:10.437004+0000","last_unstale":"2024-04-12T19:39:17.491628+0000","last_undegraded":"2024-04-12T19:39:17.491628+0000","last_fullsized":"2024-04-12T19:39:17.491628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104281+0000","last_change":"2024-04-12T19:39:15.523251+0000","last_active":"2024-04-12T19:39:18.104281+0000","last_peered":"2024-04-12T19:39:18.104281+0000","last_clean":"2024-04-12T19:39:18.104281+0000","last_became_active":"2024-04-12T19:39:15.519488+0000","last_became_peered":"2024-04-12T19:39:15.519488+0000","last_unstale":"2024-04-12T19:39:18.104281+0000","last_undegraded":"2024-04-12T19:39:18.104281+0000","last_fullsized":"2024-04-12T19:39:18.104281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:12:45.261630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103426+0000","last_change":"2024-04-12T19:39:11.452969+0000","last_active":"2024-04-12T19:39:18.103426+0000","last_peered":"2024-04-12T19:39:18.103426+0000","last_clean":"2024-04-12T19:39:18.103426+0000","last_became_active":"2024-04-12T19:39:11.452699+0000","last_became_peered":"2024-04-12T19:39:11.452699+0000","last_unstale":"2024-04-12T19:39:18.103426+0000","last_undegraded":"2024-04-12T19:39:18.103426+0000","last_fullsized":"2024-04-12T19:39:18.103426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962166+0000","last_change":"2024-04-12T19:39:10.435670+0000","last_active":"2024-04-12T19:39:18.962166+0000","last_peered":"2024-04-12T19:39:18.962166+0000","last_clean":"2024-04-12T19:39:18.962166+0000","last_became_active":"2024-04-12T19:39:10.435317+0000","last_became_peered":"2024-04-12T19:39:10.435317+0000","last_unstale":"2024-04-12T19:39:18.962166+0000","last_undegraded":"2024-04-12T19:39:18.962166+0000","last_fullsized":"2024-04-12T19:39:18.962166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104855+0000","last_change":"2024-04-12T19:39:15.517258+0000","last_active":"2024-04-12T19:39:18.104855+0000","last_peered":"2024-04-12T19:39:18.104855+0000","last_clean":"2024-04-12T19:39:18.104855+0000","last_became_active":"2024-04-12T19:39:15.516843+0000","last_became_peered":"2024-04-12T19:39:15.516843+0000","last_unstale":"2024-04-12T19:39:18.104855+0000","last_undegraded":"2024-04-12T19:39:18.104855+0000","last_fullsized":"2024-04-12T19:39:18.104855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:56:53.325064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.584621+0000","last_change":"2024-04-12T19:39:11.458719+0000","last_active":"2024-04-12T19:39:18.584621+0000","last_peered":"2024-04-12T19:39:18.584621+0000","last_clean":"2024-04-12T19:39:18.584621+0000","last_became_active":"2024-04-12T19:39:11.457787+0000","last_became_peered":"2024-04-12T19:39:11.457787+0000","last_unstale":"2024-04-12T19:39:18.584621+0000","last_undegraded":"2024-04-12T19:39:18.584621+0000","last_fullsized":"2024-04-12T19:39:18.584621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.492948+0000","last_change":"2024-04-12T19:39:10.450200+0000","last_active":"2024-04-12T19:39:18.492948+0000","last_peered":"2024-04-12T19:39:18.492948+0000","last_clean":"2024-04-12T19:39:18.492948+0000","last_became_active":"2024-04-12T19:39:10.449871+0000","last_became_peered":"2024-04-12T19:39:10.449871+0000","last_unstale":"2024-04-12T19:39:18.492948+0000","last_undegraded":"2024-04-12T19:39:18.492948+0000","last_fullsized":"2024-04-12T19:39:18.492948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.586171+0000","last_change":"2024-04-12T19:39:16.134794+0000","last_active":"2024-04-12T19:39:18.586171+0000","last_peered":"2024-04-12T19:39:18.586171+0000","last_clean":"2024-04-12T19:39:18.586171+0000","last_became_active":"2024-04-12T19:39:16.131743+0000","last_became_peered":"2024-04-12T19:39:16.131743+0000","last_unstale":"2024-04-12T19:39:18.586171+0000","last_undegraded":"2024-04-12T19:39:18.586171+0000","last_fullsized":"2024-04-12T19:39:18.586171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:56:53.325064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488155+0000","last_change":"2024-04-12T19:39:11.474413+0000","last_active":"2024-04-12T19:39:17.488155+0000","last_peered":"2024-04-12T19:39:17.488155+0000","last_clean":"2024-04-12T19:39:17.488155+0000","last_became_active":"2024-04-12T19:39:11.473738+0000","last_became_peered":"2024-04-12T19:39:11.473738+0000","last_unstale":"2024-04-12T19:39:17.488155+0000","last_undegraded":"2024-04-12T19:39:17.488155+0000","last_fullsized":"2024-04-12T19:39:17.488155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:13:56.992995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492770+0000","last_change":"2024-04-12T19:39:10.426342+0000","last_active":"2024-04-12T19:39:17.492770+0000","last_peered":"2024-04-12T19:39:17.492770+0000","last_clean":"2024-04-12T19:39:17.492770+0000","last_became_active":"2024-04-12T19:39:10.426074+0000","last_became_peered":"2024-04-12T19:39:10.426074+0000","last_unstale":"2024-04-12T19:39:17.492770+0000","last_undegraded":"2024-04-12T19:39:17.492770+0000","last_fullsized":"2024-04-12T19:39:17.492770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:19:09.670101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493775+0000","last_change":"2024-04-12T19:39:06.612396+0000","last_active":"2024-04-12T19:39:18.493775+0000","last_peered":"2024-04-12T19:39:18.493775+0000","last_clean":"2024-04-12T19:39:18.493775+0000","last_became_active":"2024-04-12T19:39:06.610032+0000","last_became_peered":"2024-04-12T19:39:06.610032+0000","last_unstale":"2024-04-12T19:39:18.493775+0000","last_undegraded":"2024-04-12T19:39:18.493775+0000","last_fullsized":"2024-04-12T19:39:18.493775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:05.335186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:05.335186+0000","last_clean_scrub_stamp":"2024-04-12T19:39:05.335186+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:31:00.943120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174520+0000","last_change":"2024-04-12T19:39:16.129683+0000","last_active":"2024-04-12T19:39:18.174520+0000","last_peered":"2024-04-12T19:39:18.174520+0000","last_clean":"2024-04-12T19:39:18.174520+0000","last_became_active":"2024-04-12T19:39:16.128384+0000","last_became_peered":"2024-04-12T19:39:16.128384+0000","last_unstale":"2024-04-12T19:39:18.174520+0000","last_undegraded":"2024-04-12T19:39:18.174520+0000","last_fullsized":"2024-04-12T19:39:18.174520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:13.334480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494857+0000","last_change":"2024-04-12T19:39:11.464853+0000","last_active":"2024-04-12T19:39:18.494857+0000","last_peered":"2024-04-12T19:39:18.494857+0000","last_clean":"2024-04-12T19:39:18.494857+0000","last_became_active":"2024-04-12T19:39:11.464583+0000","last_became_peered":"2024-04-12T19:39:11.464583+0000","last_unstale":"2024-04-12T19:39:18.494857+0000","last_undegraded":"2024-04-12T19:39:18.494857+0000","last_fullsized":"2024-04-12T19:39:18.494857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:10:23.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962230+0000","last_change":"2024-04-12T19:39:10.437434+0000","last_active":"2024-04-12T19:39:18.962230+0000","last_peered":"2024-04-12T19:39:18.962230+0000","last_clean":"2024-04-12T19:39:18.962230+0000","last_became_active":"2024-04-12T19:39:10.437000+0000","last_became_peered":"2024-04-12T19:39:10.437000+0000","last_unstale":"2024-04-12T19:39:18.962230+0000","last_undegraded":"2024-04-12T19:39:18.962230+0000","last_fullsized":"2024-04-12T19:39:18.962230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:19:09.670101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175055+0000","last_change":"2024-04-12T19:39:16.122002+0000","last_active":"2024-04-12T19:39:18.175055+0000","last_peered":"2024-04-12T19:39:18.175055+0000","last_clean":"2024-04-12T19:39:18.175055+0000","last_became_active":"2024-04-12T19:39:16.120822+0000","last_became_peered":"2024-04-12T19:39:16.120822+0000","last_unstale":"2024-04-12T19:39:18.175055+0000","last_undegraded":"2024-04-12T19:39:18.175055+0000","last_fullsized":"2024-04-12T19:39:18.175055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:30.579330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.495013+0000","last_change":"2024-04-12T19:39:11.480018+0000","last_active":"2024-04-12T19:39:17.495013+0000","last_peered":"2024-04-12T19:39:17.495013+0000","last_clean":"2024-04-12T19:39:17.495013+0000","last_became_active":"2024-04-12T19:39:11.479672+0000","last_became_peered":"2024-04-12T19:39:11.479672+0000","last_unstale":"2024-04-12T19:39:17.495013+0000","last_undegraded":"2024-04-12T19:39:17.495013+0000","last_fullsized":"2024-04-12T19:39:17.495013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:09.267564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104503+0000","last_change":"2024-04-12T19:39:10.439233+0000","last_active":"2024-04-12T19:39:18.104503+0000","last_peered":"2024-04-12T19:39:18.104503+0000","last_clean":"2024-04-12T19:39:18.104503+0000","last_became_active":"2024-04-12T19:39:10.438816+0000","last_became_peered":"2024-04-12T19:39:10.438816+0000","last_unstale":"2024-04-12T19:39:18.104503+0000","last_undegraded":"2024-04-12T19:39:18.104503+0000","last_fullsized":"2024-04-12T19:39:18.104503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:15.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585297+0000","last_change":"2024-04-12T19:39:15.520784+0000","last_active":"2024-04-12T19:39:18.585297+0000","last_peered":"2024-04-12T19:39:18.585297+0000","last_clean":"2024-04-12T19:39:18.585297+0000","last_became_active":"2024-04-12T19:39:15.520270+0000","last_became_peered":"2024-04-12T19:39:15.520270+0000","last_unstale":"2024-04-12T19:39:18.585297+0000","last_undegraded":"2024-04-12T19:39:18.585297+0000","last_fullsized":"2024-04-12T19:39:18.585297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:45:30.872970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495368+0000","last_change":"2024-04-12T19:39:11.472989+0000","last_active":"2024-04-12T19:39:18.495368+0000","last_peered":"2024-04-12T19:39:18.495368+0000","last_clean":"2024-04-12T19:39:18.495368+0000","last_became_active":"2024-04-12T19:39:11.472677+0000","last_became_peered":"2024-04-12T19:39:11.472677+0000","last_unstale":"2024-04-12T19:39:18.495368+0000","last_undegraded":"2024-04-12T19:39:18.495368+0000","last_fullsized":"2024-04-12T19:39:18.495368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:37.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962266+0000","last_change":"2024-04-12T19:39:10.438486+0000","last_active":"2024-04-12T19:39:18.962266+0000","last_peered":"2024-04-12T19:39:18.962266+0000","last_clean":"2024-04-12T19:39:18.962266+0000","last_became_active":"2024-04-12T19:39:10.438219+0000","last_became_peered":"2024-04-12T19:39:10.438219+0000","last_unstale":"2024-04-12T19:39:18.962266+0000","last_undegraded":"2024-04-12T19:39:18.962266+0000","last_fullsized":"2024-04-12T19:39:18.962266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:11:49.476183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489727+0000","last_change":"2024-04-12T19:39:16.137131+0000","last_active":"2024-04-12T19:39:17.489727+0000","last_peered":"2024-04-12T19:39:17.489727+0000","last_clean":"2024-04-12T19:39:17.489727+0000","last_became_active":"2024-04-12T19:39:16.136171+0000","last_became_peered":"2024-04-12T19:39:16.136171+0000","last_unstale":"2024-04-12T19:39:17.489727+0000","last_undegraded":"2024-04-12T19:39:17.489727+0000","last_fullsized":"2024-04-12T19:39:17.489727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:56:53.325064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495120+0000","last_change":"2024-04-12T19:39:11.476364+0000","last_active":"2024-04-12T19:39:18.495120+0000","last_peered":"2024-04-12T19:39:18.495120+0000","last_clean":"2024-04-12T19:39:18.495120+0000","last_became_active":"2024-04-12T19:39:11.476024+0000","last_became_peered":"2024-04-12T19:39:11.476024+0000","last_unstale":"2024-04-12T19:39:18.495120+0000","last_undegraded":"2024-04-12T19:39:18.495120+0000","last_fullsized":"2024-04-12T19:39:18.495120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:45:10.487944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492470+0000","last_change":"2024-04-12T19:39:10.433299+0000","last_active":"2024-04-12T19:39:17.492470+0000","last_peered":"2024-04-12T19:39:17.492470+0000","last_clean":"2024-04-12T19:39:17.492470+0000","last_became_active":"2024-04-12T19:39:10.432858+0000","last_became_peered":"2024-04-12T19:39:10.432858+0000","last_unstale":"2024-04-12T19:39:17.492470+0000","last_undegraded":"2024-04-12T19:39:17.492470+0000","last_fullsized":"2024-04-12T19:39:17.492470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:00:24.899000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490231+0000","last_change":"2024-04-12T19:39:15.520112+0000","last_active":"2024-04-12T19:39:17.490231+0000","last_peered":"2024-04-12T19:39:17.490231+0000","last_clean":"2024-04-12T19:39:17.490231+0000","last_became_active":"2024-04-12T19:39:15.519631+0000","last_became_peered":"2024-04-12T19:39:15.519631+0000","last_unstale":"2024-04-12T19:39:17.490231+0000","last_undegraded":"2024-04-12T19:39:17.490231+0000","last_fullsized":"2024-04-12T19:39:17.490231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:45:14.554860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494051+0000","last_change":"2024-04-12T19:39:11.472849+0000","last_active":"2024-04-12T19:39:18.494051+0000","last_peered":"2024-04-12T19:39:18.494051+0000","last_clean":"2024-04-12T19:39:18.494051+0000","last_became_active":"2024-04-12T19:39:11.472506+0000","last_became_peered":"2024-04-12T19:39:11.472506+0000","last_unstale":"2024-04-12T19:39:18.494051+0000","last_undegraded":"2024-04-12T19:39:18.494051+0000","last_fullsized":"2024-04-12T19:39:18.494051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:21:53.745025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962167+0000","last_change":"2024-04-12T19:39:10.434547+0000","last_active":"2024-04-12T19:39:18.962167+0000","last_peered":"2024-04-12T19:39:18.962167+0000","last_clean":"2024-04-12T19:39:18.962167+0000","last_became_active":"2024-04-12T19:39:10.433054+0000","last_became_peered":"2024-04-12T19:39:10.433054+0000","last_unstale":"2024-04-12T19:39:18.962167+0000","last_undegraded":"2024-04-12T19:39:18.962167+0000","last_fullsized":"2024-04-12T19:39:18.962167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:35:32.075423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585816+0000","last_change":"2024-04-12T19:39:15.516082+0000","last_active":"2024-04-12T19:39:18.585816+0000","last_peered":"2024-04-12T19:39:18.585816+0000","last_clean":"2024-04-12T19:39:18.585816+0000","last_became_active":"2024-04-12T19:39:15.515321+0000","last_became_peered":"2024-04-12T19:39:15.515321+0000","last_unstale":"2024-04-12T19:39:18.585816+0000","last_undegraded":"2024-04-12T19:39:18.585816+0000","last_fullsized":"2024-04-12T19:39:18.585816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:12:45.261630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174564+0000","last_change":"2024-04-12T19:39:11.468548+0000","last_active":"2024-04-12T19:39:18.174564+0000","last_peered":"2024-04-12T19:39:18.174564+0000","last_clean":"2024-04-12T19:39:18.174564+0000","last_became_active":"2024-04-12T19:39:11.468141+0000","last_became_peered":"2024-04-12T19:39:11.468141+0000","last_unstale":"2024-04-12T19:39:18.174564+0000","last_undegraded":"2024-04-12T19:39:18.174564+0000","last_fullsized":"2024-04-12T19:39:18.174564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174038+0000","last_change":"2024-04-12T19:39:10.444137+0000","last_active":"2024-04-12T19:39:18.174038+0000","last_peered":"2024-04-12T19:39:18.174038+0000","last_clean":"2024-04-12T19:39:18.174038+0000","last_became_active":"2024-04-12T19:39:10.442731+0000","last_became_peered":"2024-04-12T19:39:10.442731+0000","last_unstale":"2024-04-12T19:39:18.174038+0000","last_undegraded":"2024-04-12T19:39:18.174038+0000","last_fullsized":"2024-04-12T19:39:18.174038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:19:09.670101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489001+0000","last_change":"2024-04-12T19:39:16.126978+0000","last_active":"2024-04-12T19:39:17.489001+0000","last_peered":"2024-04-12T19:39:17.489001+0000","last_clean":"2024-04-12T19:39:17.489001+0000","last_became_active":"2024-04-12T19:39:16.125687+0000","last_became_peered":"2024-04-12T19:39:16.125687+0000","last_unstale":"2024-04-12T19:39:17.489001+0000","last_undegraded":"2024-04-12T19:39:17.489001+0000","last_fullsized":"2024-04-12T19:39:17.489001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:07:45.787032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493681+0000","last_change":"2024-04-12T19:39:11.478082+0000","last_active":"2024-04-12T19:39:18.493681+0000","last_peered":"2024-04-12T19:39:18.493681+0000","last_clean":"2024-04-12T19:39:18.493681+0000","last_became_active":"2024-04-12T19:39:11.471563+0000","last_became_peered":"2024-04-12T19:39:11.471563+0000","last_unstale":"2024-04-12T19:39:18.493681+0000","last_undegraded":"2024-04-12T19:39:18.493681+0000","last_fullsized":"2024-04-12T19:39:18.493681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:05:52.600930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491596+0000","last_change":"2024-04-12T19:39:10.443036+0000","last_active":"2024-04-12T19:39:17.491596+0000","last_peered":"2024-04-12T19:39:17.491596+0000","last_clean":"2024-04-12T19:39:17.491596+0000","last_became_active":"2024-04-12T19:39:10.442763+0000","last_became_peered":"2024-04-12T19:39:10.442763+0000","last_unstale":"2024-04-12T19:39:17.491596+0000","last_undegraded":"2024-04-12T19:39:17.491596+0000","last_fullsized":"2024-04-12T19:39:17.491596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488661+0000","last_change":"2024-04-12T19:39:16.123073+0000","last_active":"2024-04-12T19:39:17.488661+0000","last_peered":"2024-04-12T19:39:17.488661+0000","last_clean":"2024-04-12T19:39:17.488661+0000","last_became_active":"2024-04-12T19:39:16.120993+0000","last_became_peered":"2024-04-12T19:39:16.120993+0000","last_unstale":"2024-04-12T19:39:17.488661+0000","last_undegraded":"2024-04-12T19:39:17.488661+0000","last_fullsized":"2024-04-12T19:39:17.488661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:44:14.241958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585081+0000","last_change":"2024-04-12T19:39:11.466277+0000","last_active":"2024-04-12T19:39:18.585081+0000","last_peered":"2024-04-12T19:39:18.585081+0000","last_clean":"2024-04-12T19:39:18.585081+0000","last_became_active":"2024-04-12T19:39:11.465998+0000","last_became_peered":"2024-04-12T19:39:11.465998+0000","last_unstale":"2024-04-12T19:39:18.585081+0000","last_undegraded":"2024-04-12T19:39:18.585081+0000","last_fullsized":"2024-04-12T19:39:18.585081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.583818+0000","last_change":"2024-04-12T19:39:10.430339+0000","last_active":"2024-04-12T19:39:18.583818+0000","last_peered":"2024-04-12T19:39:18.583818+0000","last_clean":"2024-04-12T19:39:18.583818+0000","last_became_active":"2024-04-12T19:39:10.430059+0000","last_became_peered":"2024-04-12T19:39:10.430059+0000","last_unstale":"2024-04-12T19:39:18.583818+0000","last_undegraded":"2024-04-12T19:39:18.583818+0000","last_fullsized":"2024-04-12T19:39:18.583818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:59:25.400930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493660+0000","last_change":"2024-04-12T19:39:16.129872+0000","last_active":"2024-04-12T19:39:17.493660+0000","last_peered":"2024-04-12T19:39:17.493660+0000","last_clean":"2024-04-12T19:39:17.493660+0000","last_became_active":"2024-04-12T19:39:16.127095+0000","last_became_peered":"2024-04-12T19:39:16.127095+0000","last_unstale":"2024-04-12T19:39:17.493660+0000","last_undegraded":"2024-04-12T19:39:17.493660+0000","last_fullsized":"2024-04-12T19:39:17.493660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:27:00.174133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494610+0000","last_change":"2024-04-12T19:39:11.479072+0000","last_active":"2024-04-12T19:39:18.494610+0000","last_peered":"2024-04-12T19:39:18.494610+0000","last_clean":"2024-04-12T19:39:18.494610+0000","last_became_active":"2024-04-12T19:39:11.478779+0000","last_became_peered":"2024-04-12T19:39:11.478779+0000","last_unstale":"2024-04-12T19:39:18.494610+0000","last_undegraded":"2024-04-12T19:39:18.494610+0000","last_fullsized":"2024-04-12T19:39:18.494610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:29.380470+0000","last_change":"2024-04-12T19:39:10.443760+0000","last_active":"2024-04-12T19:39:29.380470+0000","last_peered":"2024-04-12T19:39:29.380470+0000","last_clean":"2024-04-12T19:39:29.380470+0000","last_became_active":"2024-04-12T19:39:10.443031+0000","last_became_peered":"2024-04-12T19:39:10.443031+0000","last_unstale":"2024-04-12T19:39:29.380470+0000","last_undegraded":"2024-04-12T19:39:29.380470+0000","last_fullsized":"2024-04-12T19:39:29.380470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103735+0000","last_change":"2024-04-12T19:39:15.521287+0000","last_active":"2024-04-12T19:39:18.103735+0000","last_peered":"2024-04-12T19:39:18.103735+0000","last_clean":"2024-04-12T19:39:18.103735+0000","last_became_active":"2024-04-12T19:39:15.519545+0000","last_became_peered":"2024-04-12T19:39:15.519545+0000","last_unstale":"2024-04-12T19:39:18.103735+0000","last_undegraded":"2024-04-12T19:39:18.103735+0000","last_fullsized":"2024-04-12T19:39:18.103735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:02:18.119234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491496+0000","last_change":"2024-04-12T19:39:11.467693+0000","last_active":"2024-04-12T19:39:17.491496+0000","last_peered":"2024-04-12T19:39:17.491496+0000","last_clean":"2024-04-12T19:39:17.491496+0000","last_became_active":"2024-04-12T19:39:11.467283+0000","last_became_peered":"2024-04-12T19:39:11.467283+0000","last_unstale":"2024-04-12T19:39:17.491496+0000","last_undegraded":"2024-04-12T19:39:17.491496+0000","last_fullsized":"2024-04-12T19:39:17.491496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:52.447954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104456+0000","last_change":"2024-04-12T19:39:10.440386+0000","last_active":"2024-04-12T19:39:18.104456+0000","last_peered":"2024-04-12T19:39:18.104456+0000","last_clean":"2024-04-12T19:39:18.104456+0000","last_became_active":"2024-04-12T19:39:10.439567+0000","last_became_peered":"2024-04-12T19:39:10.439567+0000","last_unstale":"2024-04-12T19:39:18.104456+0000","last_undegraded":"2024-04-12T19:39:18.104456+0000","last_fullsized":"2024-04-12T19:39:18.104456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:51.431359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493139+0000","last_change":"2024-04-12T19:39:15.511609+0000","last_active":"2024-04-12T19:39:17.493139+0000","last_peered":"2024-04-12T19:39:17.493139+0000","last_clean":"2024-04-12T19:39:17.493139+0000","last_became_active":"2024-04-12T19:39:15.511178+0000","last_became_peered":"2024-04-12T19:39:15.511178+0000","last_unstale":"2024-04-12T19:39:17.493139+0000","last_undegraded":"2024-04-12T19:39:17.493139+0000","last_fullsized":"2024-04-12T19:39:17.493139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:12:45.261630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585669+0000","last_change":"2024-04-12T19:39:11.468760+0000","last_active":"2024-04-12T19:39:18.585669+0000","last_peered":"2024-04-12T19:39:18.585669+0000","last_clean":"2024-04-12T19:39:18.585669+0000","last_became_active":"2024-04-12T19:39:11.468126+0000","last_became_peered":"2024-04-12T19:39:11.468126+0000","last_unstale":"2024-04-12T19:39:18.585669+0000","last_undegraded":"2024-04-12T19:39:18.585669+0000","last_fullsized":"2024-04-12T19:39:18.585669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:18:45.626616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493459+0000","last_change":"2024-04-12T19:39:10.440768+0000","last_active":"2024-04-12T19:39:17.493459+0000","last_peered":"2024-04-12T19:39:17.493459+0000","last_clean":"2024-04-12T19:39:17.493459+0000","last_became_active":"2024-04-12T19:39:10.440480+0000","last_became_peered":"2024-04-12T19:39:10.440480+0000","last_unstale":"2024-04-12T19:39:17.493459+0000","last_undegraded":"2024-04-12T19:39:17.493459+0000","last_fullsized":"2024-04-12T19:39:17.493459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:51.431359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487735+0000","last_change":"2024-04-12T19:39:15.509729+0000","last_active":"2024-04-12T19:39:17.487735+0000","last_peered":"2024-04-12T19:39:17.487735+0000","last_clean":"2024-04-12T19:39:17.487735+0000","last_became_active":"2024-04-12T19:39:15.509283+0000","last_became_peered":"2024-04-12T19:39:15.509283+0000","last_unstale":"2024-04-12T19:39:17.487735+0000","last_undegraded":"2024-04-12T19:39:17.487735+0000","last_fullsized":"2024-04-12T19:39:17.487735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:26:05.519893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493270+0000","last_change":"2024-04-12T19:39:11.460136+0000","last_active":"2024-04-12T19:39:17.493270+0000","last_peered":"2024-04-12T19:39:17.493270+0000","last_clean":"2024-04-12T19:39:17.493270+0000","last_became_active":"2024-04-12T19:39:11.459732+0000","last_became_peered":"2024-04-12T19:39:11.459732+0000","last_unstale":"2024-04-12T19:39:17.493270+0000","last_undegraded":"2024-04-12T19:39:17.493270+0000","last_fullsized":"2024-04-12T19:39:17.493270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:40:00.108398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174891+0000","last_change":"2024-04-12T19:39:10.445173+0000","last_active":"2024-04-12T19:39:18.174891+0000","last_peered":"2024-04-12T19:39:18.174891+0000","last_clean":"2024-04-12T19:39:18.174891+0000","last_became_active":"2024-04-12T19:39:10.444515+0000","last_became_peered":"2024-04-12T19:39:10.444515+0000","last_unstale":"2024-04-12T19:39:18.174891+0000","last_undegraded":"2024-04-12T19:39:18.174891+0000","last_fullsized":"2024-04-12T19:39:18.174891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:11:49.476183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487760+0000","last_change":"2024-04-12T19:39:16.127728+0000","last_active":"2024-04-12T19:39:17.487760+0000","last_peered":"2024-04-12T19:39:17.487760+0000","last_clean":"2024-04-12T19:39:17.487760+0000","last_became_active":"2024-04-12T19:39:16.125486+0000","last_became_peered":"2024-04-12T19:39:16.125486+0000","last_unstale":"2024-04-12T19:39:17.487760+0000","last_undegraded":"2024-04-12T19:39:17.487760+0000","last_fullsized":"2024-04-12T19:39:17.487760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:28:14.853197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585755+0000","last_change":"2024-04-12T19:39:16.133052+0000","last_active":"2024-04-12T19:39:18.585755+0000","last_peered":"2024-04-12T19:39:18.585755+0000","last_clean":"2024-04-12T19:39:18.585755+0000","last_became_active":"2024-04-12T19:39:16.130388+0000","last_became_peered":"2024-04-12T19:39:16.130388+0000","last_unstale":"2024-04-12T19:39:18.585755+0000","last_undegraded":"2024-04-12T19:39:18.585755+0000","last_fullsized":"2024-04-12T19:39:18.585755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:02:18.119234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103422+0000","last_change":"2024-04-12T19:39:11.461191+0000","last_active":"2024-04-12T19:39:18.103422+0000","last_peered":"2024-04-12T19:39:18.103422+0000","last_clean":"2024-04-12T19:39:18.103422+0000","last_became_active":"2024-04-12T19:39:11.460841+0000","last_became_peered":"2024-04-12T19:39:11.460841+0000","last_unstale":"2024-04-12T19:39:18.103422+0000","last_undegraded":"2024-04-12T19:39:18.103422+0000","last_fullsized":"2024-04-12T19:39:18.103422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489885+0000","last_change":"2024-04-12T19:39:10.430054+0000","last_active":"2024-04-12T19:39:17.489885+0000","last_peered":"2024-04-12T19:39:17.489885+0000","last_clean":"2024-04-12T19:39:17.489885+0000","last_became_active":"2024-04-12T19:39:10.429693+0000","last_became_peered":"2024-04-12T19:39:10.429693+0000","last_unstale":"2024-04-12T19:39:17.489885+0000","last_undegraded":"2024-04-12T19:39:17.489885+0000","last_fullsized":"2024-04-12T19:39:17.489885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174774+0000","last_change":"2024-04-12T19:39:15.521261+0000","last_active":"2024-04-12T19:39:18.174774+0000","last_peered":"2024-04-12T19:39:18.174774+0000","last_clean":"2024-04-12T19:39:18.174774+0000","last_became_active":"2024-04-12T19:39:15.520618+0000","last_became_peered":"2024-04-12T19:39:15.520618+0000","last_unstale":"2024-04-12T19:39:18.174774+0000","last_undegraded":"2024-04-12T19:39:18.174774+0000","last_fullsized":"2024-04-12T19:39:18.174774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:41.709345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487629+0000","last_change":"2024-04-12T19:39:11.470231+0000","last_active":"2024-04-12T19:39:17.487629+0000","last_peered":"2024-04-12T19:39:17.487629+0000","last_clean":"2024-04-12T19:39:17.487629+0000","last_became_active":"2024-04-12T19:39:11.469814+0000","last_became_peered":"2024-04-12T19:39:11.469814+0000","last_unstale":"2024-04-12T19:39:17.487629+0000","last_undegraded":"2024-04-12T19:39:17.487629+0000","last_fullsized":"2024-04-12T19:39:17.487629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488012+0000","last_change":"2024-04-12T19:39:10.441115+0000","last_active":"2024-04-12T19:39:17.488012+0000","last_peered":"2024-04-12T19:39:17.488012+0000","last_clean":"2024-04-12T19:39:17.488012+0000","last_became_active":"2024-04-12T19:39:10.440755+0000","last_became_peered":"2024-04-12T19:39:10.440755+0000","last_unstale":"2024-04-12T19:39:17.488012+0000","last_undegraded":"2024-04-12T19:39:17.488012+0000","last_fullsized":"2024-04-12T19:39:17.488012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:25:54.417979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174166+0000","last_change":"2024-04-12T19:39:10.441520+0000","last_active":"2024-04-12T19:39:18.174166+0000","last_peered":"2024-04-12T19:39:18.174166+0000","last_clean":"2024-04-12T19:39:18.174166+0000","last_became_active":"2024-04-12T19:39:10.441219+0000","last_became_peered":"2024-04-12T19:39:10.441219+0000","last_unstale":"2024-04-12T19:39:18.174166+0000","last_undegraded":"2024-04-12T19:39:18.174166+0000","last_fullsized":"2024-04-12T19:39:18.174166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585328+0000","last_change":"2024-04-12T19:39:11.460915+0000","last_active":"2024-04-12T19:39:18.585328+0000","last_peered":"2024-04-12T19:39:18.585328+0000","last_clean":"2024-04-12T19:39:18.585328+0000","last_became_active":"2024-04-12T19:39:11.460672+0000","last_became_peered":"2024-04-12T19:39:11.460672+0000","last_unstale":"2024-04-12T19:39:18.585328+0000","last_undegraded":"2024-04-12T19:39:18.585328+0000","last_fullsized":"2024-04-12T19:39:18.585328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:10:44.776087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.963253+0000","last_change":"2024-04-12T19:39:15.512665+0000","last_active":"2024-04-12T19:39:18.963253+0000","last_peered":"2024-04-12T19:39:18.963253+0000","last_clean":"2024-04-12T19:39:18.963253+0000","last_became_active":"2024-04-12T19:39:15.512224+0000","last_became_peered":"2024-04-12T19:39:15.512224+0000","last_unstale":"2024-04-12T19:39:18.963253+0000","last_undegraded":"2024-04-12T19:39:18.963253+0000","last_fullsized":"2024-04-12T19:39:18.963253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:18:49.693531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488497+0000","last_change":"2024-04-12T19:39:10.446078+0000","last_active":"2024-04-12T19:39:17.488497+0000","last_peered":"2024-04-12T19:39:17.488497+0000","last_clean":"2024-04-12T19:39:17.488497+0000","last_became_active":"2024-04-12T19:39:10.445778+0000","last_became_peered":"2024-04-12T19:39:10.445778+0000","last_unstale":"2024-04-12T19:39:17.488497+0000","last_undegraded":"2024-04-12T19:39:17.488497+0000","last_fullsized":"2024-04-12T19:39:17.488497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:59:25.400930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492269+0000","last_change":"2024-04-12T19:39:11.455047+0000","last_active":"2024-04-12T19:39:17.492269+0000","last_peered":"2024-04-12T19:39:17.492269+0000","last_clean":"2024-04-12T19:39:17.492269+0000","last_became_active":"2024-04-12T19:39:11.454646+0000","last_became_peered":"2024-04-12T19:39:11.454646+0000","last_unstale":"2024-04-12T19:39:17.492269+0000","last_undegraded":"2024-04-12T19:39:17.492269+0000","last_fullsized":"2024-04-12T19:39:17.492269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:52.478867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488924+0000","last_change":"2024-04-12T19:39:15.513691+0000","last_active":"2024-04-12T19:39:17.488924+0000","last_peered":"2024-04-12T19:39:17.488924+0000","last_clean":"2024-04-12T19:39:17.488924+0000","last_became_active":"2024-04-12T19:39:15.513269+0000","last_became_peered":"2024-04-12T19:39:15.513269+0000","last_unstale":"2024-04-12T19:39:17.488924+0000","last_undegraded":"2024-04-12T19:39:17.488924+0000","last_fullsized":"2024-04-12T19:39:17.488924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:40:26.732234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.173537+0000","last_change":"2024-04-12T19:39:11.468368+0000","last_active":"2024-04-12T19:39:18.173537+0000","last_peered":"2024-04-12T19:39:18.173537+0000","last_clean":"2024-04-12T19:39:18.173537+0000","last_became_active":"2024-04-12T19:39:11.467807+0000","last_became_peered":"2024-04-12T19:39:11.467807+0000","last_unstale":"2024-04-12T19:39:18.173537+0000","last_undegraded":"2024-04-12T19:39:18.173537+0000","last_fullsized":"2024-04-12T19:39:18.173537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:55:09.781797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962714+0000","last_change":"2024-04-12T19:39:11.464628+0000","last_active":"2024-04-12T19:39:18.962714+0000","last_peered":"2024-04-12T19:39:18.962714+0000","last_clean":"2024-04-12T19:39:18.962714+0000","last_became_active":"2024-04-12T19:39:11.464333+0000","last_became_peered":"2024-04-12T19:39:11.464333+0000","last_unstale":"2024-04-12T19:39:18.962714+0000","last_undegraded":"2024-04-12T19:39:18.962714+0000","last_fullsized":"2024-04-12T19:39:18.962714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:52.447954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491395+0000","last_change":"2024-04-12T19:39:11.480027+0000","last_active":"2024-04-12T19:39:17.491395+0000","last_peered":"2024-04-12T19:39:17.491395+0000","last_clean":"2024-04-12T19:39:17.491395+0000","last_became_active":"2024-04-12T19:39:11.479816+0000","last_became_peered":"2024-04-12T19:39:11.479816+0000","last_unstale":"2024-04-12T19:39:17.491395+0000","last_undegraded":"2024-04-12T19:39:17.491395+0000","last_fullsized":"2024-04-12T19:39:17.491395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:45:10.487944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585208+0000","last_change":"2024-04-12T19:39:11.475058+0000","last_active":"2024-04-12T19:39:18.585208+0000","last_peered":"2024-04-12T19:39:18.585208+0000","last_clean":"2024-04-12T19:39:18.585208+0000","last_became_active":"2024-04-12T19:39:11.474706+0000","last_became_peered":"2024-04-12T19:39:11.474706+0000","last_unstale":"2024-04-12T19:39:18.585208+0000","last_undegraded":"2024-04-12T19:39:18.585208+0000","last_fullsized":"2024-04-12T19:39:18.585208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:55:09.781797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488726+0000","last_change":"2024-04-12T19:39:11.476138+0000","last_active":"2024-04-12T19:39:17.488726+0000","last_peered":"2024-04-12T19:39:17.488726+0000","last_clean":"2024-04-12T19:39:17.488726+0000","last_became_active":"2024-04-12T19:39:11.473857+0000","last_became_peered":"2024-04-12T19:39:11.473857+0000","last_unstale":"2024-04-12T19:39:17.488726+0000","last_undegraded":"2024-04-12T19:39:17.488726+0000","last_fullsized":"2024-04-12T19:39:17.488726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:40:00.108398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104371+0000","last_change":"2024-04-12T19:39:11.471824+0000","last_active":"2024-04-12T19:39:18.104371+0000","last_peered":"2024-04-12T19:39:18.104371+0000","last_clean":"2024-04-12T19:39:18.104371+0000","last_became_active":"2024-04-12T19:39:11.471316+0000","last_became_peered":"2024-04-12T19:39:11.471316+0000","last_unstale":"2024-04-12T19:39:18.104371+0000","last_undegraded":"2024-04-12T19:39:18.104371+0000","last_fullsized":"2024-04-12T19:39:18.104371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175088+0000","last_change":"2024-04-12T19:39:11.477664+0000","last_active":"2024-04-12T19:39:18.175088+0000","last_peered":"2024-04-12T19:39:18.175088+0000","last_clean":"2024-04-12T19:39:18.175088+0000","last_became_active":"2024-04-12T19:39:11.477400+0000","last_became_peered":"2024-04-12T19:39:11.477400+0000","last_unstale":"2024-04-12T19:39:18.175088+0000","last_undegraded":"2024-04-12T19:39:18.175088+0000","last_fullsized":"2024-04-12T19:39:18.175088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489032+0000","last_change":"2024-04-12T19:39:11.473661+0000","last_active":"2024-04-12T19:39:17.489032+0000","last_peered":"2024-04-12T19:39:17.489032+0000","last_clean":"2024-04-12T19:39:17.489032+0000","last_became_active":"2024-04-12T19:39:11.473335+0000","last_became_peered":"2024-04-12T19:39:11.473335+0000","last_unstale":"2024-04-12T19:39:17.489032+0000","last_undegraded":"2024-04-12T19:39:17.489032+0000","last_fullsized":"2024-04-12T19:39:17.489032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489785+0000","last_change":"2024-04-12T19:39:11.480192+0000","last_active":"2024-04-12T19:39:17.489785+0000","last_peered":"2024-04-12T19:39:17.489785+0000","last_clean":"2024-04-12T19:39:17.489785+0000","last_became_active":"2024-04-12T19:39:11.479845+0000","last_became_peered":"2024-04-12T19:39:11.479845+0000","last_unstale":"2024-04-12T19:39:17.489785+0000","last_undegraded":"2024-04-12T19:39:17.489785+0000","last_fullsized":"2024-04-12T19:39:17.489785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487952+0000","last_change":"2024-04-12T19:39:11.459940+0000","last_active":"2024-04-12T19:39:17.487952+0000","last_peered":"2024-04-12T19:39:17.487952+0000","last_clean":"2024-04-12T19:39:17.487952+0000","last_became_active":"2024-04-12T19:39:11.459403+0000","last_became_peered":"2024-04-12T19:39:11.459403+0000","last_unstale":"2024-04-12T19:39:17.487952+0000","last_undegraded":"2024-04-12T19:39:17.487952+0000","last_fullsized":"2024-04-12T19:39:17.487952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:55:09.781797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491159+0000","last_change":"2024-04-12T19:39:11.457187+0000","last_active":"2024-04-12T19:39:17.491159+0000","last_peered":"2024-04-12T19:39:17.491159+0000","last_clean":"2024-04-12T19:39:17.491159+0000","last_became_active":"2024-04-12T19:39:11.456859+0000","last_became_peered":"2024-04-12T19:39:11.456859+0000","last_unstale":"2024-04-12T19:39:17.491159+0000","last_undegraded":"2024-04-12T19:39:17.491159+0000","last_fullsized":"2024-04-12T19:39:17.491159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:05:52.600930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585047+0000","last_change":"2024-04-12T19:39:11.465043+0000","last_active":"2024-04-12T19:39:18.585047+0000","last_peered":"2024-04-12T19:39:18.585047+0000","last_clean":"2024-04-12T19:39:18.585047+0000","last_became_active":"2024-04-12T19:39:11.464724+0000","last_became_peered":"2024-04-12T19:39:11.464724+0000","last_unstale":"2024-04-12T19:39:18.585047+0000","last_undegraded":"2024-04-12T19:39:18.585047+0000","last_fullsized":"2024-04-12T19:39:18.585047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:20.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174218+0000","last_change":"2024-04-12T19:39:11.473208+0000","last_active":"2024-04-12T19:39:18.174218+0000","last_peered":"2024-04-12T19:39:18.174218+0000","last_clean":"2024-04-12T19:39:18.174218+0000","last_became_active":"2024-04-12T19:39:11.472752+0000","last_became_peered":"2024-04-12T19:39:11.472752+0000","last_unstale":"2024-04-12T19:39:18.174218+0000","last_undegraded":"2024-04-12T19:39:18.174218+0000","last_fullsized":"2024-04-12T19:39:18.174218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:10:44.776087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495278+0000","last_change":"2024-04-12T19:39:11.461738+0000","last_active":"2024-04-12T19:39:18.495278+0000","last_peered":"2024-04-12T19:39:18.495278+0000","last_clean":"2024-04-12T19:39:18.495278+0000","last_became_active":"2024-04-12T19:39:11.461456+0000","last_became_peered":"2024-04-12T19:39:11.461456+0000","last_unstale":"2024-04-12T19:39:18.495278+0000","last_undegraded":"2024-04-12T19:39:18.495278+0000","last_fullsized":"2024-04-12T19:39:18.495278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:22:57.956770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.963582+0000","last_change":"2024-04-12T19:39:11.468295+0000","last_active":"2024-04-12T19:39:18.963582+0000","last_peered":"2024-04-12T19:39:18.963582+0000","last_clean":"2024-04-12T19:39:18.963582+0000","last_became_active":"2024-04-12T19:39:11.468002+0000","last_became_peered":"2024-04-12T19:39:11.468002+0000","last_unstale":"2024-04-12T19:39:18.963582+0000","last_undegraded":"2024-04-12T19:39:18.963582+0000","last_fullsized":"2024-04-12T19:39:18.963582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:16.676989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.494704+0000","last_change":"2024-04-12T19:39:11.457117+0000","last_active":"2024-04-12T19:39:17.494704+0000","last_peered":"2024-04-12T19:39:17.494704+0000","last_clean":"2024-04-12T19:39:17.494704+0000","last_became_active":"2024-04-12T19:39:11.456714+0000","last_became_peered":"2024-04-12T19:39:11.456714+0000","last_unstale":"2024-04-12T19:39:17.494704+0000","last_undegraded":"2024-04-12T19:39:17.494704+0000","last_fullsized":"2024-04-12T19:39:17.494704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:22:57.956770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489510+0000","last_change":"2024-04-12T19:39:11.456585+0000","last_active":"2024-04-12T19:39:17.489510+0000","last_peered":"2024-04-12T19:39:17.489510+0000","last_clean":"2024-04-12T19:39:17.489510+0000","last_became_active":"2024-04-12T19:39:11.453931+0000","last_became_peered":"2024-04-12T19:39:11.453931+0000","last_unstale":"2024-04-12T19:39:17.489510+0000","last_undegraded":"2024-04-12T19:39:17.489510+0000","last_fullsized":"2024-04-12T19:39:17.489510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103665+0000","last_change":"2024-04-12T19:39:11.445513+0000","last_active":"2024-04-12T19:39:18.103665+0000","last_peered":"2024-04-12T19:39:18.103665+0000","last_clean":"2024-04-12T19:39:18.103665+0000","last_became_active":"2024-04-12T19:39:11.445149+0000","last_became_peered":"2024-04-12T19:39:11.445149+0000","last_unstale":"2024-04-12T19:39:18.103665+0000","last_undegraded":"2024-04-12T19:39:18.103665+0000","last_fullsized":"2024-04-12T19:39:18.103665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585076+0000","last_change":"2024-04-12T19:39:11.457130+0000","last_active":"2024-04-12T19:39:18.585076+0000","last_peered":"2024-04-12T19:39:18.585076+0000","last_clean":"2024-04-12T19:39:18.585076+0000","last_became_active":"2024-04-12T19:39:11.456787+0000","last_became_peered":"2024-04-12T19:39:11.456787+0000","last_unstale":"2024-04-12T19:39:18.585076+0000","last_undegraded":"2024-04-12T19:39:18.585076+0000","last_fullsized":"2024-04-12T19:39:18.585076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488357+0000","last_change":"2024-04-12T19:39:11.474356+0000","last_active":"2024-04-12T19:39:17.488357+0000","last_peered":"2024-04-12T19:39:17.488357+0000","last_clean":"2024-04-12T19:39:17.488357+0000","last_became_active":"2024-04-12T19:39:11.474021+0000","last_became_peered":"2024-04-12T19:39:11.474021+0000","last_unstale":"2024-04-12T19:39:17.488357+0000","last_undegraded":"2024-04-12T19:39:17.488357+0000","last_fullsized":"2024-04-12T19:39:17.488357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491247+0000","last_change":"2024-04-12T19:39:11.472738+0000","last_active":"2024-04-12T19:39:17.491247+0000","last_peered":"2024-04-12T19:39:17.491247+0000","last_clean":"2024-04-12T19:39:17.491247+0000","last_became_active":"2024-04-12T19:39:11.472424+0000","last_became_peered":"2024-04-12T19:39:11.472424+0000","last_unstale":"2024-04-12T19:39:17.491247+0000","last_undegraded":"2024-04-12T19:39:17.491247+0000","last_fullsized":"2024-04-12T19:39:17.491247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:32.845169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174515+0000","last_change":"2024-04-12T19:39:11.468484+0000","last_active":"2024-04-12T19:39:18.174515+0000","last_peered":"2024-04-12T19:39:18.174515+0000","last_clean":"2024-04-12T19:39:18.174515+0000","last_became_active":"2024-04-12T19:39:11.468078+0000","last_became_peered":"2024-04-12T19:39:11.468078+0000","last_unstale":"2024-04-12T19:39:18.174515+0000","last_undegraded":"2024-04-12T19:39:18.174515+0000","last_fullsized":"2024-04-12T19:39:18.174515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175012+0000","last_change":"2024-04-12T19:39:11.470836+0000","last_active":"2024-04-12T19:39:18.175012+0000","last_peered":"2024-04-12T19:39:18.175012+0000","last_clean":"2024-04-12T19:39:18.175012+0000","last_became_active":"2024-04-12T19:39:11.470569+0000","last_became_peered":"2024-04-12T19:39:11.470569+0000","last_unstale":"2024-04-12T19:39:18.175012+0000","last_undegraded":"2024-04-12T19:39:18.175012+0000","last_fullsized":"2024-04-12T19:39:18.175012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495253+0000","last_change":"2024-04-12T19:39:11.479266+0000","last_active":"2024-04-12T19:39:18.495253+0000","last_peered":"2024-04-12T19:39:18.495253+0000","last_clean":"2024-04-12T19:39:18.495253+0000","last_became_active":"2024-04-12T19:39:11.479025+0000","last_became_peered":"2024-04-12T19:39:11.479025+0000","last_unstale":"2024-04-12T19:39:18.495253+0000","last_undegraded":"2024-04-12T19:39:18.495253+0000","last_fullsized":"2024-04-12T19:39:18.495253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:26.512414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487468+0000","last_change":"2024-04-12T19:39:11.477102+0000","last_active":"2024-04-12T19:39:17.487468+0000","last_peered":"2024-04-12T19:39:17.487468+0000","last_clean":"2024-04-12T19:39:17.487468+0000","last_became_active":"2024-04-12T19:39:11.476734+0000","last_became_peered":"2024-04-12T19:39:11.476734+0000","last_unstale":"2024-04-12T19:39:17.487468+0000","last_undegraded":"2024-04-12T19:39:17.487468+0000","last_fullsized":"2024-04-12T19:39:17.487468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:10:44.776087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493741+0000","last_change":"2024-04-12T19:39:11.457154+0000","last_active":"2024-04-12T19:39:18.493741+0000","last_peered":"2024-04-12T19:39:18.493741+0000","last_clean":"2024-04-12T19:39:18.493741+0000","last_became_active":"2024-04-12T19:39:11.456829+0000","last_became_peered":"2024-04-12T19:39:11.456829+0000","last_unstale":"2024-04-12T19:39:18.493741+0000","last_undegraded":"2024-04-12T19:39:18.493741+0000","last_fullsized":"2024-04-12T19:39:18.493741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:40:00.108398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490869+0000","last_change":"2024-04-12T19:39:11.457995+0000","last_active":"2024-04-12T19:39:17.490869+0000","last_peered":"2024-04-12T19:39:17.490869+0000","last_clean":"2024-04-12T19:39:17.490869+0000","last_became_active":"2024-04-12T19:39:11.457611+0000","last_became_peered":"2024-04-12T19:39:11.457611+0000","last_unstale":"2024-04-12T19:39:17.490869+0000","last_undegraded":"2024-04-12T19:39:17.490869+0000","last_fullsized":"2024-04-12T19:39:17.490869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:10:23.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493427+0000","last_change":"2024-04-12T19:39:11.458277+0000","last_active":"2024-04-12T19:39:18.493427+0000","last_peered":"2024-04-12T19:39:18.493427+0000","last_clean":"2024-04-12T19:39:18.493427+0000","last_became_active":"2024-04-12T19:39:11.457957+0000","last_became_peered":"2024-04-12T19:39:11.457957+0000","last_unstale":"2024-04-12T19:39:18.493427+0000","last_undegraded":"2024-04-12T19:39:18.493427+0000","last_fullsized":"2024-04-12T19:39:18.493427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:13:56.992995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493124+0000","last_change":"2024-04-12T19:39:11.479162+0000","last_active":"2024-04-12T19:39:17.493124+0000","last_peered":"2024-04-12T19:39:17.493124+0000","last_clean":"2024-04-12T19:39:17.493124+0000","last_became_active":"2024-04-12T19:39:11.478748+0000","last_became_peered":"2024-04-12T19:39:11.478748+0000","last_unstale":"2024-04-12T19:39:17.493124+0000","last_undegraded":"2024-04-12T19:39:17.493124+0000","last_fullsized":"2024-04-12T19:39:17.493124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:13:56.992995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585351+0000","last_change":"2024-04-12T19:39:11.459392+0000","last_active":"2024-04-12T19:39:18.585351+0000","last_peered":"2024-04-12T19:39:18.585351+0000","last_clean":"2024-04-12T19:39:18.585351+0000","last_became_active":"2024-04-12T19:39:11.459080+0000","last_became_peered":"2024-04-12T19:39:11.459080+0000","last_unstale":"2024-04-12T19:39:18.585351+0000","last_undegraded":"2024-04-12T19:39:18.585351+0000","last_fullsized":"2024-04-12T19:39:18.585351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104633+0000","last_change":"2024-04-12T19:39:11.455201+0000","last_active":"2024-04-12T19:39:18.104633+0000","last_peered":"2024-04-12T19:39:18.104633+0000","last_clean":"2024-04-12T19:39:18.104633+0000","last_became_active":"2024-04-12T19:39:11.454864+0000","last_became_peered":"2024-04-12T19:39:11.454864+0000","last_unstale":"2024-04-12T19:39:18.104633+0000","last_undegraded":"2024-04-12T19:39:18.104633+0000","last_fullsized":"2024-04-12T19:39:18.104633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494971+0000","last_change":"2024-04-12T19:39:11.477240+0000","last_active":"2024-04-12T19:39:18.494971+0000","last_peered":"2024-04-12T19:39:18.494971+0000","last_clean":"2024-04-12T19:39:18.494971+0000","last_became_active":"2024-04-12T19:39:11.476955+0000","last_became_peered":"2024-04-12T19:39:11.476955+0000","last_unstale":"2024-04-12T19:39:18.494971+0000","last_undegraded":"2024-04-12T19:39:18.494971+0000","last_fullsized":"2024-04-12T19:39:18.494971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:09.267564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":703014,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":115906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":112154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":112190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":115906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":112064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":112224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":703070,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-12T19:39:44.980 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-12T19:39:45.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.221+0000 7f4269800640 1 Processor -- start 2024-04-12T19:39:45.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.221+0000 7f4269800640 1 -- start start 2024-04-12T19:39:45.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.222+0000 7f4269800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f42640a8500 0x7f42641526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.222+0000 7f4269800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42641531a0 con 0x7f42640a8120 2024-04-12T19:39:45.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.222+0000 7f4269800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4264071df0 con 0x7f42640a4e60 2024-04-12T19:39:45.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.222+0000 7f4269800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f4264153680 con 0x7f42640a8500 2024-04-12T19:39:45.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.222+0000 7f4262a00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f42640a8120 0x7f42640728d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34302/0 (socket says 172.21.15.131:34302) 2024-04-12T19:39:45.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.222+0000 7f4262a00640 1 -- 172.21.15.131:0/4279603968 learned_addr learned my addr 172.21.15.131:0/4279603968 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:45.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2253420578 0 0) 0x7f42641531a0 con 0x7f42640a8120 2024-04-12T19:39:45.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4248003520 con 0x7f42640a8120 2024-04-12T19:39:45.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4262000640 1 --2- 172.21.15.131:0/4279603968 >> v2:172.21.15.171:3300/0 conn(0x7f42640a8500 0x7f42641526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1185109000 0 0) 0x7f4248003520 con 0x7f42640a8120 2024-04-12T19:39:45.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 >> v2:172.21.15.171:3300/0 conn(0x7f42640a8500 msgr2=0x7f42641526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:45.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 --2- 172.21.15.131:0/4279603968 >> v2:172.21.15.171:3300/0 conn(0x7f42640a8500 0x7f42641526f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 >> v1:172.21.15.171:6789/0 conn(0x7f42640a4e60 legacy=0x7f4264159a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42640720d0 con 0x7f42640a8120 2024-04-12T19:39:45.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f4254001670 con 0x7f42640a8120 2024-04-12T19:39:45.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 >> v1:172.21.15.131:6789/0 conn(0x7f42640a8120 legacy=0x7f42640728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 --2- 172.21.15.131:0/4279603968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4248003a00 0x7f4248003e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 --2- 172.21.15.131:0/4279603968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4248004800 0x7f4248004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 --2- 172.21.15.131:0/4279603968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4248005210 0x7f424800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4264153680 con 0x7f4248005210 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f424800c160 con 0x7f4248003a00 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f424800c360 con 0x7f4248004800 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.223+0000 7f4263400640 1 --2- 172.21.15.131:0/4279603968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4248005210 0x7f424800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.224+0000 7f4262a00640 1 --2- 172.21.15.131:0/4279603968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4248003a00 0x7f4248003e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.224+0000 7f4262000640 1 --2- 172.21.15.131:0/4279603968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4248004800 0x7f4248004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.224+0000 7f4263400640 1 -- 172.21.15.131:0/4279603968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4248004800 msgr2=0x7f4248004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.224+0000 7f4263400640 1 --2- 172.21.15.131:0/4279603968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4248004800 0x7f4248004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.224+0000 7f4263400640 1 -- 172.21.15.131:0/4279603968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4248003a00 msgr2=0x7f4248003e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.224+0000 7f4263400640 1 --2- 172.21.15.131:0/4279603968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4248003a00 0x7f4248003e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.224+0000 7f4263400640 1 -- 172.21.15.131:0/4279603968 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4248003520 con 0x7f4248005210 2024-04-12T19:39:45.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.224+0000 7f4262000640 1 --2- 172.21.15.131:0/4279603968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4248004800 0x7f4248004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:45.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.225+0000 7f4263400640 1 -- 172.21.15.131:0/4279603968 reap_dead start 2024-04-12T19:39:45.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.225+0000 7f4263400640 1 --2- 172.21.15.131:0/4279603968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4248005210 0x7f424800b9c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f425c001e20 tx=0x7f4248005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=958291898839d326 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:45.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.225+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c001a70 con 0x7f4248005210 2024-04-12T19:39:45.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.225+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c003b70 con 0x7f4248005210 2024-04-12T19:39:45.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.225+0000 7f4261600640 1 -- 172.21.15.131:0/4279603968 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c0050d0 con 0x7f4248005210 2024-04-12T19:39:45.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.226+0000 7f4269800640 1 -- 172.21.15.131:0/4279603968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4248005210 msgr2=0x7f424800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.226+0000 7f4269800640 1 --2- 172.21.15.131:0/4279603968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4248005210 0x7f424800b9c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f425c001e20 tx=0x7f4248005830 comp rx=0 tx=0).stop 2024-04-12T19:39:45.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.226+0000 7f4269800640 1 -- 172.21.15.131:0/4279603968 shutdown_connections 2024-04-12T19:39:45.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.226+0000 7f4269800640 1 --2- 172.21.15.131:0/4279603968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4248005210 0x7f424800b9c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.226+0000 7f4269800640 1 -- 172.21.15.131:0/4279603968 >> 172.21.15.131:0/4279603968 conn(0x7f42640c2590 msgr2=0x7f42640c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:45.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.226+0000 7f4269800640 1 -- 172.21.15.131:0/4279603968 shutdown_connections 2024-04-12T19:39:45.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.226+0000 7f4269800640 1 -- 172.21.15.131:0/4279603968 wait complete. 2024-04-12T19:39:45.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.227+0000 7f4269800640 1 Processor -- start 2024-04-12T19:39:45.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.228+0000 7f4269800640 1 -- start start 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.228+0000 7f4269800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4248005210 0x7f42640b9d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.228+0000 7f4269800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f426414d710 0x7f42640bbf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.228+0000 7f4269800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42640bc4d0 0x7f4264151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.228+0000 7f4269800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f426406f520 con 0x7f42640bc4d0 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.228+0000 7f4269800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f426406d970 con 0x7f426414d710 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.228+0000 7f4269800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f426406f6a0 con 0x7f4248005210 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.229+0000 7f4263400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42640bc4d0 0x7f4264151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.229+0000 7f4263400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42640bc4d0 0x7f4264151d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41486/0 (socket says 172.21.15.131:41486) 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.229+0000 7f4263400640 1 -- 172.21.15.131:0/1117006731 learned_addr learned my addr 172.21.15.131:0/1117006731 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.229+0000 7f4262a00640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4248005210 0x7f42640b9d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.229+0000 7f4263400640 1 -- 172.21.15.131:0/1117006731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4248005210 msgr2=0x7f42640b9d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.229+0000 7f4263400640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4248005210 0x7f42640b9d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.229+0000 7f4263400640 1 -- 172.21.15.131:0/1117006731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f426414d710 msgr2=0x7f42640bbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.229+0000 7f4263400640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f426414d710 0x7f42640bbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.229+0000 7f4263400640 1 -- 172.21.15.131:0/1117006731 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42640ba2d0 con 0x7f42640bc4d0 2024-04-12T19:39:45.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.229+0000 7f4262a00640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4248005210 0x7f42640b9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:45.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.229+0000 7f4263400640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42640bc4d0 0x7f4264151d80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f425c001f40 tx=0x7f425c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:45.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.230+0000 7f425aa00640 1 -- 172.21.15.131:0/1117006731 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c001a70 con 0x7f42640bc4d0 2024-04-12T19:39:45.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.230+0000 7f425aa00640 1 -- 172.21.15.131:0/1117006731 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f425c006b50 con 0x7f42640bc4d0 2024-04-12T19:39:45.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.230+0000 7f4269800640 1 -- 172.21.15.131:0/1117006731 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4264150280 con 0x7f42640bc4d0 2024-04-12T19:39:45.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.230+0000 7f425aa00640 1 -- 172.21.15.131:0/1117006731 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f425c007030 con 0x7f42640bc4d0 2024-04-12T19:39:45.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.230+0000 7f4269800640 1 -- 172.21.15.131:0/1117006731 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42641515c0 con 0x7f42640bc4d0 2024-04-12T19:39:45.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.231+0000 7f4269800640 1 -- 172.21.15.131:0/1117006731 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42640a8930 con 0x7f42640bc4d0 2024-04-12T19:39:45.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.232+0000 7f425aa00640 1 -- 172.21.15.131:0/1117006731 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f425c0071d0 con 0x7f42640bc4d0 2024-04-12T19:39:45.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.232+0000 7f425aa00640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f424406c8f0 0x7f424406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.233+0000 7f425aa00640 1 -- 172.21.15.131:0/1117006731 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f425c0ad930 con 0x7f42640bc4d0 2024-04-12T19:39:45.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.233+0000 7f4262a00640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f424406c8f0 0x7f424406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.233 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.233+0000 7f4262a00640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f424406c8f0 0x7f424406edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4254001eb0 tx=0x7f4254000ef0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:45.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.237+0000 7f425aa00640 1 -- 172.21.15.131:0/1117006731 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f42640a8930 con 0x7f42640bc4d0 2024-04-12T19:39:45.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.418+0000 7f4269800640 1 -- 172.21.15.131:0/1117006731 --> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42640bffa0 con 0x7f424406c8f0 2024-04-12T19:39:45.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.428+0000 7f425aa00640 1 -- 172.21.15.131:0/1117006731 <== mgr.4101 v2:172.21.15.131:6832/873500205 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332614 (secure 0 0 0) 0x7f42640bffa0 con 0x7f424406c8f0 2024-04-12T19:39:45.433 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:45.435 INFO:teuthology.orchestra.run.smithi131.stderr:dumped all 2024-04-12T19:39:45.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.436+0000 7f4269800640 1 -- 172.21.15.131:0/1117006731 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f424406c8f0 msgr2=0x7f424406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.436+0000 7f4269800640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f424406c8f0 0x7f424406edb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4254001eb0 tx=0x7f4254000ef0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.436 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.436+0000 7f4269800640 1 -- 172.21.15.131:0/1117006731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42640bc4d0 msgr2=0x7f4264151d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.436+0000 7f4269800640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42640bc4d0 0x7f4264151d80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f425c001f40 tx=0x7f425c0014a0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.436+0000 7f4269800640 1 -- 172.21.15.131:0/1117006731 shutdown_connections 2024-04-12T19:39:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.436+0000 7f4269800640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f424406c8f0 0x7f424406edb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.436+0000 7f4269800640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f426414d710 0x7f42640bbf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.436+0000 7f4269800640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f42640bc4d0 0x7f4264151d80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.436+0000 7f4269800640 1 --2- 172.21.15.131:0/1117006731 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4248005210 0x7f42640b9d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.436+0000 7f4269800640 1 -- 172.21.15.131:0/1117006731 >> 172.21.15.131:0/1117006731 conn(0x7f42640c2590 msgr2=0x7f4264071140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.436+0000 7f4269800640 1 -- 172.21.15.131:0/1117006731 shutdown_connections 2024-04-12T19:39:45.437 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.436+0000 7f4269800640 1 -- 172.21.15.131:0/1117006731 wait complete. 2024-04-12T19:39:45.454 INFO:teuthology.orchestra.run.smithi131.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-12T19:39:44.831237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218532,"kb_used_data":2368,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754756188,"statfs":{"total":773094113280,"available":772870336512,"internally_reserved":0,"allocated":2424832,"data_stored":2086528,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004909"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585758+0000","last_change":"2024-04-12T19:39:10.436376+0000","last_active":"2024-04-12T19:39:18.585758+0000","last_peered":"2024-04-12T19:39:18.585758+0000","last_clean":"2024-04-12T19:39:18.585758+0000","last_became_active":"2024-04-12T19:39:10.436052+0000","last_became_peered":"2024-04-12T19:39:10.436052+0000","last_unstale":"2024-04-12T19:39:18.585758+0000","last_undegraded":"2024-04-12T19:39:18.585758+0000","last_fullsized":"2024-04-12T19:39:18.585758+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:25:54.417979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489106+0000","last_change":"2024-04-12T19:39:11.476500+0000","last_active":"2024-04-12T19:39:17.489106+0000","last_peered":"2024-04-12T19:39:17.489106+0000","last_clean":"2024-04-12T19:39:17.489106+0000","last_became_active":"2024-04-12T19:39:11.476227+0000","last_became_peered":"2024-04-12T19:39:11.476227+0000","last_unstale":"2024-04-12T19:39:17.489106+0000","last_undegraded":"2024-04-12T19:39:17.489106+0000","last_fullsized":"2024-04-12T19:39:17.489106+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:10:23.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488071+0000","last_change":"2024-04-12T19:39:16.130127+0000","last_active":"2024-04-12T19:39:17.488071+0000","last_peered":"2024-04-12T19:39:17.488071+0000","last_clean":"2024-04-12T19:39:17.488071+0000","last_became_active":"2024-04-12T19:39:16.128965+0000","last_became_peered":"2024-04-12T19:39:16.128965+0000","last_unstale":"2024-04-12T19:39:17.488071+0000","last_undegraded":"2024-04-12T19:39:17.488071+0000","last_fullsized":"2024-04-12T19:39:17.488071+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:05:40.753433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489202+0000","last_change":"2024-04-12T19:39:10.434713+0000","last_active":"2024-04-12T19:39:17.489202+0000","last_peered":"2024-04-12T19:39:17.489202+0000","last_clean":"2024-04-12T19:39:17.489202+0000","last_became_active":"2024-04-12T19:39:10.434206+0000","last_became_peered":"2024-04-12T19:39:10.434206+0000","last_unstale":"2024-04-12T19:39:17.489202+0000","last_undegraded":"2024-04-12T19:39:17.489202+0000","last_fullsized":"2024-04-12T19:39:17.489202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:35:32.075423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585573+0000","last_change":"2024-04-12T19:39:11.468967+0000","last_active":"2024-04-12T19:39:18.585573+0000","last_peered":"2024-04-12T19:39:18.585573+0000","last_clean":"2024-04-12T19:39:18.585573+0000","last_became_active":"2024-04-12T19:39:11.468506+0000","last_became_peered":"2024-04-12T19:39:11.468506+0000","last_unstale":"2024-04-12T19:39:18.585573+0000","last_undegraded":"2024-04-12T19:39:18.585573+0000","last_fullsized":"2024-04-12T19:39:18.585573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:34:33.700728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490493+0000","last_change":"2024-04-12T19:39:15.514844+0000","last_active":"2024-04-12T19:39:17.490493+0000","last_peered":"2024-04-12T19:39:17.490493+0000","last_clean":"2024-04-12T19:39:17.490493+0000","last_became_active":"2024-04-12T19:39:15.514389+0000","last_became_peered":"2024-04-12T19:39:15.514389+0000","last_unstale":"2024-04-12T19:39:17.490493+0000","last_undegraded":"2024-04-12T19:39:17.490493+0000","last_fullsized":"2024-04-12T19:39:17.490493+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:13.334480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493030+0000","last_change":"2024-04-12T19:39:10.449208+0000","last_active":"2024-04-12T19:39:18.493030+0000","last_peered":"2024-04-12T19:39:18.493030+0000","last_clean":"2024-04-12T19:39:18.493030+0000","last_became_active":"2024-04-12T19:39:10.447087+0000","last_became_peered":"2024-04-12T19:39:10.447087+0000","last_unstale":"2024-04-12T19:39:18.493030+0000","last_undegraded":"2024-04-12T19:39:18.493030+0000","last_fullsized":"2024-04-12T19:39:18.493030+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:15.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493393+0000","last_change":"2024-04-12T19:39:11.453798+0000","last_active":"2024-04-12T19:39:17.493393+0000","last_peered":"2024-04-12T19:39:17.493393+0000","last_clean":"2024-04-12T19:39:17.493393+0000","last_became_active":"2024-04-12T19:39:11.451146+0000","last_became_peered":"2024-04-12T19:39:11.451146+0000","last_unstale":"2024-04-12T19:39:17.493393+0000","last_undegraded":"2024-04-12T19:39:17.493393+0000","last_fullsized":"2024-04-12T19:39:17.493393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:21:53.745025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491302+0000","last_change":"2024-04-12T19:39:15.516232+0000","last_active":"2024-04-12T19:39:17.491302+0000","last_peered":"2024-04-12T19:39:17.491302+0000","last_clean":"2024-04-12T19:39:17.491302+0000","last_became_active":"2024-04-12T19:39:15.515675+0000","last_became_peered":"2024-04-12T19:39:15.515675+0000","last_unstale":"2024-04-12T19:39:17.491302+0000","last_undegraded":"2024-04-12T19:39:17.491302+0000","last_fullsized":"2024-04-12T19:39:17.491302+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:39:36.033443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.492973+0000","last_change":"2024-04-12T19:39:10.448666+0000","last_active":"2024-04-12T19:39:18.492973+0000","last_peered":"2024-04-12T19:39:18.492973+0000","last_clean":"2024-04-12T19:39:18.492973+0000","last_became_active":"2024-04-12T19:39:10.447506+0000","last_became_peered":"2024-04-12T19:39:10.447506+0000","last_unstale":"2024-04-12T19:39:18.492973+0000","last_undegraded":"2024-04-12T19:39:18.492973+0000","last_fullsized":"2024-04-12T19:39:18.492973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493463+0000","last_change":"2024-04-12T19:39:11.444311+0000","last_active":"2024-04-12T19:39:17.493463+0000","last_peered":"2024-04-12T19:39:17.493463+0000","last_clean":"2024-04-12T19:39:17.493463+0000","last_became_active":"2024-04-12T19:39:11.443691+0000","last_became_peered":"2024-04-12T19:39:11.443691+0000","last_unstale":"2024-04-12T19:39:17.493463+0000","last_undegraded":"2024-04-12T19:39:17.493463+0000","last_fullsized":"2024-04-12T19:39:17.493463+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:37.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491425+0000","last_change":"2024-04-12T19:39:15.512394+0000","last_active":"2024-04-12T19:39:17.491425+0000","last_peered":"2024-04-12T19:39:17.491425+0000","last_clean":"2024-04-12T19:39:17.491425+0000","last_became_active":"2024-04-12T19:39:15.511995+0000","last_became_peered":"2024-04-12T19:39:15.511995+0000","last_unstale":"2024-04-12T19:39:17.491425+0000","last_undegraded":"2024-04-12T19:39:17.491425+0000","last_fullsized":"2024-04-12T19:39:17.491425+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:25:21.809067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.173497+0000","last_change":"2024-04-12T19:39:11.466978+0000","last_active":"2024-04-12T19:39:18.173497+0000","last_peered":"2024-04-12T19:39:18.173497+0000","last_clean":"2024-04-12T19:39:18.173497+0000","last_became_active":"2024-04-12T19:39:11.462526+0000","last_became_peered":"2024-04-12T19:39:11.462526+0000","last_unstale":"2024-04-12T19:39:18.173497+0000","last_undegraded":"2024-04-12T19:39:18.173497+0000","last_fullsized":"2024-04-12T19:39:18.173497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493020+0000","last_change":"2024-04-12T19:39:10.449545+0000","last_active":"2024-04-12T19:39:18.493020+0000","last_peered":"2024-04-12T19:39:18.493020+0000","last_clean":"2024-04-12T19:39:18.493020+0000","last_became_active":"2024-04-12T19:39:10.449218+0000","last_became_peered":"2024-04-12T19:39:10.449218+0000","last_unstale":"2024-04-12T19:39:18.493020+0000","last_undegraded":"2024-04-12T19:39:18.493020+0000","last_fullsized":"2024-04-12T19:39:18.493020+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:51.431359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492072+0000","last_change":"2024-04-12T19:39:15.520316+0000","last_active":"2024-04-12T19:39:17.492072+0000","last_peered":"2024-04-12T19:39:17.492072+0000","last_clean":"2024-04-12T19:39:17.492072+0000","last_became_active":"2024-04-12T19:39:15.519733+0000","last_became_peered":"2024-04-12T19:39:15.519733+0000","last_unstale":"2024-04-12T19:39:17.492072+0000","last_undegraded":"2024-04-12T19:39:17.492072+0000","last_fullsized":"2024-04-12T19:39:17.492072+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:45:30.872970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488363+0000","last_change":"2024-04-12T19:39:11.468457+0000","last_active":"2024-04-12T19:39:17.488363+0000","last_peered":"2024-04-12T19:39:17.488363+0000","last_clean":"2024-04-12T19:39:17.488363+0000","last_became_active":"2024-04-12T19:39:11.467315+0000","last_became_peered":"2024-04-12T19:39:11.467315+0000","last_unstale":"2024-04-12T19:39:17.488363+0000","last_undegraded":"2024-04-12T19:39:17.488363+0000","last_fullsized":"2024-04-12T19:39:17.488363+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103926+0000","last_change":"2024-04-12T19:39:10.440820+0000","last_active":"2024-04-12T19:39:18.103926+0000","last_peered":"2024-04-12T19:39:18.103926+0000","last_clean":"2024-04-12T19:39:18.103926+0000","last_became_active":"2024-04-12T19:39:10.440389+0000","last_became_peered":"2024-04-12T19:39:10.440389+0000","last_unstale":"2024-04-12T19:39:18.103926+0000","last_undegraded":"2024-04-12T19:39:18.103926+0000","last_fullsized":"2024-04-12T19:39:18.103926+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490713+0000","last_change":"2024-04-12T19:39:15.512849+0000","last_active":"2024-04-12T19:39:17.490713+0000","last_peered":"2024-04-12T19:39:17.490713+0000","last_clean":"2024-04-12T19:39:17.490713+0000","last_became_active":"2024-04-12T19:39:15.512484+0000","last_became_peered":"2024-04-12T19:39:15.512484+0000","last_unstale":"2024-04-12T19:39:17.490713+0000","last_undegraded":"2024-04-12T19:39:17.490713+0000","last_fullsized":"2024-04-12T19:39:17.490713+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:41.709345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487788+0000","last_change":"2024-04-12T19:39:11.467478+0000","last_active":"2024-04-12T19:39:17.487788+0000","last_peered":"2024-04-12T19:39:17.487788+0000","last_clean":"2024-04-12T19:39:17.487788+0000","last_became_active":"2024-04-12T19:39:11.467119+0000","last_became_peered":"2024-04-12T19:39:11.467119+0000","last_unstale":"2024-04-12T19:39:17.487788+0000","last_undegraded":"2024-04-12T19:39:17.487788+0000","last_fullsized":"2024-04-12T19:39:17.487788+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103760+0000","last_change":"2024-04-12T19:39:10.445133+0000","last_active":"2024-04-12T19:39:18.103760+0000","last_peered":"2024-04-12T19:39:18.103760+0000","last_clean":"2024-04-12T19:39:18.103760+0000","last_became_active":"2024-04-12T19:39:10.444813+0000","last_became_peered":"2024-04-12T19:39:10.444813+0000","last_unstale":"2024-04-12T19:39:18.103760+0000","last_undegraded":"2024-04-12T19:39:18.103760+0000","last_fullsized":"2024-04-12T19:39:18.103760+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:28:58.315840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104936+0000","last_change":"2024-04-12T19:39:16.128749+0000","last_active":"2024-04-12T19:39:18.104936+0000","last_peered":"2024-04-12T19:39:18.104936+0000","last_clean":"2024-04-12T19:39:18.104936+0000","last_became_active":"2024-04-12T19:39:16.127560+0000","last_became_peered":"2024-04-12T19:39:16.127560+0000","last_unstale":"2024-04-12T19:39:18.104936+0000","last_undegraded":"2024-04-12T19:39:18.104936+0000","last_fullsized":"2024-04-12T19:39:18.104936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:27:00.174133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491573+0000","last_change":"2024-04-12T19:39:11.460532+0000","last_active":"2024-04-12T19:39:17.491573+0000","last_peered":"2024-04-12T19:39:17.491573+0000","last_clean":"2024-04-12T19:39:17.491573+0000","last_became_active":"2024-04-12T19:39:11.460027+0000","last_became_peered":"2024-04-12T19:39:11.460027+0000","last_unstale":"2024-04-12T19:39:17.491573+0000","last_undegraded":"2024-04-12T19:39:17.491573+0000","last_fullsized":"2024-04-12T19:39:17.491573+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:16.676989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493544+0000","last_change":"2024-04-12T19:39:10.447746+0000","last_active":"2024-04-12T19:39:18.493544+0000","last_peered":"2024-04-12T19:39:18.493544+0000","last_clean":"2024-04-12T19:39:18.493544+0000","last_became_active":"2024-04-12T19:39:10.446264+0000","last_became_peered":"2024-04-12T19:39:10.446264+0000","last_unstale":"2024-04-12T19:39:18.493544+0000","last_undegraded":"2024-04-12T19:39:18.493544+0000","last_fullsized":"2024-04-12T19:39:18.493544+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492578+0000","last_change":"2024-04-12T19:39:15.514854+0000","last_active":"2024-04-12T19:39:17.492578+0000","last_peered":"2024-04-12T19:39:17.492578+0000","last_clean":"2024-04-12T19:39:17.492578+0000","last_became_active":"2024-04-12T19:39:15.514469+0000","last_became_peered":"2024-04-12T19:39:15.514469+0000","last_unstale":"2024-04-12T19:39:17.492578+0000","last_undegraded":"2024-04-12T19:39:17.492578+0000","last_fullsized":"2024-04-12T19:39:17.492578+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:02:18.119234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.586125+0000","last_change":"2024-04-12T19:39:11.455415+0000","last_active":"2024-04-12T19:39:18.586125+0000","last_peered":"2024-04-12T19:39:18.586125+0000","last_clean":"2024-04-12T19:39:18.586125+0000","last_became_active":"2024-04-12T19:39:11.455042+0000","last_became_peered":"2024-04-12T19:39:11.455042+0000","last_unstale":"2024-04-12T19:39:18.586125+0000","last_undegraded":"2024-04-12T19:39:18.586125+0000","last_fullsized":"2024-04-12T19:39:18.586125+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175136+0000","last_change":"2024-04-12T19:39:10.447580+0000","last_active":"2024-04-12T19:39:18.175136+0000","last_peered":"2024-04-12T19:39:18.175136+0000","last_clean":"2024-04-12T19:39:18.175136+0000","last_became_active":"2024-04-12T19:39:10.447234+0000","last_became_peered":"2024-04-12T19:39:10.447234+0000","last_unstale":"2024-04-12T19:39:18.175136+0000","last_undegraded":"2024-04-12T19:39:18.175136+0000","last_fullsized":"2024-04-12T19:39:18.175136+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490950+0000","last_change":"2024-04-12T19:39:16.129529+0000","last_active":"2024-04-12T19:39:17.490950+0000","last_peered":"2024-04-12T19:39:17.490950+0000","last_clean":"2024-04-12T19:39:17.490950+0000","last_became_active":"2024-04-12T19:39:16.128296+0000","last_became_peered":"2024-04-12T19:39:16.128296+0000","last_unstale":"2024-04-12T19:39:17.490950+0000","last_undegraded":"2024-04-12T19:39:17.490950+0000","last_fullsized":"2024-04-12T19:39:17.490950+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:30.579330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489090+0000","last_change":"2024-04-12T19:39:11.474331+0000","last_active":"2024-04-12T19:39:17.489090+0000","last_peered":"2024-04-12T19:39:17.489090+0000","last_clean":"2024-04-12T19:39:17.489090+0000","last_became_active":"2024-04-12T19:39:11.474034+0000","last_became_peered":"2024-04-12T19:39:11.474034+0000","last_unstale":"2024-04-12T19:39:17.489090+0000","last_undegraded":"2024-04-12T19:39:17.489090+0000","last_fullsized":"2024-04-12T19:39:17.489090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"21'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104698+0000","last_change":"2024-04-12T19:39:10.441909+0000","last_active":"2024-04-12T19:39:18.104698+0000","last_peered":"2024-04-12T19:39:18.104698+0000","last_clean":"2024-04-12T19:39:18.104698+0000","last_became_active":"2024-04-12T19:39:10.441461+0000","last_became_peered":"2024-04-12T19:39:10.441461+0000","last_unstale":"2024-04-12T19:39:18.104698+0000","last_undegraded":"2024-04-12T19:39:18.104698+0000","last_fullsized":"2024-04-12T19:39:18.104698+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487914+0000","last_change":"2024-04-12T19:39:16.121582+0000","last_active":"2024-04-12T19:39:17.487914+0000","last_peered":"2024-04-12T19:39:17.487914+0000","last_clean":"2024-04-12T19:39:17.487914+0000","last_became_active":"2024-04-12T19:39:16.120301+0000","last_became_peered":"2024-04-12T19:39:16.120301+0000","last_unstale":"2024-04-12T19:39:17.487914+0000","last_undegraded":"2024-04-12T19:39:17.487914+0000","last_fullsized":"2024-04-12T19:39:17.487914+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:08:52.349202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104233+0000","last_change":"2024-04-12T19:39:11.454547+0000","last_active":"2024-04-12T19:39:18.104233+0000","last_peered":"2024-04-12T19:39:18.104233+0000","last_clean":"2024-04-12T19:39:18.104233+0000","last_became_active":"2024-04-12T19:39:11.454183+0000","last_became_peered":"2024-04-12T19:39:11.454183+0000","last_unstale":"2024-04-12T19:39:18.104233+0000","last_undegraded":"2024-04-12T19:39:18.104233+0000","last_fullsized":"2024-04-12T19:39:18.104233+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495290+0000","last_change":"2024-04-12T19:39:10.450615+0000","last_active":"2024-04-12T19:39:18.495290+0000","last_peered":"2024-04-12T19:39:18.495290+0000","last_clean":"2024-04-12T19:39:18.495290+0000","last_became_active":"2024-04-12T19:39:10.450161+0000","last_became_peered":"2024-04-12T19:39:10.450161+0000","last_unstale":"2024-04-12T19:39:18.495290+0000","last_undegraded":"2024-04-12T19:39:18.495290+0000","last_fullsized":"2024-04-12T19:39:18.495290+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:28:58.315840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585091+0000","last_change":"2024-04-12T19:39:16.130720+0000","last_active":"2024-04-12T19:39:18.585091+0000","last_peered":"2024-04-12T19:39:18.585091+0000","last_clean":"2024-04-12T19:39:18.585091+0000","last_became_active":"2024-04-12T19:39:16.127733+0000","last_became_peered":"2024-04-12T19:39:16.127733+0000","last_unstale":"2024-04-12T19:39:18.585091+0000","last_undegraded":"2024-04-12T19:39:18.585091+0000","last_fullsized":"2024-04-12T19:39:18.585091+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:25:21.809067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493689+0000","last_change":"2024-04-12T19:39:11.478915+0000","last_active":"2024-04-12T19:39:17.493689+0000","last_peered":"2024-04-12T19:39:17.493689+0000","last_clean":"2024-04-12T19:39:17.493689+0000","last_became_active":"2024-04-12T19:39:11.478570+0000","last_became_peered":"2024-04-12T19:39:11.478570+0000","last_unstale":"2024-04-12T19:39:17.493689+0000","last_undegraded":"2024-04-12T19:39:17.493689+0000","last_fullsized":"2024-04-12T19:39:17.493689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:26.512414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104346+0000","last_change":"2024-04-12T19:39:10.430117+0000","last_active":"2024-04-12T19:39:18.104346+0000","last_peered":"2024-04-12T19:39:18.104346+0000","last_clean":"2024-04-12T19:39:18.104346+0000","last_became_active":"2024-04-12T19:39:10.429533+0000","last_became_peered":"2024-04-12T19:39:10.429533+0000","last_unstale":"2024-04-12T19:39:18.104346+0000","last_undegraded":"2024-04-12T19:39:18.104346+0000","last_fullsized":"2024-04-12T19:39:18.104346+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103455+0000","last_change":"2024-04-12T19:39:15.516618+0000","last_active":"2024-04-12T19:39:18.103455+0000","last_peered":"2024-04-12T19:39:18.103455+0000","last_clean":"2024-04-12T19:39:18.103455+0000","last_became_active":"2024-04-12T19:39:15.516233+0000","last_became_peered":"2024-04-12T19:39:15.516233+0000","last_unstale":"2024-04-12T19:39:18.103455+0000","last_undegraded":"2024-04-12T19:39:18.103455+0000","last_fullsized":"2024-04-12T19:39:18.103455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:45:30.872970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491846+0000","last_change":"2024-04-12T19:39:11.459045+0000","last_active":"2024-04-12T19:39:17.491846+0000","last_peered":"2024-04-12T19:39:17.491846+0000","last_clean":"2024-04-12T19:39:17.491846+0000","last_became_active":"2024-04-12T19:39:11.458714+0000","last_became_peered":"2024-04-12T19:39:11.458714+0000","last_unstale":"2024-04-12T19:39:17.491846+0000","last_undegraded":"2024-04-12T19:39:17.491846+0000","last_fullsized":"2024-04-12T19:39:17.491846+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:33.845598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491628+0000","last_change":"2024-04-12T19:39:10.437425+0000","last_active":"2024-04-12T19:39:17.491628+0000","last_peered":"2024-04-12T19:39:17.491628+0000","last_clean":"2024-04-12T19:39:17.491628+0000","last_became_active":"2024-04-12T19:39:10.437004+0000","last_became_peered":"2024-04-12T19:39:10.437004+0000","last_unstale":"2024-04-12T19:39:17.491628+0000","last_undegraded":"2024-04-12T19:39:17.491628+0000","last_fullsized":"2024-04-12T19:39:17.491628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104281+0000","last_change":"2024-04-12T19:39:15.523251+0000","last_active":"2024-04-12T19:39:18.104281+0000","last_peered":"2024-04-12T19:39:18.104281+0000","last_clean":"2024-04-12T19:39:18.104281+0000","last_became_active":"2024-04-12T19:39:15.519488+0000","last_became_peered":"2024-04-12T19:39:15.519488+0000","last_unstale":"2024-04-12T19:39:18.104281+0000","last_undegraded":"2024-04-12T19:39:18.104281+0000","last_fullsized":"2024-04-12T19:39:18.104281+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:12:45.261630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103426+0000","last_change":"2024-04-12T19:39:11.452969+0000","last_active":"2024-04-12T19:39:18.103426+0000","last_peered":"2024-04-12T19:39:18.103426+0000","last_clean":"2024-04-12T19:39:18.103426+0000","last_became_active":"2024-04-12T19:39:11.452699+0000","last_became_peered":"2024-04-12T19:39:11.452699+0000","last_unstale":"2024-04-12T19:39:18.103426+0000","last_undegraded":"2024-04-12T19:39:18.103426+0000","last_fullsized":"2024-04-12T19:39:18.103426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962166+0000","last_change":"2024-04-12T19:39:10.435670+0000","last_active":"2024-04-12T19:39:18.962166+0000","last_peered":"2024-04-12T19:39:18.962166+0000","last_clean":"2024-04-12T19:39:18.962166+0000","last_became_active":"2024-04-12T19:39:10.435317+0000","last_became_peered":"2024-04-12T19:39:10.435317+0000","last_unstale":"2024-04-12T19:39:18.962166+0000","last_undegraded":"2024-04-12T19:39:18.962166+0000","last_fullsized":"2024-04-12T19:39:18.962166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104855+0000","last_change":"2024-04-12T19:39:15.517258+0000","last_active":"2024-04-12T19:39:18.104855+0000","last_peered":"2024-04-12T19:39:18.104855+0000","last_clean":"2024-04-12T19:39:18.104855+0000","last_became_active":"2024-04-12T19:39:15.516843+0000","last_became_peered":"2024-04-12T19:39:15.516843+0000","last_unstale":"2024-04-12T19:39:18.104855+0000","last_undegraded":"2024-04-12T19:39:18.104855+0000","last_fullsized":"2024-04-12T19:39:18.104855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:56:53.325064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.584621+0000","last_change":"2024-04-12T19:39:11.458719+0000","last_active":"2024-04-12T19:39:18.584621+0000","last_peered":"2024-04-12T19:39:18.584621+0000","last_clean":"2024-04-12T19:39:18.584621+0000","last_became_active":"2024-04-12T19:39:11.457787+0000","last_became_peered":"2024-04-12T19:39:11.457787+0000","last_unstale":"2024-04-12T19:39:18.584621+0000","last_undegraded":"2024-04-12T19:39:18.584621+0000","last_fullsized":"2024-04-12T19:39:18.584621+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.492948+0000","last_change":"2024-04-12T19:39:10.450200+0000","last_active":"2024-04-12T19:39:18.492948+0000","last_peered":"2024-04-12T19:39:18.492948+0000","last_clean":"2024-04-12T19:39:18.492948+0000","last_became_active":"2024-04-12T19:39:10.449871+0000","last_became_peered":"2024-04-12T19:39:10.449871+0000","last_unstale":"2024-04-12T19:39:18.492948+0000","last_undegraded":"2024-04-12T19:39:18.492948+0000","last_fullsized":"2024-04-12T19:39:18.492948+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.586171+0000","last_change":"2024-04-12T19:39:16.134794+0000","last_active":"2024-04-12T19:39:18.586171+0000","last_peered":"2024-04-12T19:39:18.586171+0000","last_clean":"2024-04-12T19:39:18.586171+0000","last_became_active":"2024-04-12T19:39:16.131743+0000","last_became_peered":"2024-04-12T19:39:16.131743+0000","last_unstale":"2024-04-12T19:39:18.586171+0000","last_undegraded":"2024-04-12T19:39:18.586171+0000","last_fullsized":"2024-04-12T19:39:18.586171+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:56:53.325064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488155+0000","last_change":"2024-04-12T19:39:11.474413+0000","last_active":"2024-04-12T19:39:17.488155+0000","last_peered":"2024-04-12T19:39:17.488155+0000","last_clean":"2024-04-12T19:39:17.488155+0000","last_became_active":"2024-04-12T19:39:11.473738+0000","last_became_peered":"2024-04-12T19:39:11.473738+0000","last_unstale":"2024-04-12T19:39:17.488155+0000","last_undegraded":"2024-04-12T19:39:17.488155+0000","last_fullsized":"2024-04-12T19:39:17.488155+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:13:56.992995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492770+0000","last_change":"2024-04-12T19:39:10.426342+0000","last_active":"2024-04-12T19:39:17.492770+0000","last_peered":"2024-04-12T19:39:17.492770+0000","last_clean":"2024-04-12T19:39:17.492770+0000","last_became_active":"2024-04-12T19:39:10.426074+0000","last_became_peered":"2024-04-12T19:39:10.426074+0000","last_unstale":"2024-04-12T19:39:17.492770+0000","last_undegraded":"2024-04-12T19:39:17.492770+0000","last_fullsized":"2024-04-12T19:39:17.492770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:19:09.670101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":180,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493775+0000","last_change":"2024-04-12T19:39:06.612396+0000","last_active":"2024-04-12T19:39:18.493775+0000","last_peered":"2024-04-12T19:39:18.493775+0000","last_clean":"2024-04-12T19:39:18.493775+0000","last_became_active":"2024-04-12T19:39:06.610032+0000","last_became_peered":"2024-04-12T19:39:06.610032+0000","last_unstale":"2024-04-12T19:39:18.493775+0000","last_undegraded":"2024-04-12T19:39:18.493775+0000","last_fullsized":"2024-04-12T19:39:18.493775+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:05.335186+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:05.335186+0000","last_clean_scrub_stamp":"2024-04-12T19:39:05.335186+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:31:00.943120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174520+0000","last_change":"2024-04-12T19:39:16.129683+0000","last_active":"2024-04-12T19:39:18.174520+0000","last_peered":"2024-04-12T19:39:18.174520+0000","last_clean":"2024-04-12T19:39:18.174520+0000","last_became_active":"2024-04-12T19:39:16.128384+0000","last_became_peered":"2024-04-12T19:39:16.128384+0000","last_unstale":"2024-04-12T19:39:18.174520+0000","last_undegraded":"2024-04-12T19:39:18.174520+0000","last_fullsized":"2024-04-12T19:39:18.174520+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:13.334480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494857+0000","last_change":"2024-04-12T19:39:11.464853+0000","last_active":"2024-04-12T19:39:18.494857+0000","last_peered":"2024-04-12T19:39:18.494857+0000","last_clean":"2024-04-12T19:39:18.494857+0000","last_became_active":"2024-04-12T19:39:11.464583+0000","last_became_peered":"2024-04-12T19:39:11.464583+0000","last_unstale":"2024-04-12T19:39:18.494857+0000","last_undegraded":"2024-04-12T19:39:18.494857+0000","last_fullsized":"2024-04-12T19:39:18.494857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:10:23.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962230+0000","last_change":"2024-04-12T19:39:10.437434+0000","last_active":"2024-04-12T19:39:18.962230+0000","last_peered":"2024-04-12T19:39:18.962230+0000","last_clean":"2024-04-12T19:39:18.962230+0000","last_became_active":"2024-04-12T19:39:10.437000+0000","last_became_peered":"2024-04-12T19:39:10.437000+0000","last_unstale":"2024-04-12T19:39:18.962230+0000","last_undegraded":"2024-04-12T19:39:18.962230+0000","last_fullsized":"2024-04-12T19:39:18.962230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:19:09.670101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175055+0000","last_change":"2024-04-12T19:39:16.122002+0000","last_active":"2024-04-12T19:39:18.175055+0000","last_peered":"2024-04-12T19:39:18.175055+0000","last_clean":"2024-04-12T19:39:18.175055+0000","last_became_active":"2024-04-12T19:39:16.120822+0000","last_became_peered":"2024-04-12T19:39:16.120822+0000","last_unstale":"2024-04-12T19:39:18.175055+0000","last_undegraded":"2024-04-12T19:39:18.175055+0000","last_fullsized":"2024-04-12T19:39:18.175055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:30.579330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.495013+0000","last_change":"2024-04-12T19:39:11.480018+0000","last_active":"2024-04-12T19:39:17.495013+0000","last_peered":"2024-04-12T19:39:17.495013+0000","last_clean":"2024-04-12T19:39:17.495013+0000","last_became_active":"2024-04-12T19:39:11.479672+0000","last_became_peered":"2024-04-12T19:39:11.479672+0000","last_unstale":"2024-04-12T19:39:17.495013+0000","last_undegraded":"2024-04-12T19:39:17.495013+0000","last_fullsized":"2024-04-12T19:39:17.495013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:09.267564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104503+0000","last_change":"2024-04-12T19:39:10.439233+0000","last_active":"2024-04-12T19:39:18.104503+0000","last_peered":"2024-04-12T19:39:18.104503+0000","last_clean":"2024-04-12T19:39:18.104503+0000","last_became_active":"2024-04-12T19:39:10.438816+0000","last_became_peered":"2024-04-12T19:39:10.438816+0000","last_unstale":"2024-04-12T19:39:18.104503+0000","last_undegraded":"2024-04-12T19:39:18.104503+0000","last_fullsized":"2024-04-12T19:39:18.104503+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:15.660394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585297+0000","last_change":"2024-04-12T19:39:15.520784+0000","last_active":"2024-04-12T19:39:18.585297+0000","last_peered":"2024-04-12T19:39:18.585297+0000","last_clean":"2024-04-12T19:39:18.585297+0000","last_became_active":"2024-04-12T19:39:15.520270+0000","last_became_peered":"2024-04-12T19:39:15.520270+0000","last_unstale":"2024-04-12T19:39:18.585297+0000","last_undegraded":"2024-04-12T19:39:18.585297+0000","last_fullsized":"2024-04-12T19:39:18.585297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:45:30.872970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495368+0000","last_change":"2024-04-12T19:39:11.472989+0000","last_active":"2024-04-12T19:39:18.495368+0000","last_peered":"2024-04-12T19:39:18.495368+0000","last_clean":"2024-04-12T19:39:18.495368+0000","last_became_active":"2024-04-12T19:39:11.472677+0000","last_became_peered":"2024-04-12T19:39:11.472677+0000","last_unstale":"2024-04-12T19:39:18.495368+0000","last_undegraded":"2024-04-12T19:39:18.495368+0000","last_fullsized":"2024-04-12T19:39:18.495368+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:37.642429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962266+0000","last_change":"2024-04-12T19:39:10.438486+0000","last_active":"2024-04-12T19:39:18.962266+0000","last_peered":"2024-04-12T19:39:18.962266+0000","last_clean":"2024-04-12T19:39:18.962266+0000","last_became_active":"2024-04-12T19:39:10.438219+0000","last_became_peered":"2024-04-12T19:39:10.438219+0000","last_unstale":"2024-04-12T19:39:18.962266+0000","last_undegraded":"2024-04-12T19:39:18.962266+0000","last_fullsized":"2024-04-12T19:39:18.962266+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:11:49.476183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489727+0000","last_change":"2024-04-12T19:39:16.137131+0000","last_active":"2024-04-12T19:39:17.489727+0000","last_peered":"2024-04-12T19:39:17.489727+0000","last_clean":"2024-04-12T19:39:17.489727+0000","last_became_active":"2024-04-12T19:39:16.136171+0000","last_became_peered":"2024-04-12T19:39:16.136171+0000","last_unstale":"2024-04-12T19:39:17.489727+0000","last_undegraded":"2024-04-12T19:39:17.489727+0000","last_fullsized":"2024-04-12T19:39:17.489727+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:56:53.325064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495120+0000","last_change":"2024-04-12T19:39:11.476364+0000","last_active":"2024-04-12T19:39:18.495120+0000","last_peered":"2024-04-12T19:39:18.495120+0000","last_clean":"2024-04-12T19:39:18.495120+0000","last_became_active":"2024-04-12T19:39:11.476024+0000","last_became_peered":"2024-04-12T19:39:11.476024+0000","last_unstale":"2024-04-12T19:39:18.495120+0000","last_undegraded":"2024-04-12T19:39:18.495120+0000","last_fullsized":"2024-04-12T19:39:18.495120+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:45:10.487944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492470+0000","last_change":"2024-04-12T19:39:10.433299+0000","last_active":"2024-04-12T19:39:17.492470+0000","last_peered":"2024-04-12T19:39:17.492470+0000","last_clean":"2024-04-12T19:39:17.492470+0000","last_became_active":"2024-04-12T19:39:10.432858+0000","last_became_peered":"2024-04-12T19:39:10.432858+0000","last_unstale":"2024-04-12T19:39:17.492470+0000","last_undegraded":"2024-04-12T19:39:17.492470+0000","last_fullsized":"2024-04-12T19:39:17.492470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T04:00:24.899000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490231+0000","last_change":"2024-04-12T19:39:15.520112+0000","last_active":"2024-04-12T19:39:17.490231+0000","last_peered":"2024-04-12T19:39:17.490231+0000","last_clean":"2024-04-12T19:39:17.490231+0000","last_became_active":"2024-04-12T19:39:15.519631+0000","last_became_peered":"2024-04-12T19:39:15.519631+0000","last_unstale":"2024-04-12T19:39:17.490231+0000","last_undegraded":"2024-04-12T19:39:17.490231+0000","last_fullsized":"2024-04-12T19:39:17.490231+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:45:14.554860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494051+0000","last_change":"2024-04-12T19:39:11.472849+0000","last_active":"2024-04-12T19:39:18.494051+0000","last_peered":"2024-04-12T19:39:18.494051+0000","last_clean":"2024-04-12T19:39:18.494051+0000","last_became_active":"2024-04-12T19:39:11.472506+0000","last_became_peered":"2024-04-12T19:39:11.472506+0000","last_unstale":"2024-04-12T19:39:18.494051+0000","last_undegraded":"2024-04-12T19:39:18.494051+0000","last_fullsized":"2024-04-12T19:39:18.494051+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:21:53.745025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962167+0000","last_change":"2024-04-12T19:39:10.434547+0000","last_active":"2024-04-12T19:39:18.962167+0000","last_peered":"2024-04-12T19:39:18.962167+0000","last_clean":"2024-04-12T19:39:18.962167+0000","last_became_active":"2024-04-12T19:39:10.433054+0000","last_became_peered":"2024-04-12T19:39:10.433054+0000","last_unstale":"2024-04-12T19:39:18.962167+0000","last_undegraded":"2024-04-12T19:39:18.962167+0000","last_fullsized":"2024-04-12T19:39:18.962167+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:35:32.075423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585816+0000","last_change":"2024-04-12T19:39:15.516082+0000","last_active":"2024-04-12T19:39:18.585816+0000","last_peered":"2024-04-12T19:39:18.585816+0000","last_clean":"2024-04-12T19:39:18.585816+0000","last_became_active":"2024-04-12T19:39:15.515321+0000","last_became_peered":"2024-04-12T19:39:15.515321+0000","last_unstale":"2024-04-12T19:39:18.585816+0000","last_undegraded":"2024-04-12T19:39:18.585816+0000","last_fullsized":"2024-04-12T19:39:18.585816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:12:45.261630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174564+0000","last_change":"2024-04-12T19:39:11.468548+0000","last_active":"2024-04-12T19:39:18.174564+0000","last_peered":"2024-04-12T19:39:18.174564+0000","last_clean":"2024-04-12T19:39:18.174564+0000","last_became_active":"2024-04-12T19:39:11.468141+0000","last_became_peered":"2024-04-12T19:39:11.468141+0000","last_unstale":"2024-04-12T19:39:18.174564+0000","last_undegraded":"2024-04-12T19:39:18.174564+0000","last_fullsized":"2024-04-12T19:39:18.174564+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174038+0000","last_change":"2024-04-12T19:39:10.444137+0000","last_active":"2024-04-12T19:39:18.174038+0000","last_peered":"2024-04-12T19:39:18.174038+0000","last_clean":"2024-04-12T19:39:18.174038+0000","last_became_active":"2024-04-12T19:39:10.442731+0000","last_became_peered":"2024-04-12T19:39:10.442731+0000","last_unstale":"2024-04-12T19:39:18.174038+0000","last_undegraded":"2024-04-12T19:39:18.174038+0000","last_fullsized":"2024-04-12T19:39:18.174038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:19:09.670101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489001+0000","last_change":"2024-04-12T19:39:16.126978+0000","last_active":"2024-04-12T19:39:17.489001+0000","last_peered":"2024-04-12T19:39:17.489001+0000","last_clean":"2024-04-12T19:39:17.489001+0000","last_became_active":"2024-04-12T19:39:16.125687+0000","last_became_peered":"2024-04-12T19:39:16.125687+0000","last_unstale":"2024-04-12T19:39:17.489001+0000","last_undegraded":"2024-04-12T19:39:17.489001+0000","last_fullsized":"2024-04-12T19:39:17.489001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:07:45.787032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493681+0000","last_change":"2024-04-12T19:39:11.478082+0000","last_active":"2024-04-12T19:39:18.493681+0000","last_peered":"2024-04-12T19:39:18.493681+0000","last_clean":"2024-04-12T19:39:18.493681+0000","last_became_active":"2024-04-12T19:39:11.471563+0000","last_became_peered":"2024-04-12T19:39:11.471563+0000","last_unstale":"2024-04-12T19:39:18.493681+0000","last_undegraded":"2024-04-12T19:39:18.493681+0000","last_fullsized":"2024-04-12T19:39:18.493681+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:05:52.600930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491596+0000","last_change":"2024-04-12T19:39:10.443036+0000","last_active":"2024-04-12T19:39:17.491596+0000","last_peered":"2024-04-12T19:39:17.491596+0000","last_clean":"2024-04-12T19:39:17.491596+0000","last_became_active":"2024-04-12T19:39:10.442763+0000","last_became_peered":"2024-04-12T19:39:10.442763+0000","last_unstale":"2024-04-12T19:39:17.491596+0000","last_undegraded":"2024-04-12T19:39:17.491596+0000","last_fullsized":"2024-04-12T19:39:17.491596+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488661+0000","last_change":"2024-04-12T19:39:16.123073+0000","last_active":"2024-04-12T19:39:17.488661+0000","last_peered":"2024-04-12T19:39:17.488661+0000","last_clean":"2024-04-12T19:39:17.488661+0000","last_became_active":"2024-04-12T19:39:16.120993+0000","last_became_peered":"2024-04-12T19:39:16.120993+0000","last_unstale":"2024-04-12T19:39:17.488661+0000","last_undegraded":"2024-04-12T19:39:17.488661+0000","last_fullsized":"2024-04-12T19:39:17.488661+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:44:14.241958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585081+0000","last_change":"2024-04-12T19:39:11.466277+0000","last_active":"2024-04-12T19:39:18.585081+0000","last_peered":"2024-04-12T19:39:18.585081+0000","last_clean":"2024-04-12T19:39:18.585081+0000","last_became_active":"2024-04-12T19:39:11.465998+0000","last_became_peered":"2024-04-12T19:39:11.465998+0000","last_unstale":"2024-04-12T19:39:18.585081+0000","last_undegraded":"2024-04-12T19:39:18.585081+0000","last_fullsized":"2024-04-12T19:39:18.585081+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.583818+0000","last_change":"2024-04-12T19:39:10.430339+0000","last_active":"2024-04-12T19:39:18.583818+0000","last_peered":"2024-04-12T19:39:18.583818+0000","last_clean":"2024-04-12T19:39:18.583818+0000","last_became_active":"2024-04-12T19:39:10.430059+0000","last_became_peered":"2024-04-12T19:39:10.430059+0000","last_unstale":"2024-04-12T19:39:18.583818+0000","last_undegraded":"2024-04-12T19:39:18.583818+0000","last_fullsized":"2024-04-12T19:39:18.583818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:59:25.400930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493660+0000","last_change":"2024-04-12T19:39:16.129872+0000","last_active":"2024-04-12T19:39:17.493660+0000","last_peered":"2024-04-12T19:39:17.493660+0000","last_clean":"2024-04-12T19:39:17.493660+0000","last_became_active":"2024-04-12T19:39:16.127095+0000","last_became_peered":"2024-04-12T19:39:16.127095+0000","last_unstale":"2024-04-12T19:39:17.493660+0000","last_undegraded":"2024-04-12T19:39:17.493660+0000","last_fullsized":"2024-04-12T19:39:17.493660+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:27:00.174133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494610+0000","last_change":"2024-04-12T19:39:11.479072+0000","last_active":"2024-04-12T19:39:18.494610+0000","last_peered":"2024-04-12T19:39:18.494610+0000","last_clean":"2024-04-12T19:39:18.494610+0000","last_became_active":"2024-04-12T19:39:11.478779+0000","last_became_peered":"2024-04-12T19:39:11.478779+0000","last_unstale":"2024-04-12T19:39:18.494610+0000","last_undegraded":"2024-04-12T19:39:18.494610+0000","last_fullsized":"2024-04-12T19:39:18.494610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'10","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:29.380470+0000","last_change":"2024-04-12T19:39:10.443760+0000","last_active":"2024-04-12T19:39:29.380470+0000","last_peered":"2024-04-12T19:39:29.380470+0000","last_clean":"2024-04-12T19:39:29.380470+0000","last_became_active":"2024-04-12T19:39:10.443031+0000","last_became_peered":"2024-04-12T19:39:10.443031+0000","last_unstale":"2024-04-12T19:39:29.380470+0000","last_undegraded":"2024-04-12T19:39:29.380470+0000","last_fullsized":"2024-04-12T19:39:29.380470+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:31.828574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103735+0000","last_change":"2024-04-12T19:39:15.521287+0000","last_active":"2024-04-12T19:39:18.103735+0000","last_peered":"2024-04-12T19:39:18.103735+0000","last_clean":"2024-04-12T19:39:18.103735+0000","last_became_active":"2024-04-12T19:39:15.519545+0000","last_became_peered":"2024-04-12T19:39:15.519545+0000","last_unstale":"2024-04-12T19:39:18.103735+0000","last_undegraded":"2024-04-12T19:39:18.103735+0000","last_fullsized":"2024-04-12T19:39:18.103735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:02:18.119234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491496+0000","last_change":"2024-04-12T19:39:11.467693+0000","last_active":"2024-04-12T19:39:17.491496+0000","last_peered":"2024-04-12T19:39:17.491496+0000","last_clean":"2024-04-12T19:39:17.491496+0000","last_became_active":"2024-04-12T19:39:11.467283+0000","last_became_peered":"2024-04-12T19:39:11.467283+0000","last_unstale":"2024-04-12T19:39:17.491496+0000","last_undegraded":"2024-04-12T19:39:17.491496+0000","last_fullsized":"2024-04-12T19:39:17.491496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:52.447954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":26,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104456+0000","last_change":"2024-04-12T19:39:10.440386+0000","last_active":"2024-04-12T19:39:18.104456+0000","last_peered":"2024-04-12T19:39:18.104456+0000","last_clean":"2024-04-12T19:39:18.104456+0000","last_became_active":"2024-04-12T19:39:10.439567+0000","last_became_peered":"2024-04-12T19:39:10.439567+0000","last_unstale":"2024-04-12T19:39:18.104456+0000","last_undegraded":"2024-04-12T19:39:18.104456+0000","last_fullsized":"2024-04-12T19:39:18.104456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:51.431359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493139+0000","last_change":"2024-04-12T19:39:15.511609+0000","last_active":"2024-04-12T19:39:17.493139+0000","last_peered":"2024-04-12T19:39:17.493139+0000","last_clean":"2024-04-12T19:39:17.493139+0000","last_became_active":"2024-04-12T19:39:15.511178+0000","last_became_peered":"2024-04-12T19:39:15.511178+0000","last_unstale":"2024-04-12T19:39:17.493139+0000","last_undegraded":"2024-04-12T19:39:17.493139+0000","last_fullsized":"2024-04-12T19:39:17.493139+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:12:45.261630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585669+0000","last_change":"2024-04-12T19:39:11.468760+0000","last_active":"2024-04-12T19:39:18.585669+0000","last_peered":"2024-04-12T19:39:18.585669+0000","last_clean":"2024-04-12T19:39:18.585669+0000","last_became_active":"2024-04-12T19:39:11.468126+0000","last_became_peered":"2024-04-12T19:39:11.468126+0000","last_unstale":"2024-04-12T19:39:18.585669+0000","last_undegraded":"2024-04-12T19:39:18.585669+0000","last_fullsized":"2024-04-12T19:39:18.585669+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:18:45.626616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493459+0000","last_change":"2024-04-12T19:39:10.440768+0000","last_active":"2024-04-12T19:39:17.493459+0000","last_peered":"2024-04-12T19:39:17.493459+0000","last_clean":"2024-04-12T19:39:17.493459+0000","last_became_active":"2024-04-12T19:39:10.440480+0000","last_became_peered":"2024-04-12T19:39:10.440480+0000","last_unstale":"2024-04-12T19:39:17.493459+0000","last_undegraded":"2024-04-12T19:39:17.493459+0000","last_fullsized":"2024-04-12T19:39:17.493459+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:51.431359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487735+0000","last_change":"2024-04-12T19:39:15.509729+0000","last_active":"2024-04-12T19:39:17.487735+0000","last_peered":"2024-04-12T19:39:17.487735+0000","last_clean":"2024-04-12T19:39:17.487735+0000","last_became_active":"2024-04-12T19:39:15.509283+0000","last_became_peered":"2024-04-12T19:39:15.509283+0000","last_unstale":"2024-04-12T19:39:17.487735+0000","last_undegraded":"2024-04-12T19:39:17.487735+0000","last_fullsized":"2024-04-12T19:39:17.487735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:26:05.519893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493270+0000","last_change":"2024-04-12T19:39:11.460136+0000","last_active":"2024-04-12T19:39:17.493270+0000","last_peered":"2024-04-12T19:39:17.493270+0000","last_clean":"2024-04-12T19:39:17.493270+0000","last_became_active":"2024-04-12T19:39:11.459732+0000","last_became_peered":"2024-04-12T19:39:11.459732+0000","last_unstale":"2024-04-12T19:39:17.493270+0000","last_undegraded":"2024-04-12T19:39:17.493270+0000","last_fullsized":"2024-04-12T19:39:17.493270+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:40:00.108398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174891+0000","last_change":"2024-04-12T19:39:10.445173+0000","last_active":"2024-04-12T19:39:18.174891+0000","last_peered":"2024-04-12T19:39:18.174891+0000","last_clean":"2024-04-12T19:39:18.174891+0000","last_became_active":"2024-04-12T19:39:10.444515+0000","last_became_peered":"2024-04-12T19:39:10.444515+0000","last_unstale":"2024-04-12T19:39:18.174891+0000","last_undegraded":"2024-04-12T19:39:18.174891+0000","last_fullsized":"2024-04-12T19:39:18.174891+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:11:49.476183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487760+0000","last_change":"2024-04-12T19:39:16.127728+0000","last_active":"2024-04-12T19:39:17.487760+0000","last_peered":"2024-04-12T19:39:17.487760+0000","last_clean":"2024-04-12T19:39:17.487760+0000","last_became_active":"2024-04-12T19:39:16.125486+0000","last_became_peered":"2024-04-12T19:39:16.125486+0000","last_unstale":"2024-04-12T19:39:17.487760+0000","last_undegraded":"2024-04-12T19:39:17.487760+0000","last_fullsized":"2024-04-12T19:39:17.487760+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:28:14.853197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585755+0000","last_change":"2024-04-12T19:39:16.133052+0000","last_active":"2024-04-12T19:39:18.585755+0000","last_peered":"2024-04-12T19:39:18.585755+0000","last_clean":"2024-04-12T19:39:18.585755+0000","last_became_active":"2024-04-12T19:39:16.130388+0000","last_became_peered":"2024-04-12T19:39:16.130388+0000","last_unstale":"2024-04-12T19:39:18.585755+0000","last_undegraded":"2024-04-12T19:39:18.585755+0000","last_fullsized":"2024-04-12T19:39:18.585755+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T20:02:18.119234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103422+0000","last_change":"2024-04-12T19:39:11.461191+0000","last_active":"2024-04-12T19:39:18.103422+0000","last_peered":"2024-04-12T19:39:18.103422+0000","last_clean":"2024-04-12T19:39:18.103422+0000","last_became_active":"2024-04-12T19:39:11.460841+0000","last_became_peered":"2024-04-12T19:39:11.460841+0000","last_unstale":"2024-04-12T19:39:18.103422+0000","last_undegraded":"2024-04-12T19:39:18.103422+0000","last_fullsized":"2024-04-12T19:39:18.103422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489885+0000","last_change":"2024-04-12T19:39:10.430054+0000","last_active":"2024-04-12T19:39:17.489885+0000","last_peered":"2024-04-12T19:39:17.489885+0000","last_clean":"2024-04-12T19:39:17.489885+0000","last_became_active":"2024-04-12T19:39:10.429693+0000","last_became_peered":"2024-04-12T19:39:10.429693+0000","last_unstale":"2024-04-12T19:39:17.489885+0000","last_undegraded":"2024-04-12T19:39:17.489885+0000","last_fullsized":"2024-04-12T19:39:17.489885+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:51.462272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174774+0000","last_change":"2024-04-12T19:39:15.521261+0000","last_active":"2024-04-12T19:39:18.174774+0000","last_peered":"2024-04-12T19:39:18.174774+0000","last_clean":"2024-04-12T19:39:18.174774+0000","last_became_active":"2024-04-12T19:39:15.520618+0000","last_became_peered":"2024-04-12T19:39:15.520618+0000","last_unstale":"2024-04-12T19:39:18.174774+0000","last_undegraded":"2024-04-12T19:39:18.174774+0000","last_fullsized":"2024-04-12T19:39:18.174774+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:52:41.709345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487629+0000","last_change":"2024-04-12T19:39:11.470231+0000","last_active":"2024-04-12T19:39:17.487629+0000","last_peered":"2024-04-12T19:39:17.487629+0000","last_clean":"2024-04-12T19:39:17.487629+0000","last_became_active":"2024-04-12T19:39:11.469814+0000","last_became_peered":"2024-04-12T19:39:11.469814+0000","last_unstale":"2024-04-12T19:39:17.487629+0000","last_undegraded":"2024-04-12T19:39:17.487629+0000","last_fullsized":"2024-04-12T19:39:17.487629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488012+0000","last_change":"2024-04-12T19:39:10.441115+0000","last_active":"2024-04-12T19:39:17.488012+0000","last_peered":"2024-04-12T19:39:17.488012+0000","last_clean":"2024-04-12T19:39:17.488012+0000","last_became_active":"2024-04-12T19:39:10.440755+0000","last_became_peered":"2024-04-12T19:39:10.440755+0000","last_unstale":"2024-04-12T19:39:17.488012+0000","last_undegraded":"2024-04-12T19:39:17.488012+0000","last_fullsized":"2024-04-12T19:39:17.488012+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:25:54.417979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174166+0000","last_change":"2024-04-12T19:39:10.441520+0000","last_active":"2024-04-12T19:39:18.174166+0000","last_peered":"2024-04-12T19:39:18.174166+0000","last_clean":"2024-04-12T19:39:18.174166+0000","last_became_active":"2024-04-12T19:39:10.441219+0000","last_became_peered":"2024-04-12T19:39:10.441219+0000","last_unstale":"2024-04-12T19:39:18.174166+0000","last_undegraded":"2024-04-12T19:39:18.174166+0000","last_fullsized":"2024-04-12T19:39:18.174166+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:26:32.829003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585328+0000","last_change":"2024-04-12T19:39:11.460915+0000","last_active":"2024-04-12T19:39:18.585328+0000","last_peered":"2024-04-12T19:39:18.585328+0000","last_clean":"2024-04-12T19:39:18.585328+0000","last_became_active":"2024-04-12T19:39:11.460672+0000","last_became_peered":"2024-04-12T19:39:11.460672+0000","last_unstale":"2024-04-12T19:39:18.585328+0000","last_undegraded":"2024-04-12T19:39:18.585328+0000","last_fullsized":"2024-04-12T19:39:18.585328+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:10:44.776087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.963253+0000","last_change":"2024-04-12T19:39:15.512665+0000","last_active":"2024-04-12T19:39:18.963253+0000","last_peered":"2024-04-12T19:39:18.963253+0000","last_clean":"2024-04-12T19:39:18.963253+0000","last_became_active":"2024-04-12T19:39:15.512224+0000","last_became_peered":"2024-04-12T19:39:15.512224+0000","last_unstale":"2024-04-12T19:39:18.963253+0000","last_undegraded":"2024-04-12T19:39:18.963253+0000","last_fullsized":"2024-04-12T19:39:18.963253+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:18:49.693531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488497+0000","last_change":"2024-04-12T19:39:10.446078+0000","last_active":"2024-04-12T19:39:17.488497+0000","last_peered":"2024-04-12T19:39:17.488497+0000","last_clean":"2024-04-12T19:39:17.488497+0000","last_became_active":"2024-04-12T19:39:10.445778+0000","last_became_peered":"2024-04-12T19:39:10.445778+0000","last_unstale":"2024-04-12T19:39:17.488497+0000","last_undegraded":"2024-04-12T19:39:17.488497+0000","last_fullsized":"2024-04-12T19:39:17.488497+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:09.376460+0000","last_clean_scrub_stamp":"2024-04-12T19:39:09.376460+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:59:25.400930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.492269+0000","last_change":"2024-04-12T19:39:11.455047+0000","last_active":"2024-04-12T19:39:17.492269+0000","last_peered":"2024-04-12T19:39:17.492269+0000","last_clean":"2024-04-12T19:39:17.492269+0000","last_became_active":"2024-04-12T19:39:11.454646+0000","last_became_peered":"2024-04-12T19:39:11.454646+0000","last_unstale":"2024-04-12T19:39:17.492269+0000","last_undegraded":"2024-04-12T19:39:17.492269+0000","last_fullsized":"2024-04-12T19:39:17.492269+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:52.478867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":17,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488924+0000","last_change":"2024-04-12T19:39:15.513691+0000","last_active":"2024-04-12T19:39:17.488924+0000","last_peered":"2024-04-12T19:39:17.488924+0000","last_clean":"2024-04-12T19:39:17.488924+0000","last_became_active":"2024-04-12T19:39:15.513269+0000","last_became_peered":"2024-04-12T19:39:15.513269+0000","last_unstale":"2024-04-12T19:39:17.488924+0000","last_undegraded":"2024-04-12T19:39:17.488924+0000","last_fullsized":"2024-04-12T19:39:17.488924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:14.459971+0000","last_clean_scrub_stamp":"2024-04-12T19:39:14.459971+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:40:26.732234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.173537+0000","last_change":"2024-04-12T19:39:11.468368+0000","last_active":"2024-04-12T19:39:18.173537+0000","last_peered":"2024-04-12T19:39:18.173537+0000","last_clean":"2024-04-12T19:39:18.173537+0000","last_became_active":"2024-04-12T19:39:11.467807+0000","last_became_peered":"2024-04-12T19:39:11.467807+0000","last_unstale":"2024-04-12T19:39:18.173537+0000","last_undegraded":"2024-04-12T19:39:18.173537+0000","last_fullsized":"2024-04-12T19:39:18.173537+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:55:09.781797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.962714+0000","last_change":"2024-04-12T19:39:11.464628+0000","last_active":"2024-04-12T19:39:18.962714+0000","last_peered":"2024-04-12T19:39:18.962714+0000","last_clean":"2024-04-12T19:39:18.962714+0000","last_became_active":"2024-04-12T19:39:11.464333+0000","last_became_peered":"2024-04-12T19:39:11.464333+0000","last_unstale":"2024-04-12T19:39:18.962714+0000","last_undegraded":"2024-04-12T19:39:18.962714+0000","last_fullsized":"2024-04-12T19:39:18.962714+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:03:52.447954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491395+0000","last_change":"2024-04-12T19:39:11.480027+0000","last_active":"2024-04-12T19:39:17.491395+0000","last_peered":"2024-04-12T19:39:17.491395+0000","last_clean":"2024-04-12T19:39:17.491395+0000","last_became_active":"2024-04-12T19:39:11.479816+0000","last_became_peered":"2024-04-12T19:39:11.479816+0000","last_unstale":"2024-04-12T19:39:17.491395+0000","last_undegraded":"2024-04-12T19:39:17.491395+0000","last_fullsized":"2024-04-12T19:39:17.491395+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:45:10.487944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585208+0000","last_change":"2024-04-12T19:39:11.475058+0000","last_active":"2024-04-12T19:39:18.585208+0000","last_peered":"2024-04-12T19:39:18.585208+0000","last_clean":"2024-04-12T19:39:18.585208+0000","last_became_active":"2024-04-12T19:39:11.474706+0000","last_became_peered":"2024-04-12T19:39:11.474706+0000","last_unstale":"2024-04-12T19:39:18.585208+0000","last_undegraded":"2024-04-12T19:39:18.585208+0000","last_fullsized":"2024-04-12T19:39:18.585208+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:55:09.781797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488726+0000","last_change":"2024-04-12T19:39:11.476138+0000","last_active":"2024-04-12T19:39:17.488726+0000","last_peered":"2024-04-12T19:39:17.488726+0000","last_clean":"2024-04-12T19:39:17.488726+0000","last_became_active":"2024-04-12T19:39:11.473857+0000","last_became_peered":"2024-04-12T19:39:11.473857+0000","last_unstale":"2024-04-12T19:39:17.488726+0000","last_undegraded":"2024-04-12T19:39:17.488726+0000","last_fullsized":"2024-04-12T19:39:17.488726+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:40:00.108398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104371+0000","last_change":"2024-04-12T19:39:11.471824+0000","last_active":"2024-04-12T19:39:18.104371+0000","last_peered":"2024-04-12T19:39:18.104371+0000","last_clean":"2024-04-12T19:39:18.104371+0000","last_became_active":"2024-04-12T19:39:11.471316+0000","last_became_peered":"2024-04-12T19:39:11.471316+0000","last_unstale":"2024-04-12T19:39:18.104371+0000","last_undegraded":"2024-04-12T19:39:18.104371+0000","last_fullsized":"2024-04-12T19:39:18.104371+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T02:41:15.426654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175088+0000","last_change":"2024-04-12T19:39:11.477664+0000","last_active":"2024-04-12T19:39:18.175088+0000","last_peered":"2024-04-12T19:39:18.175088+0000","last_clean":"2024-04-12T19:39:18.175088+0000","last_became_active":"2024-04-12T19:39:11.477400+0000","last_became_peered":"2024-04-12T19:39:11.477400+0000","last_unstale":"2024-04-12T19:39:18.175088+0000","last_undegraded":"2024-04-12T19:39:18.175088+0000","last_fullsized":"2024-04-12T19:39:18.175088+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489032+0000","last_change":"2024-04-12T19:39:11.473661+0000","last_active":"2024-04-12T19:39:17.489032+0000","last_peered":"2024-04-12T19:39:17.489032+0000","last_clean":"2024-04-12T19:39:17.489032+0000","last_became_active":"2024-04-12T19:39:11.473335+0000","last_became_peered":"2024-04-12T19:39:11.473335+0000","last_unstale":"2024-04-12T19:39:17.489032+0000","last_undegraded":"2024-04-12T19:39:17.489032+0000","last_fullsized":"2024-04-12T19:39:17.489032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489785+0000","last_change":"2024-04-12T19:39:11.480192+0000","last_active":"2024-04-12T19:39:17.489785+0000","last_peered":"2024-04-12T19:39:17.489785+0000","last_clean":"2024-04-12T19:39:17.489785+0000","last_became_active":"2024-04-12T19:39:11.479845+0000","last_became_peered":"2024-04-12T19:39:11.479845+0000","last_unstale":"2024-04-12T19:39:17.489785+0000","last_undegraded":"2024-04-12T19:39:17.489785+0000","last_fullsized":"2024-04-12T19:39:17.489785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:25:40.049195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487952+0000","last_change":"2024-04-12T19:39:11.459940+0000","last_active":"2024-04-12T19:39:17.487952+0000","last_peered":"2024-04-12T19:39:17.487952+0000","last_clean":"2024-04-12T19:39:17.487952+0000","last_became_active":"2024-04-12T19:39:11.459403+0000","last_became_peered":"2024-04-12T19:39:11.459403+0000","last_unstale":"2024-04-12T19:39:17.487952+0000","last_undegraded":"2024-04-12T19:39:17.487952+0000","last_fullsized":"2024-04-12T19:39:17.487952+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T19:55:09.781797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491159+0000","last_change":"2024-04-12T19:39:11.457187+0000","last_active":"2024-04-12T19:39:17.491159+0000","last_peered":"2024-04-12T19:39:17.491159+0000","last_clean":"2024-04-12T19:39:17.491159+0000","last_became_active":"2024-04-12T19:39:11.456859+0000","last_became_peered":"2024-04-12T19:39:11.456859+0000","last_unstale":"2024-04-12T19:39:17.491159+0000","last_undegraded":"2024-04-12T19:39:17.491159+0000","last_fullsized":"2024-04-12T19:39:17.491159+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:05:52.600930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585047+0000","last_change":"2024-04-12T19:39:11.465043+0000","last_active":"2024-04-12T19:39:18.585047+0000","last_peered":"2024-04-12T19:39:18.585047+0000","last_clean":"2024-04-12T19:39:18.585047+0000","last_became_active":"2024-04-12T19:39:11.464724+0000","last_became_peered":"2024-04-12T19:39:11.464724+0000","last_unstale":"2024-04-12T19:39:18.585047+0000","last_undegraded":"2024-04-12T19:39:18.585047+0000","last_fullsized":"2024-04-12T19:39:18.585047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T03:01:20.477813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174218+0000","last_change":"2024-04-12T19:39:11.473208+0000","last_active":"2024-04-12T19:39:18.174218+0000","last_peered":"2024-04-12T19:39:18.174218+0000","last_clean":"2024-04-12T19:39:18.174218+0000","last_became_active":"2024-04-12T19:39:11.472752+0000","last_became_peered":"2024-04-12T19:39:11.472752+0000","last_unstale":"2024-04-12T19:39:18.174218+0000","last_undegraded":"2024-04-12T19:39:18.174218+0000","last_fullsized":"2024-04-12T19:39:18.174218+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:10:44.776087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495278+0000","last_change":"2024-04-12T19:39:11.461738+0000","last_active":"2024-04-12T19:39:18.495278+0000","last_peered":"2024-04-12T19:39:18.495278+0000","last_clean":"2024-04-12T19:39:18.495278+0000","last_became_active":"2024-04-12T19:39:11.461456+0000","last_became_peered":"2024-04-12T19:39:11.461456+0000","last_unstale":"2024-04-12T19:39:18.495278+0000","last_undegraded":"2024-04-12T19:39:18.495278+0000","last_fullsized":"2024-04-12T19:39:18.495278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:22:57.956770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.963582+0000","last_change":"2024-04-12T19:39:11.468295+0000","last_active":"2024-04-12T19:39:18.963582+0000","last_peered":"2024-04-12T19:39:18.963582+0000","last_clean":"2024-04-12T19:39:18.963582+0000","last_became_active":"2024-04-12T19:39:11.468002+0000","last_became_peered":"2024-04-12T19:39:11.468002+0000","last_unstale":"2024-04-12T19:39:18.963582+0000","last_undegraded":"2024-04-12T19:39:18.963582+0000","last_fullsized":"2024-04-12T19:39:18.963582+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:59:16.676989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.494704+0000","last_change":"2024-04-12T19:39:11.457117+0000","last_active":"2024-04-12T19:39:17.494704+0000","last_peered":"2024-04-12T19:39:17.494704+0000","last_clean":"2024-04-12T19:39:17.494704+0000","last_became_active":"2024-04-12T19:39:11.456714+0000","last_became_peered":"2024-04-12T19:39:11.456714+0000","last_unstale":"2024-04-12T19:39:17.494704+0000","last_undegraded":"2024-04-12T19:39:17.494704+0000","last_fullsized":"2024-04-12T19:39:17.494704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:22:57.956770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.489510+0000","last_change":"2024-04-12T19:39:11.456585+0000","last_active":"2024-04-12T19:39:17.489510+0000","last_peered":"2024-04-12T19:39:17.489510+0000","last_clean":"2024-04-12T19:39:17.489510+0000","last_became_active":"2024-04-12T19:39:11.453931+0000","last_became_peered":"2024-04-12T19:39:11.453931+0000","last_unstale":"2024-04-12T19:39:17.489510+0000","last_undegraded":"2024-04-12T19:39:17.489510+0000","last_fullsized":"2024-04-12T19:39:17.489510+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T21:14:19.833504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.103665+0000","last_change":"2024-04-12T19:39:11.445513+0000","last_active":"2024-04-12T19:39:18.103665+0000","last_peered":"2024-04-12T19:39:18.103665+0000","last_clean":"2024-04-12T19:39:18.103665+0000","last_became_active":"2024-04-12T19:39:11.445149+0000","last_became_peered":"2024-04-12T19:39:11.445149+0000","last_unstale":"2024-04-12T19:39:18.103665+0000","last_undegraded":"2024-04-12T19:39:18.103665+0000","last_fullsized":"2024-04-12T19:39:18.103665+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585076+0000","last_change":"2024-04-12T19:39:11.457130+0000","last_active":"2024-04-12T19:39:18.585076+0000","last_peered":"2024-04-12T19:39:18.585076+0000","last_clean":"2024-04-12T19:39:18.585076+0000","last_became_active":"2024-04-12T19:39:11.456787+0000","last_became_peered":"2024-04-12T19:39:11.456787+0000","last_unstale":"2024-04-12T19:39:18.585076+0000","last_undegraded":"2024-04-12T19:39:18.585076+0000","last_fullsized":"2024-04-12T19:39:18.585076+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.488357+0000","last_change":"2024-04-12T19:39:11.474356+0000","last_active":"2024-04-12T19:39:17.488357+0000","last_peered":"2024-04-12T19:39:17.488357+0000","last_clean":"2024-04-12T19:39:17.488357+0000","last_became_active":"2024-04-12T19:39:11.474021+0000","last_became_peered":"2024-04-12T19:39:11.474021+0000","last_unstale":"2024-04-12T19:39:17.488357+0000","last_undegraded":"2024-04-12T19:39:17.488357+0000","last_fullsized":"2024-04-12T19:39:17.488357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.491247+0000","last_change":"2024-04-12T19:39:11.472738+0000","last_active":"2024-04-12T19:39:17.491247+0000","last_peered":"2024-04-12T19:39:17.491247+0000","last_clean":"2024-04-12T19:39:17.491247+0000","last_became_active":"2024-04-12T19:39:11.472424+0000","last_became_peered":"2024-04-12T19:39:11.472424+0000","last_unstale":"2024-04-12T19:39:17.491247+0000","last_undegraded":"2024-04-12T19:39:17.491247+0000","last_fullsized":"2024-04-12T19:39:17.491247+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T06:50:32.845169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.174515+0000","last_change":"2024-04-12T19:39:11.468484+0000","last_active":"2024-04-12T19:39:18.174515+0000","last_peered":"2024-04-12T19:39:18.174515+0000","last_clean":"2024-04-12T19:39:18.174515+0000","last_became_active":"2024-04-12T19:39:11.468078+0000","last_became_peered":"2024-04-12T19:39:11.468078+0000","last_unstale":"2024-04-12T19:39:18.174515+0000","last_undegraded":"2024-04-12T19:39:18.174515+0000","last_fullsized":"2024-04-12T19:39:18.174515+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:55:18.186987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.175012+0000","last_change":"2024-04-12T19:39:11.470836+0000","last_active":"2024-04-12T19:39:18.175012+0000","last_peered":"2024-04-12T19:39:18.175012+0000","last_clean":"2024-04-12T19:39:18.175012+0000","last_became_active":"2024-04-12T19:39:11.470569+0000","last_became_peered":"2024-04-12T19:39:11.470569+0000","last_unstale":"2024-04-12T19:39:18.175012+0000","last_undegraded":"2024-04-12T19:39:18.175012+0000","last_fullsized":"2024-04-12T19:39:18.175012+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.495253+0000","last_change":"2024-04-12T19:39:11.479266+0000","last_active":"2024-04-12T19:39:18.495253+0000","last_peered":"2024-04-12T19:39:18.495253+0000","last_clean":"2024-04-12T19:39:18.495253+0000","last_became_active":"2024-04-12T19:39:11.479025+0000","last_became_peered":"2024-04-12T19:39:11.479025+0000","last_unstale":"2024-04-12T19:39:18.495253+0000","last_undegraded":"2024-04-12T19:39:18.495253+0000","last_fullsized":"2024-04-12T19:39:18.495253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:05:26.512414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.487468+0000","last_change":"2024-04-12T19:39:11.477102+0000","last_active":"2024-04-12T19:39:17.487468+0000","last_peered":"2024-04-12T19:39:17.487468+0000","last_clean":"2024-04-12T19:39:17.487468+0000","last_became_active":"2024-04-12T19:39:11.476734+0000","last_became_peered":"2024-04-12T19:39:11.476734+0000","last_unstale":"2024-04-12T19:39:17.487468+0000","last_undegraded":"2024-04-12T19:39:17.487468+0000","last_fullsized":"2024-04-12T19:39:17.487468+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T23:10:44.776087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493741+0000","last_change":"2024-04-12T19:39:11.457154+0000","last_active":"2024-04-12T19:39:18.493741+0000","last_peered":"2024-04-12T19:39:18.493741+0000","last_clean":"2024-04-12T19:39:18.493741+0000","last_became_active":"2024-04-12T19:39:11.456829+0000","last_became_peered":"2024-04-12T19:39:11.456829+0000","last_unstale":"2024-04-12T19:39:18.493741+0000","last_undegraded":"2024-04-12T19:39:18.493741+0000","last_fullsized":"2024-04-12T19:39:18.493741+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:40:00.108398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.490869+0000","last_change":"2024-04-12T19:39:11.457995+0000","last_active":"2024-04-12T19:39:17.490869+0000","last_peered":"2024-04-12T19:39:17.490869+0000","last_clean":"2024-04-12T19:39:17.490869+0000","last_became_active":"2024-04-12T19:39:11.457611+0000","last_became_peered":"2024-04-12T19:39:11.457611+0000","last_unstale":"2024-04-12T19:39:17.490869+0000","last_undegraded":"2024-04-12T19:39:17.490869+0000","last_fullsized":"2024-04-12T19:39:17.490869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:10:23.931286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.493427+0000","last_change":"2024-04-12T19:39:11.458277+0000","last_active":"2024-04-12T19:39:18.493427+0000","last_peered":"2024-04-12T19:39:18.493427+0000","last_clean":"2024-04-12T19:39:18.493427+0000","last_became_active":"2024-04-12T19:39:11.457957+0000","last_became_peered":"2024-04-12T19:39:11.457957+0000","last_unstale":"2024-04-12T19:39:18.493427+0000","last_undegraded":"2024-04-12T19:39:18.493427+0000","last_fullsized":"2024-04-12T19:39:18.493427+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:13:56.992995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:17.493124+0000","last_change":"2024-04-12T19:39:11.479162+0000","last_active":"2024-04-12T19:39:17.493124+0000","last_peered":"2024-04-12T19:39:17.493124+0000","last_clean":"2024-04-12T19:39:17.493124+0000","last_became_active":"2024-04-12T19:39:11.478748+0000","last_became_peered":"2024-04-12T19:39:11.478748+0000","last_unstale":"2024-04-12T19:39:17.493124+0000","last_undegraded":"2024-04-12T19:39:17.493124+0000","last_fullsized":"2024-04-12T19:39:17.493124+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T07:13:56.992995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.585351+0000","last_change":"2024-04-12T19:39:11.459392+0000","last_active":"2024-04-12T19:39:18.585351+0000","last_peered":"2024-04-12T19:39:18.585351+0000","last_clean":"2024-04-12T19:39:18.585351+0000","last_became_active":"2024-04-12T19:39:11.459080+0000","last_became_peered":"2024-04-12T19:39:11.459080+0000","last_unstale":"2024-04-12T19:39:18.585351+0000","last_undegraded":"2024-04-12T19:39:18.585351+0000","last_fullsized":"2024-04-12T19:39:18.585351+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T00:41:06.387680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.104633+0000","last_change":"2024-04-12T19:39:11.455201+0000","last_active":"2024-04-12T19:39:18.104633+0000","last_peered":"2024-04-12T19:39:18.104633+0000","last_clean":"2024-04-12T19:39:18.104633+0000","last_became_active":"2024-04-12T19:39:11.454864+0000","last_became_peered":"2024-04-12T19:39:11.454864+0000","last_unstale":"2024-04-12T19:39:18.104633+0000","last_undegraded":"2024-04-12T19:39:18.104633+0000","last_fullsized":"2024-04-12T19:39:18.104633+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-14T01:18:40.862659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":22,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-12T19:39:18.494971+0000","last_change":"2024-04-12T19:39:11.477240+0000","last_active":"2024-04-12T19:39:18.494971+0000","last_peered":"2024-04-12T19:39:18.494971+0000","last_clean":"2024-04-12T19:39:18.494971+0000","last_became_active":"2024-04-12T19:39:11.476955+0000","last_became_peered":"2024-04-12T19:39:11.476955+0000","last_unstale":"2024-04-12T19:39:18.494971+0000","last_undegraded":"2024-04-12T19:39:18.494971+0000","last_fullsized":"2024-04-12T19:39:18.494971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-12T19:39:10.393055+0000","last_clean_scrub_stamp":"2024-04-12T19:39:10.393055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-13T22:43:09.267564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":64736,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574858,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":348160,"data_stored":703014,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":115906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27296,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344544,"statfs":{"total":96636764160,"available":96608813056,"internally_reserved":0,"allocated":282624,"data_stored":112154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":290816,"data_stored":112190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":284,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":290816,"data_stored":115906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574859,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":278528,"data_stored":112064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27300,"kb_used_data":280,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344540,"statfs":{"total":96636764160,"available":96608808960,"internally_reserved":0,"allocated":286720,"data_stored":112224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":703070,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":32368,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-12T19:39:45.459 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-12T19:39:45.459 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-12T19:39:45.460 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-12T19:39:45.460 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-12T19:39:45.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.700+0000 7fac83200640 1 Processor -- start 2024-04-12T19:39:45.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.700+0000 7fac83200640 1 -- start start 2024-04-12T19:39:45.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.701+0000 7fac83200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fac840734c0 0x7fac841521f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.701+0000 7fac83200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac840bdbc0 0x7fac84152730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.701+0000 7fac83200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fac84152d10 con 0x7fac840a6240 2024-04-12T19:39:45.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.701+0000 7fac83200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fac840be320 con 0x7fac840734c0 2024-04-12T19:39:45.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.701+0000 7fac83200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fac840be570 con 0x7fac840bdbc0 2024-04-12T19:39:45.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac82800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fac840a6240 0x7fac840a66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34306/0 (socket says 172.21.15.131:34306) 2024-04-12T19:39:45.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac82800640 1 -- 172.21.15.131:0/1445310500 learned_addr learned my addr 172.21.15.131:0/1445310500 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac7be00640 1 --2- 172.21.15.131:0/1445310500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac840bdbc0 0x7fac84152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac81e00640 1 --2- 172.21.15.131:0/1445310500 >> v2:172.21.15.171:3300/0 conn(0x7fac840734c0 0x7fac841521f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1004101424 0 0) 0x7fac84152d10 con 0x7fac840a6240 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fac68003520 con 0x7fac840a6240 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 172300220 0 0) 0x7fac68003520 con 0x7fac840a6240 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac840bdbc0 msgr2=0x7fac84152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac81400640 1 --2- 172.21.15.131:0/1445310500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac840bdbc0 0x7fac84152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 >> v2:172.21.15.171:3300/0 conn(0x7fac840734c0 msgr2=0x7fac841521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac81400640 1 --2- 172.21.15.131:0/1445310500 >> v2:172.21.15.171:3300/0 conn(0x7fac840734c0 0x7fac841521f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac840be850 con 0x7fac840a6240 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7fac7c0019f0 con 0x7fac840a6240 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.702+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 >> v1:172.21.15.131:6789/0 conn(0x7fac840a6240 legacy=0x7fac840a66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac81400640 1 --2- 172.21.15.131:0/1445310500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac840bdbc0 0x7fac680039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac81400640 1 --2- 172.21.15.131:0/1445310500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68003f30 0x7fac68004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac81400640 1 --2- 172.21.15.131:0/1445310500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac68004d40 0x7fac680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fac840be320 con 0x7fac68003f30 2024-04-12T19:39:45.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fac840be570 con 0x7fac68004d40 2024-04-12T19:39:45.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fac6800bac0 con 0x7fac840bdbc0 2024-04-12T19:39:45.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac81e00640 1 --2- 172.21.15.131:0/1445310500 >> v2:172.21.15.171:3300/0 conn(0x7fac840734c0 0x7fac841521f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T19:39:45.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac7be00640 1 --2- 172.21.15.131:0/1445310500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68003f30 0x7fac68004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac7be00640 1 -- 172.21.15.131:0/1445310500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac840bdbc0 msgr2=0x7fac680039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:45.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac81e00640 1 --2- 172.21.15.131:0/1445310500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac840bdbc0 0x7fac680039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac7be00640 1 --2- 172.21.15.131:0/1445310500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac840bdbc0 0x7fac680039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac7be00640 1 -- 172.21.15.131:0/1445310500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac68004d40 msgr2=0x7fac680051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:45.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac7be00640 1 --2- 172.21.15.131:0/1445310500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac68004d40 0x7fac680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.703+0000 7fac7be00640 1 -- 172.21.15.131:0/1445310500 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac68003520 con 0x7fac68003f30 2024-04-12T19:39:45.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.704+0000 7fac7be00640 1 --2- 172.21.15.131:0/1445310500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68003f30 0x7fac68004800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009af0 tx=0x7fac68005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf227f4fe7350bb server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:45.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.705+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c039070 con 0x7fac68003f30 2024-04-12T19:39:45.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.705+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac6c02c6b0 con 0x7fac68003f30 2024-04-12T19:39:45.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.705+0000 7fac81400640 1 -- 172.21.15.131:0/1445310500 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6c009690 con 0x7fac68003f30 2024-04-12T19:39:45.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.705+0000 7fac83200640 1 -- 172.21.15.131:0/1445310500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68003f30 msgr2=0x7fac68004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.705+0000 7fac83200640 1 --2- 172.21.15.131:0/1445310500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68003f30 0x7fac68004800 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fac6c009af0 tx=0x7fac68005830 comp rx=0 tx=0).stop 2024-04-12T19:39:45.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.705+0000 7fac82800640 1 -- 172.21.15.131:0/1445310500 reap_dead start 2024-04-12T19:39:45.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.705+0000 7fac83200640 1 -- 172.21.15.131:0/1445310500 shutdown_connections 2024-04-12T19:39:45.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.705+0000 7fac83200640 1 -- 172.21.15.131:0/1445310500 >> 172.21.15.131:0/1445310500 conn(0x7fac840c24d0 msgr2=0x7fac840c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:45.707 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.705+0000 7fac83200640 1 -- 172.21.15.131:0/1445310500 shutdown_connections 2024-04-12T19:39:45.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.706+0000 7fac83200640 1 -- 172.21.15.131:0/1445310500 wait complete. 2024-04-12T19:39:45.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.707+0000 7fac83200640 1 Processor -- start 2024-04-12T19:39:45.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.707+0000 7fac83200640 1 -- start start 2024-04-12T19:39:45.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.708+0000 7fac83200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68003f30 0x7fac841da610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.708+0000 7fac83200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac841dab50 0x7fac84145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.708+0000 7fac83200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac84145f70 0x7fac84144850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.708+0000 7fac83200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fac840738a0 con 0x7fac68003f30 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.708+0000 7fac83200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fac840a8320 con 0x7fac841dab50 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.708+0000 7fac83200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fac840a7cd0 con 0x7fac84145f70 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.708+0000 7fac81e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68003f30 0x7fac841da610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.708+0000 7fac81e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68003f30 0x7fac841da610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41506/0 (socket says 172.21.15.131:41506) 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.708+0000 7fac81e00640 1 -- 172.21.15.131:0/3249473328 learned_addr learned my addr 172.21.15.131:0/3249473328 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac81e00640 1 -- 172.21.15.131:0/3249473328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac84145f70 msgr2=0x7fac84144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac82800640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac84145f70 0x7fac84144850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac81e00640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac84145f70 0x7fac84144850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac81e00640 1 -- 172.21.15.131:0/3249473328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac841dab50 msgr2=0x7fac84145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac7be00640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac841dab50 0x7fac84145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac81e00640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac841dab50 0x7fac84145a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac81e00640 1 -- 172.21.15.131:0/3249473328 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac84147a50 con 0x7fac68003f30 2024-04-12T19:39:45.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac81e00640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68003f30 0x7fac841da610 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac7400f570 tx=0x7fac7400fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:45.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac7a000640 1 -- 172.21.15.131:0/3249473328 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74018070 con 0x7fac68003f30 2024-04-12T19:39:45.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac7a000640 1 -- 172.21.15.131:0/3249473328 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac74014890 con 0x7fac68003f30 2024-04-12T19:39:45.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac83200640 1 -- 172.21.15.131:0/3249473328 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac84147cc0 con 0x7fac68003f30 2024-04-12T19:39:45.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac7a000640 1 -- 172.21.15.131:0/3249473328 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac74014c80 con 0x7fac68003f30 2024-04-12T19:39:45.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.709+0000 7fac83200640 1 -- 172.21.15.131:0/3249473328 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac84148280 con 0x7fac68003f30 2024-04-12T19:39:45.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.710+0000 7fac83200640 1 -- 172.21.15.131:0/3249473328 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac84075c30 con 0x7fac68003f30 2024-04-12T19:39:45.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.711+0000 7fac7a000640 1 -- 172.21.15.131:0/3249473328 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fac7401b070 con 0x7fac68003f30 2024-04-12T19:39:45.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.712+0000 7fac7a000640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fac6006c8f0 0x7fac6006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:45.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.712+0000 7fac7a000640 1 -- 172.21.15.131:0/3249473328 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fac7408c190 con 0x7fac68003f30 2024-04-12T19:39:45.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.712+0000 7fac7be00640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fac6006c8f0 0x7fac6006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:45.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.713+0000 7fac7be00640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fac6006c8f0 0x7fac6006edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fac6c036000 tx=0x7fac6c030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:45.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.716+0000 7fac7a000640 1 -- 172.21.15.131:0/3249473328 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fac7405a310 con 0x7fac68003f30 2024-04-12T19:39:45.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.939+0000 7fac83200640 1 -- 172.21.15.131:0/3249473328 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fac840bd9a0 con 0x7fac68003f30 2024-04-12T19:39:45.940 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.940+0000 7fac7a000640 1 -- 172.21.15.131:0/3249473328 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fac74014e20 con 0x7fac68003f30 2024-04-12T19:39:45.940 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:45.940 INFO:teuthology.orchestra.run.smithi131.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-12T19:39:45.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.943+0000 7fac83200640 1 -- 172.21.15.131:0/3249473328 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fac6006c8f0 msgr2=0x7fac6006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.943+0000 7fac83200640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fac6006c8f0 0x7fac6006edb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fac6c036000 tx=0x7fac6c030000 comp rx=0 tx=0).stop 2024-04-12T19:39:45.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.943+0000 7fac83200640 1 -- 172.21.15.131:0/3249473328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68003f30 msgr2=0x7fac841da610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:45.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.943+0000 7fac83200640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68003f30 0x7fac841da610 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fac7400f570 tx=0x7fac7400fa30 comp rx=0 tx=0).stop 2024-04-12T19:39:45.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.943+0000 7fac83200640 1 -- 172.21.15.131:0/3249473328 shutdown_connections 2024-04-12T19:39:45.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.943+0000 7fac83200640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fac6006c8f0 0x7fac6006edb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.943+0000 7fac83200640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fac841dab50 0x7fac84145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.943 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.943+0000 7fac83200640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fac84145f70 0x7fac84144850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.943+0000 7fac83200640 1 --2- 172.21.15.131:0/3249473328 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac68003f30 0x7fac841da610 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:45.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.943+0000 7fac83200640 1 -- 172.21.15.131:0/3249473328 >> 172.21.15.131:0/3249473328 conn(0x7fac840c24d0 msgr2=0x7fac840c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:45.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.943+0000 7fac83200640 1 -- 172.21.15.131:0/3249473328 shutdown_connections 2024-04-12T19:39:45.944 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:45.943+0000 7fac83200640 1 -- 172.21.15.131:0/3249473328 wait complete. 2024-04-12T19:39:45.959 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-12T19:39:45.960 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:46.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.155+0000 7f5a7c600640 1 Processor -- start 2024-04-12T19:39:46.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.156+0000 7f5a7c600640 1 -- start start 2024-04-12T19:39:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.157+0000 7f5a7c600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a7406b9e0 0x7f5a7406bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.157+0000 7f5a7c600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5a74154d40 0x7f5a7415b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.157+0000 7f5a7c600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a74072d80 con 0x7f5a74073760 2024-04-12T19:39:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.157+0000 7f5a7c600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f5a74073c10 con 0x7f5a74154d40 2024-04-12T19:39:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.157+0000 7f5a7c600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5a74073e60 con 0x7f5a7406b9e0 2024-04-12T19:39:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.157+0000 7f5a7a600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5a74154d40 0x7f5a7415b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.157+0000 7f5a7a600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f5a74154d40 0x7f5a7415b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41520/0 (socket says 172.21.15.131:41520) 2024-04-12T19:39:46.157 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.157+0000 7f5a7a600640 1 -- 172.21.15.131:0/1503995507 learned_addr learned my addr 172.21.15.131:0/1503995507 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.157+0000 7f5a79c00640 1 --2- 172.21.15.131:0/1503995507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a7406b9e0 0x7f5a7406bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.158+0000 7f5a7a600640 1 -- 172.21.15.131:0/1503995507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a7406b9e0 msgr2=0x7f5a7406bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.158+0000 7f5a7a600640 1 --2- 172.21.15.131:0/1503995507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a7406b9e0 0x7f5a7406bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.158 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.158+0000 7f5a7a600640 1 -- 172.21.15.131:0/1503995507 >> v1:172.21.15.171:6789/0 conn(0x7f5a74073760 legacy=0x7f5a74154630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.158+0000 7f5a7a600640 1 -- 172.21.15.131:0/1503995507 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a74072290 con 0x7f5a74154d40 2024-04-12T19:39:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.158+0000 7f5a79c00640 1 --2- 172.21.15.131:0/1503995507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a7406b9e0 0x7f5a7406bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:46.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.159+0000 7f5a7a600640 1 --2- 172.21.15.131:0/1503995507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a74154d40 0x7f5a7415b9c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009870 tx=0x7f5a6c02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd70f822d1db744 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.159+0000 7f5a73e00640 1 -- 172.21.15.131:0/1503995507 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c0317c0 con 0x7f5a74154d40 2024-04-12T19:39:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.159+0000 7f5a73e00640 1 -- 172.21.15.131:0/1503995507 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6c037070 con 0x7f5a74154d40 2024-04-12T19:39:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.159+0000 7f5a73e00640 1 -- 172.21.15.131:0/1503995507 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6c031b80 con 0x7f5a74154d40 2024-04-12T19:39:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.159+0000 7f5a7c600640 1 -- 172.21.15.131:0/1503995507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a74154d40 msgr2=0x7f5a7415b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.159+0000 7f5a7c600640 1 --2- 172.21.15.131:0/1503995507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a74154d40 0x7f5a7415b9c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5a6c009870 tx=0x7f5a6c02b860 comp rx=0 tx=0).stop 2024-04-12T19:39:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.160+0000 7f5a7c600640 1 -- 172.21.15.131:0/1503995507 shutdown_connections 2024-04-12T19:39:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.160+0000 7f5a7c600640 1 --2- 172.21.15.131:0/1503995507 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a74154d40 0x7f5a7415b9c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.160+0000 7f5a7c600640 1 --2- 172.21.15.131:0/1503995507 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a7406b9e0 0x7f5a7406bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.160+0000 7f5a7c600640 1 -- 172.21.15.131:0/1503995507 >> 172.21.15.131:0/1503995507 conn(0x7f5a740c36a0 msgr2=0x7f5a740c3a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.160+0000 7f5a7c600640 1 -- 172.21.15.131:0/1503995507 shutdown_connections 2024-04-12T19:39:46.160 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.160+0000 7f5a7c600640 1 -- 172.21.15.131:0/1503995507 wait complete. 2024-04-12T19:39:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.161+0000 7f5a7c600640 1 Processor -- start 2024-04-12T19:39:46.161 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.161+0000 7f5a7c600640 1 -- start start 2024-04-12T19:39:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.162+0000 7f5a7c600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a7406b9e0 0x7f5a7414c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.162+0000 7f5a7c600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a74073760 0x7f5a740a7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.162+0000 7f5a7c600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a74154d40 0x7f5a740c2e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.162+0000 7f5a7c600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5a74072a40 con 0x7f5a7406b9e0 2024-04-12T19:39:46.162 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.162+0000 7f5a7c600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f5a740728c0 con 0x7f5a74154d40 2024-04-12T19:39:46.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.162+0000 7f5a7c600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f5a74070ad0 con 0x7f5a74073760 2024-04-12T19:39:46.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.162+0000 7f5a79c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a7406b9e0 0x7f5a7414c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:46.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.162+0000 7f5a79c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a7406b9e0 0x7f5a7414c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41528/0 (socket says 172.21.15.131:41528) 2024-04-12T19:39:46.163 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.163+0000 7f5a79c00640 1 -- 172.21.15.131:0/36576889 learned_addr learned my addr 172.21.15.131:0/36576889 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:46.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.163+0000 7f5a7a600640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a74154d40 0x7f5a740c2e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:46.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.163+0000 7f5a79200640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a74073760 0x7f5a740a7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:46.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.163+0000 7f5a79c00640 1 -- 172.21.15.131:0/36576889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a74073760 msgr2=0x7f5a740a7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:46.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.163+0000 7f5a79c00640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a74073760 0x7f5a740a7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.163+0000 7f5a79c00640 1 -- 172.21.15.131:0/36576889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a74154d40 msgr2=0x7f5a740c2e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:46.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.163+0000 7f5a79c00640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a74154d40 0x7f5a740c2e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.164 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.163+0000 7f5a79c00640 1 -- 172.21.15.131:0/36576889 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a740c3350 con 0x7f5a7406b9e0 2024-04-12T19:39:46.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.163+0000 7f5a79200640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a74073760 0x7f5a740a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:46.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.163+0000 7f5a7a600640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a74154d40 0x7f5a740c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:46.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.163+0000 7f5a79c00640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a7406b9e0 0x7f5a7414c250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800ce30 tx=0x7f5a6800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:46.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.163+0000 7f5a71600640 1 -- 172.21.15.131:0/36576889 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800f890 con 0x7f5a7406b9e0 2024-04-12T19:39:46.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.164+0000 7f5a71600640 1 -- 172.21.15.131:0/36576889 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6800fa30 con 0x7f5a7406b9e0 2024-04-12T19:39:46.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.164+0000 7f5a71600640 1 -- 172.21.15.131:0/36576889 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a6800fe00 con 0x7f5a7406b9e0 2024-04-12T19:39:46.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.164+0000 7f5a7c600640 1 -- 172.21.15.131:0/36576889 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a740a65c0 con 0x7f5a7406b9e0 2024-04-12T19:39:46.165 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.164+0000 7f5a7c600640 1 -- 172.21.15.131:0/36576889 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a741ea8e0 con 0x7f5a7406b9e0 2024-04-12T19:39:46.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.165+0000 7f5a7c600640 1 -- 172.21.15.131:0/36576889 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a7404fd50 con 0x7f5a7406b9e0 2024-04-12T19:39:46.166 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.166+0000 7f5a71600640 1 -- 172.21.15.131:0/36576889 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5a68018400 con 0x7f5a7406b9e0 2024-04-12T19:39:46.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.167+0000 7f5a71600640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5a5406c8f0 0x7f5a5406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:46.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.167+0000 7f5a71600640 1 -- 172.21.15.131:0/36576889 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f5a6808ccc0 con 0x7f5a7406b9e0 2024-04-12T19:39:46.167 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.167+0000 7f5a79200640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5a5406c8f0 0x7f5a5406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:46.168 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.168+0000 7f5a79200640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5a5406c8f0 0x7f5a5406edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5a740c3570 tx=0x7f5a60009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:46.171 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.172+0000 7f5a71600640 1 -- 172.21.15.131:0/36576889 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f5a68093080 con 0x7f5a7406b9e0 2024-04-12T19:39:46.372 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.372+0000 7f5a7c600640 1 -- 172.21.15.131:0/36576889 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a740a6790 con 0x7f5a7406b9e0 2024-04-12T19:39:46.374 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.374+0000 7f5a71600640 1 -- 172.21.15.131:0/36576889 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f5a68014030 con 0x7f5a7406b9e0 2024-04-12T19:39:46.375 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:46.375 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":26,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:17.479662+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:46.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.377+0000 7f5a7c600640 1 -- 172.21.15.131:0/36576889 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5a5406c8f0 msgr2=0x7f5a5406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:46.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.377+0000 7f5a7c600640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5a5406c8f0 0x7f5a5406edb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5a740c3570 tx=0x7f5a60009040 comp rx=0 tx=0).stop 2024-04-12T19:39:46.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.377+0000 7f5a7c600640 1 -- 172.21.15.131:0/36576889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a7406b9e0 msgr2=0x7f5a7414c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:46.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.377+0000 7f5a7c600640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a7406b9e0 0x7f5a7414c250 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f5a6800ce30 tx=0x7f5a6800a650 comp rx=0 tx=0).stop 2024-04-12T19:39:46.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.377+0000 7f5a7c600640 1 -- 172.21.15.131:0/36576889 shutdown_connections 2024-04-12T19:39:46.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.377+0000 7f5a7c600640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f5a5406c8f0 0x7f5a5406edb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.377+0000 7f5a7c600640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f5a74154d40 0x7f5a740c2e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.377+0000 7f5a7c600640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5a74073760 0x7f5a740a7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.377+0000 7f5a7c600640 1 --2- 172.21.15.131:0/36576889 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a7406b9e0 0x7f5a7414c250 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.377+0000 7f5a7c600640 1 -- 172.21.15.131:0/36576889 >> 172.21.15.131:0/36576889 conn(0x7f5a740c36a0 msgr2=0x7f5a7414f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:46.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.378+0000 7f5a7c600640 1 -- 172.21.15.131:0/36576889 shutdown_connections 2024-04-12T19:39:46.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.378+0000 7f5a7c600640 1 -- 172.21.15.131:0/36576889 wait complete. 2024-04-12T19:39:46.394 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T19:39:04.855067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-12T19:39:09.370965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-12T19:39:09.858079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-12T19:39:13.479306+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-12T19:39:46.394 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T19:39:46.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.594+0000 7f1b0ce00640 1 Processor -- start 2024-04-12T19:39:46.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.595+0000 7f1b0ce00640 1 -- start start 2024-04-12T19:39:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.596+0000 7f1b0ce00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f1b08154860 0x7f1b08154fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.596+0000 7f1b0ce00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1b080bd8c0 0x7f1b080bdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.596+0000 7f1b0ce00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b080b8a20 con 0x7f1b08067940 2024-04-12T19:39:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.596+0000 7f1b0ce00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f1b08155520 con 0x7f1b080bd8c0 2024-04-12T19:39:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.596+0000 7f1b0ce00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f1b080b9470 con 0x7f1b08154860 2024-04-12T19:39:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.596+0000 7f1b06800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1b080bd8c0 0x7f1b080bdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.596+0000 7f1b06800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f1b080bd8c0 0x7f1b080bdd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41530/0 (socket says 172.21.15.131:41530) 2024-04-12T19:39:46.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.596+0000 7f1b06800640 1 -- 172.21.15.131:0/130852800 learned_addr learned my addr 172.21.15.131:0/130852800 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:46.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.596+0000 7f1b06800640 1 -- 172.21.15.131:0/130852800 >> v2:172.21.15.171:3300/0 conn(0x7f1b08154860 msgr2=0x7f1b08154fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:46.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.596+0000 7f1b06800640 1 --2- 172.21.15.131:0/130852800 >> v2:172.21.15.171:3300/0 conn(0x7f1b08154860 0x7f1b08154fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.596+0000 7f1b06800640 1 -- 172.21.15.131:0/130852800 >> v1:172.21.15.171:6789/0 conn(0x7f1b08067940 legacy=0x7f1b0814b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:46.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.596+0000 7f1b06800640 1 -- 172.21.15.131:0/130852800 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b080b9750 con 0x7f1b080bd8c0 2024-04-12T19:39:46.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.597+0000 7f1b06800640 1 --2- 172.21.15.131:0/130852800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b080bd8c0 0x7f1b080bdd10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1b0806ce90 tx=0x7f1b0002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0b5b67290e6170c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:46.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.598+0000 7f1b04a00640 1 -- 172.21.15.131:0/130852800 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b0002e070 con 0x7f1b080bd8c0 2024-04-12T19:39:46.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.598+0000 7f1b04a00640 1 -- 172.21.15.131:0/130852800 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b00037070 con 0x7f1b080bd8c0 2024-04-12T19:39:46.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.598+0000 7f1b04a00640 1 -- 172.21.15.131:0/130852800 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00031a00 con 0x7f1b080bd8c0 2024-04-12T19:39:46.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.598+0000 7f1b0ce00640 1 -- 172.21.15.131:0/130852800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b080bd8c0 msgr2=0x7f1b080bdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:46.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.598+0000 7f1b0ce00640 1 --2- 172.21.15.131:0/130852800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b080bd8c0 0x7f1b080bdd10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1b0806ce90 tx=0x7f1b0002b880 comp rx=0 tx=0).stop 2024-04-12T19:39:46.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.599+0000 7f1b0ce00640 1 -- 172.21.15.131:0/130852800 shutdown_connections 2024-04-12T19:39:46.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.599+0000 7f1b0ce00640 1 --2- 172.21.15.131:0/130852800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b080bd8c0 0x7f1b080bdd10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.599+0000 7f1b0ce00640 1 --2- 172.21.15.131:0/130852800 >> v2:172.21.15.171:3300/0 conn(0x7f1b08154860 0x7f1b08154fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.599+0000 7f1b0ce00640 1 -- 172.21.15.131:0/130852800 >> 172.21.15.131:0/130852800 conn(0x7f1b0806c920 msgr2=0x7f1b080c0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:46.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.599+0000 7f1b0ce00640 1 -- 172.21.15.131:0/130852800 shutdown_connections 2024-04-12T19:39:46.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.599+0000 7f1b0ce00640 1 -- 172.21.15.131:0/130852800 wait complete. 2024-04-12T19:39:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.600+0000 7f1b0ce00640 1 Processor -- start 2024-04-12T19:39:46.600 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.600+0000 7f1b0ce00640 1 -- start start 2024-04-12T19:39:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.601+0000 7f1b0ce00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b08067940 0x7f1b08146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.601+0000 7f1b0ce00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b080bd8c0 0x7f1b081508e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.601+0000 7f1b0ce00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b08154860 0x7f1b0813ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.601+0000 7f1b0ce00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1b080b9a30 con 0x7f1b08154860 2024-04-12T19:39:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.601+0000 7f1b0ce00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0814b740 con 0x7f1b08067940 2024-04-12T19:39:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.601+0000 7f1b0ce00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1b080b9bb0 con 0x7f1b080bd8c0 2024-04-12T19:39:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.601+0000 7f1b06800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b08154860 0x7f1b0813ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:46.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.602+0000 7f1b06800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b08154860 0x7f1b0813ebe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41536/0 (socket says 172.21.15.131:41536) 2024-04-12T19:39:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.602+0000 7f1b06800640 1 -- 172.21.15.131:0/1273267974 learned_addr learned my addr 172.21.15.131:0/1273267974 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.602+0000 7f1b05e00640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b08067940 0x7f1b08146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.602+0000 7f1b05400640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b080bd8c0 0x7f1b081508e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.602+0000 7f1b06800640 1 -- 172.21.15.131:0/1273267974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b080bd8c0 msgr2=0x7f1b081508e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.602+0000 7f1b06800640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b080bd8c0 0x7f1b081508e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.602+0000 7f1b06800640 1 -- 172.21.15.131:0/1273267974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b08067940 msgr2=0x7f1b08146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.602+0000 7f1b06800640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b08067940 0x7f1b08146520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.602+0000 7f1b06800640 1 -- 172.21.15.131:0/1273267974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b08151a80 con 0x7f1b08154860 2024-04-12T19:39:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.602+0000 7f1b05e00640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b08067940 0x7f1b08146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:46.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.602+0000 7f1b06800640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b08154860 0x7f1b0813ebe0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1b00034040 tx=0x7f1b000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:46.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.603+0000 7f1afe000640 1 -- 172.21.15.131:0/1273267974 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00032880 con 0x7f1b08154860 2024-04-12T19:39:46.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.603+0000 7f1afe000640 1 -- 172.21.15.131:0/1273267974 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b00032a20 con 0x7f1b08154860 2024-04-12T19:39:46.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.603+0000 7f1afe000640 1 -- 172.21.15.131:0/1273267974 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b00032dd0 con 0x7f1b08154860 2024-04-12T19:39:46.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.603+0000 7f1b0ce00640 1 -- 172.21.15.131:0/1273267974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b08150e20 con 0x7f1b08154860 2024-04-12T19:39:46.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.603+0000 7f1b0ce00640 1 -- 172.21.15.131:0/1273267974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0813f4f0 con 0x7f1b08154860 2024-04-12T19:39:46.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.604+0000 7f1b0ce00640 1 -- 172.21.15.131:0/1273267974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0813f730 con 0x7f1b08154860 2024-04-12T19:39:46.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.605+0000 7f1afe000640 1 -- 172.21.15.131:0/1273267974 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1b000453f0 con 0x7f1b08154860 2024-04-12T19:39:46.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.606+0000 7f1afe000640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f1ae406c8f0 0x7f1ae406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:46.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.606+0000 7f1afe000640 1 -- 172.21.15.131:0/1273267974 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f1b000ade80 con 0x7f1b08154860 2024-04-12T19:39:46.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.606+0000 7f1b05e00640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f1ae406c8f0 0x7f1ae406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:46.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.607+0000 7f1b05e00640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f1ae406c8f0 0x7f1ae406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1af8007eb0 tx=0x7f1af80073c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:46.610 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.611+0000 7f1afe000640 1 -- 172.21.15.131:0/1273267974 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1b0813f730 con 0x7f1b08154860 2024-04-12T19:39:46.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.793+0000 7f1b0ce00640 1 -- 172.21.15.131:0/1273267974 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f1b0804fd50 con 0x7f1b08154860 2024-04-12T19:39:46.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.794+0000 7f1afe000640 1 -- 172.21.15.131:0/1273267974 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f1b00040070 con 0x7f1b08154860 2024-04-12T19:39:46.794 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-12T19:39:46.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.797+0000 7f1b0ce00640 1 -- 172.21.15.131:0/1273267974 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f1ae406c8f0 msgr2=0x7f1ae406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:46.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.797+0000 7f1b0ce00640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f1ae406c8f0 0x7f1ae406edb0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1af8007eb0 tx=0x7f1af80073c0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.797+0000 7f1b0ce00640 1 -- 172.21.15.131:0/1273267974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b08154860 msgr2=0x7f1b0813ebe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:46.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.797+0000 7f1b0ce00640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b08154860 0x7f1b0813ebe0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f1b00034040 tx=0x7f1b000046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.797+0000 7f1b0ce00640 1 -- 172.21.15.131:0/1273267974 shutdown_connections 2024-04-12T19:39:46.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.797+0000 7f1b0ce00640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f1ae406c8f0 0x7f1ae406edb0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.797+0000 7f1b0ce00640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1b08154860 0x7f1b0813ebe0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.797+0000 7f1b0ce00640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1b080bd8c0 0x7f1b081508e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.797+0000 7f1b0ce00640 1 --2- 172.21.15.131:0/1273267974 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1b08067940 0x7f1b08146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:46.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.797+0000 7f1b0ce00640 1 -- 172.21.15.131:0/1273267974 >> 172.21.15.131:0/1273267974 conn(0x7f1b0806c920 msgr2=0x7f1b080c0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:46.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.797+0000 7f1b0ce00640 1 -- 172.21.15.131:0/1273267974 shutdown_connections 2024-04-12T19:39:46.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:46.797+0000 7f1b0ce00640 1 -- 172.21.15.131:0/1273267974 wait complete. 2024-04-12T19:39:46.814 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-12T19:39:47.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.020+0000 7f6dc4200640 1 Processor -- start 2024-04-12T19:39:47.020 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.020+0000 7f6dc4200640 1 -- start start 2024-04-12T19:39:47.021 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.021+0000 7f6dc4200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6dbc1548f0 0x7f6dbc0b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.021+0000 7f6dc4200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f6dbc0bed50 0x7f6dbc14aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.021+0000 7f6dc4200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6dbc073780 con 0x7f6dbc0bf3f0 2024-04-12T19:39:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.021+0000 7f6dc4200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f6dbc1553e0 con 0x7f6dbc1548f0 2024-04-12T19:39:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.021+0000 7f6dc4200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f6dbc067840 con 0x7f6dbc0bed50 2024-04-12T19:39:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.022+0000 7f6dc1800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f6dbc1548f0 0x7f6dbc0b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.022+0000 7f6dc0e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f6dbc0bf3f0 0x7f6dbc154cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34308/0 (socket says 172.21.15.131:34308) 2024-04-12T19:39:47.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.022+0000 7f6dc0e00640 1 -- 172.21.15.131:0/1684852068 learned_addr learned my addr 172.21.15.131:0/1684852068 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.022+0000 7f6dc2200640 1 --2- 172.21.15.131:0/1684852068 >> v2:172.21.15.171:3300/0 conn(0x7f6dbc0bed50 0x7f6dbc14aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.022+0000 7f6dbbe00640 1 -- 172.21.15.131:0/1684852068 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334857701 0 0) 0x7f6dbc073780 con 0x7f6dbc0bf3f0 2024-04-12T19:39:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.022+0000 7f6dbbe00640 1 -- 172.21.15.131:0/1684852068 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6da0003520 con 0x7f6dbc0bf3f0 2024-04-12T19:39:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.022+0000 7f6dc1800640 1 -- 172.21.15.131:0/1684852068 >> v2:172.21.15.171:3300/0 conn(0x7f6dbc0bed50 msgr2=0x7f6dbc14aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.022+0000 7f6dc1800640 1 --2- 172.21.15.131:0/1684852068 >> v2:172.21.15.171:3300/0 conn(0x7f6dbc0bed50 0x7f6dbc14aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.022+0000 7f6dc1800640 1 -- 172.21.15.131:0/1684852068 >> v1:172.21.15.131:6789/0 conn(0x7f6dbc0bf3f0 legacy=0x7f6dbc154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.022+0000 7f6dc1800640 1 -- 172.21.15.131:0/1684852068 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dbc0731c0 con 0x7f6dbc1548f0 2024-04-12T19:39:47.023 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.023+0000 7f6dc1800640 1 --2- 172.21.15.131:0/1684852068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dbc1548f0 0x7f6dbc0b7e00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0be160 tx=0x7f6dac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7b1b738ea30eec server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.024+0000 7f6dbbe00640 1 -- 172.21.15.131:0/1684852068 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac035020 con 0x7f6dbc1548f0 2024-04-12T19:39:47.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.024+0000 7f6dbbe00640 1 -- 172.21.15.131:0/1684852068 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dac031830 con 0x7f6dbc1548f0 2024-04-12T19:39:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.024+0000 7f6dbbe00640 1 -- 172.21.15.131:0/1684852068 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dac031be0 con 0x7f6dbc1548f0 2024-04-12T19:39:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.024+0000 7f6dc4200640 1 -- 172.21.15.131:0/1684852068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dbc1548f0 msgr2=0x7f6dbc0b7e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.024+0000 7f6dc4200640 1 --2- 172.21.15.131:0/1684852068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dbc1548f0 0x7f6dbc0b7e00 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6dbc0be160 tx=0x7f6dac02b8d0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.024+0000 7f6dc4200640 1 -- 172.21.15.131:0/1684852068 shutdown_connections 2024-04-12T19:39:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.024+0000 7f6dc4200640 1 --2- 172.21.15.131:0/1684852068 >> v2:172.21.15.171:3300/0 conn(0x7f6dbc0bed50 0x7f6dbc14aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.024+0000 7f6dc4200640 1 --2- 172.21.15.131:0/1684852068 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dbc1548f0 0x7f6dbc0b7e00 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.024+0000 7f6dc4200640 1 -- 172.21.15.131:0/1684852068 >> 172.21.15.131:0/1684852068 conn(0x7f6dbc06c920 msgr2=0x7f6dbc071a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.024+0000 7f6dc4200640 1 -- 172.21.15.131:0/1684852068 shutdown_connections 2024-04-12T19:39:47.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.024+0000 7f6dc4200640 1 -- 172.21.15.131:0/1684852068 wait complete. 2024-04-12T19:39:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.026+0000 7f6dc4200640 1 Processor -- start 2024-04-12T19:39:47.026 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.026+0000 7f6dc4200640 1 -- start start 2024-04-12T19:39:47.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.027+0000 7f6dc4200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dbc0bed50 0x7f6dbc1e6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.027+0000 7f6dc4200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dbc0bf3f0 0x7f6dbc152330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.027+0000 7f6dc4200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dbc1548f0 0x7f6dbc152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.027+0000 7f6dc4200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc0be550 con 0x7f6dbc1548f0 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.027+0000 7f6dc4200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f6dbc0be270 con 0x7f6dbc0bf3f0 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.027+0000 7f6dc4200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f6dbc0be830 con 0x7f6dbc0bed50 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.027+0000 7f6dc2200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dbc1548f0 0x7f6dbc152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.027+0000 7f6dc2200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dbc1548f0 0x7f6dbc152870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41556/0 (socket says 172.21.15.131:41556) 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.027+0000 7f6dc2200640 1 -- 172.21.15.131:0/388474188 learned_addr learned my addr 172.21.15.131:0/388474188 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6dc1800640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dbc0bed50 0x7f6dbc1e6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6dc0e00640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dbc0bf3f0 0x7f6dbc152330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6dc2200640 1 -- 172.21.15.131:0/388474188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dbc0bed50 msgr2=0x7f6dbc1e6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6dc2200640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dbc0bed50 0x7f6dbc1e6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6dc2200640 1 -- 172.21.15.131:0/388474188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dbc0bf3f0 msgr2=0x7f6dbc152330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6dc2200640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dbc0bf3f0 0x7f6dbc152330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6dc2200640 1 -- 172.21.15.131:0/388474188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dbc1db0d0 con 0x7f6dbc1548f0 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6dc0e00640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dbc0bf3f0 0x7f6dbc152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6dc2200640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dbc1548f0 0x7f6dbc152870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6db400d800 tx=0x7f6db400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:47.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6db9600640 1 -- 172.21.15.131:0/388474188 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db400b6c0 con 0x7f6dbc1548f0 2024-04-12T19:39:47.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6db9600640 1 -- 172.21.15.131:0/388474188 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6db4019070 con 0x7f6dbc1548f0 2024-04-12T19:39:47.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6db9600640 1 -- 172.21.15.131:0/388474188 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6db400bac0 con 0x7f6dbc1548f0 2024-04-12T19:39:47.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6dc4200640 1 -- 172.21.15.131:0/388474188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dbc1e7560 con 0x7f6dbc1548f0 2024-04-12T19:39:47.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.028+0000 7f6dc4200640 1 -- 172.21.15.131:0/388474188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dbc14fe70 con 0x7f6dbc1548f0 2024-04-12T19:39:47.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.029+0000 7f6dc4200640 1 -- 172.21.15.131:0/388474188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6dbc06d180 con 0x7f6dbc1548f0 2024-04-12T19:39:47.030 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.030+0000 7f6db9600640 1 -- 172.21.15.131:0/388474188 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f6db400bc60 con 0x7f6dbc1548f0 2024-04-12T19:39:47.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.031+0000 7f6db9600640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6d9c06c8f0 0x7f6d9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.031+0000 7f6db9600640 1 -- 172.21.15.131:0/388474188 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f6db408c3a0 con 0x7f6dbc1548f0 2024-04-12T19:39:47.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.032+0000 7f6dc1800640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6d9c06c8f0 0x7f6d9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.032+0000 7f6dc1800640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6d9c06c8f0 0x7f6d9c06edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6dac036000 tx=0x7f6dac03c040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:47.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.036+0000 7f6db9600640 1 -- 172.21.15.131:0/388474188 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f6db405a3f0 con 0x7f6dbc1548f0 2024-04-12T19:39:47.234 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.234+0000 7f6dc4200640 1 -- 172.21.15.131:0/388474188 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f6dbc04fd50 con 0x7f6dbc1548f0 2024-04-12T19:39:47.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.235+0000 7f6db9600640 1 -- 172.21.15.131:0/388474188 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f6db4059cf0 con 0x7f6dbc1548f0 2024-04-12T19:39:47.235 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T19:39:47.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.237+0000 7f6dc4200640 1 -- 172.21.15.131:0/388474188 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6d9c06c8f0 msgr2=0x7f6d9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.237+0000 7f6dc4200640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6d9c06c8f0 0x7f6d9c06edb0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6dac036000 tx=0x7f6dac03c040 comp rx=0 tx=0).stop 2024-04-12T19:39:47.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.237+0000 7f6dc4200640 1 -- 172.21.15.131:0/388474188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dbc1548f0 msgr2=0x7f6dbc152870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.237 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.237+0000 7f6dc4200640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dbc1548f0 0x7f6dbc152870 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6db400d800 tx=0x7f6db400dcc0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.238+0000 7f6dc4200640 1 -- 172.21.15.131:0/388474188 shutdown_connections 2024-04-12T19:39:47.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.238+0000 7f6dc4200640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f6d9c06c8f0 0x7f6d9c06edb0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.238+0000 7f6dc4200640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f6dbc0bf3f0 0x7f6dbc152330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.238+0000 7f6dc4200640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6dbc1548f0 0x7f6dbc152870 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.238+0000 7f6dc4200640 1 --2- 172.21.15.131:0/388474188 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f6dbc0bed50 0x7f6dbc1e6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.238+0000 7f6dc4200640 1 -- 172.21.15.131:0/388474188 >> 172.21.15.131:0/388474188 conn(0x7f6dbc06c920 msgr2=0x7f6dbc072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:47.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.238+0000 7f6dc4200640 1 -- 172.21.15.131:0/388474188 shutdown_connections 2024-04-12T19:39:47.239 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.238+0000 7f6dc4200640 1 -- 172.21.15.131:0/388474188 wait complete. 2024-04-12T19:39:47.256 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-12T19:39:47.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.457+0000 7ffb60a00640 1 Processor -- start 2024-04-12T19:39:47.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.457+0000 7ffb60a00640 1 -- start start 2024-04-12T19:39:47.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.458+0000 7ffb60a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffb5c0bf720 0x7ffb5c0a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.458+0000 7ffb60a00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7ffb5c0a4f80 0x7ffb5c14eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.458+0000 7ffb60a00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb5c0a7ae0 con 0x7ffb5c073840 2024-04-12T19:39:47.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.459+0000 7ffb60a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7ffb5c0a5c90 con 0x7ffb5c0bf720 2024-04-12T19:39:47.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.459+0000 7ffb60a00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7ffb5c0beed0 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.459+0000 7ffb59e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffb5c0bf720 0x7ffb5c0a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.459+0000 7ffb59e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7ffb5c0bf720 0x7ffb5c0a6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41560/0 (socket says 172.21.15.131:41560) 2024-04-12T19:39:47.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.459+0000 7ffb59e00640 1 -- 172.21.15.131:0/4293697671 learned_addr learned my addr 172.21.15.131:0/4293697671 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:47.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.459+0000 7ffb59400640 1 --2- 172.21.15.131:0/4293697671 >> v2:172.21.15.171:3300/0 conn(0x7ffb5c0a4f80 0x7ffb5c14eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.459+0000 7ffb59e00640 1 -- 172.21.15.131:0/4293697671 >> v2:172.21.15.171:3300/0 conn(0x7ffb5c0a4f80 msgr2=0x7ffb5c14eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:47.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.459+0000 7ffb59e00640 1 --2- 172.21.15.131:0/4293697671 >> v2:172.21.15.171:3300/0 conn(0x7ffb5c0a4f80 0x7ffb5c14eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.459+0000 7ffb59e00640 1 -- 172.21.15.131:0/4293697671 >> v1:172.21.15.171:6789/0 conn(0x7ffb5c073840 legacy=0x7ffb5c1524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:47.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.459+0000 7ffb59e00640 1 -- 172.21.15.131:0/4293697671 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c0be2a0 con 0x7ffb5c0bf720 2024-04-12T19:39:47.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.459+0000 7ffb59400640 1 --2- 172.21.15.131:0/4293697671 >> v2:172.21.15.171:3300/0 conn(0x7ffb5c0a4f80 0x7ffb5c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:47.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.461+0000 7ffb59e00640 1 --2- 172.21.15.131:0/4293697671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5c0bf720 0x7ffb5c0a6120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0a7a00 tx=0x7ffb4c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaf6cbea35b26c32 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:47.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.461+0000 7ffb58a00640 1 -- 172.21.15.131:0/4293697671 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c02e070 con 0x7ffb5c0bf720 2024-04-12T19:39:47.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.461+0000 7ffb58a00640 1 -- 172.21.15.131:0/4293697671 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb4c037070 con 0x7ffb5c0bf720 2024-04-12T19:39:47.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.461+0000 7ffb58a00640 1 -- 172.21.15.131:0/4293697671 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4c031a00 con 0x7ffb5c0bf720 2024-04-12T19:39:47.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.461+0000 7ffb60a00640 1 -- 172.21.15.131:0/4293697671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5c0bf720 msgr2=0x7ffb5c0a6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.461+0000 7ffb60a00640 1 --2- 172.21.15.131:0/4293697671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5c0bf720 0x7ffb5c0a6120 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c0a7a00 tx=0x7ffb4c02b880 comp rx=0 tx=0).stop 2024-04-12T19:39:47.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.462+0000 7ffb60a00640 1 -- 172.21.15.131:0/4293697671 shutdown_connections 2024-04-12T19:39:47.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.462+0000 7ffb60a00640 1 --2- 172.21.15.131:0/4293697671 >> v2:172.21.15.171:3300/0 conn(0x7ffb5c0a4f80 0x7ffb5c14eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.462+0000 7ffb60a00640 1 --2- 172.21.15.131:0/4293697671 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5c0bf720 0x7ffb5c0a6120 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.462+0000 7ffb60a00640 1 -- 172.21.15.131:0/4293697671 >> 172.21.15.131:0/4293697671 conn(0x7ffb5c06be00 msgr2=0x7ffb5c06c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:47.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.462+0000 7ffb60a00640 1 -- 172.21.15.131:0/4293697671 shutdown_connections 2024-04-12T19:39:47.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.462+0000 7ffb60a00640 1 -- 172.21.15.131:0/4293697671 wait complete. 2024-04-12T19:39:47.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.463+0000 7ffb60a00640 1 Processor -- start 2024-04-12T19:39:47.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.463+0000 7ffb60a00640 1 -- start start 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.464+0000 7ffb60a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb5c073840 0x7ffb5c1da5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.464+0000 7ffb60a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5c0a4f80 0x7ffb5c1e7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.464+0000 7ffb60a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb5c0bf720 0x7ffb5c0ba750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.464+0000 7ffb60a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c0bfb00 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.464+0000 7ffb60a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c0beba0 con 0x7ffb5c0bf720 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.464+0000 7ffb60a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7ffb5c0bfc80 con 0x7ffb5c073840 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.464+0000 7ffb59400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5c0a4f80 0x7ffb5c1e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.465+0000 7ffb59400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5c0a4f80 0x7ffb5c1e7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41568/0 (socket says 172.21.15.131:41568) 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.465+0000 7ffb59400640 1 -- 172.21.15.131:0/483100624 learned_addr learned my addr 172.21.15.131:0/483100624 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.465+0000 7ffb59e00640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb5c073840 0x7ffb5c1da5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.465+0000 7ffb59400640 1 -- 172.21.15.131:0/483100624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb5c073840 msgr2=0x7ffb5c1da5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.465+0000 7ffb59400640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb5c073840 0x7ffb5c1da5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.465+0000 7ffb5a800640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb5c0bf720 0x7ffb5c0ba750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.467 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.465+0000 7ffb59400640 1 -- 172.21.15.131:0/483100624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb5c0bf720 msgr2=0x7ffb5c0ba750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.465+0000 7ffb59400640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb5c0bf720 0x7ffb5c0ba750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.465+0000 7ffb59400640 1 -- 172.21.15.131:0/483100624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c1dab00 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.465+0000 7ffb59e00640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb5c073840 0x7ffb5c1da5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:47.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.465+0000 7ffb59400640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5c0a4f80 0x7ffb5c1e7900 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c820 tx=0x7ffb4800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:47.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.466+0000 7ffb52000640 1 -- 172.21.15.131:0/483100624 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48015070 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.466+0000 7ffb52000640 1 -- 172.21.15.131:0/483100624 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb48007a30 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.466+0000 7ffb52000640 1 -- 172.21.15.131:0/483100624 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48007e00 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.466+0000 7ffb60a00640 1 -- 172.21.15.131:0/483100624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5c0b99c0 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.468 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.466+0000 7ffb60a00640 1 -- 172.21.15.131:0/483100624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb5c1e7100 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.467+0000 7ffb60a00640 1 -- 172.21.15.131:0/483100624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb5c04fd50 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.468+0000 7ffb52000640 1 -- 172.21.15.131:0/483100624 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7ffb48018070 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.469+0000 7ffb52000640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7ffb3c06c8f0 0x7ffb3c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.469+0000 7ffb52000640 1 -- 172.21.15.131:0/483100624 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7ffb4808bee0 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.469+0000 7ffb59e00640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7ffb3c06c8f0 0x7ffb3c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.469 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.470+0000 7ffb59e00640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7ffb3c06c8f0 0x7ffb3c06edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c036000 tx=0x7ffb4c008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:47.473 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.474+0000 7ffb52000640 1 -- 172.21.15.131:0/483100624 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7ffb48059fc0 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.674+0000 7ffb60a00640 1 -- 172.21.15.131:0/483100624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ffb5c1491b0 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.675+0000 7ffb52000640 1 -- 172.21.15.131:0/483100624 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7ffb480598c0 con 0x7ffb5c0a4f80 2024-04-12T19:39:47.675 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-12T19:39:47.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.678+0000 7ffb60a00640 1 -- 172.21.15.131:0/483100624 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7ffb3c06c8f0 msgr2=0x7ffb3c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.678+0000 7ffb60a00640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7ffb3c06c8f0 0x7ffb3c06edb0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ffb4c036000 tx=0x7ffb4c008030 comp rx=0 tx=0).stop 2024-04-12T19:39:47.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.678+0000 7ffb60a00640 1 -- 172.21.15.131:0/483100624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5c0a4f80 msgr2=0x7ffb5c1e7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.678+0000 7ffb60a00640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5c0a4f80 0x7ffb5c1e7900 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ffb4800c820 tx=0x7ffb4800cc20 comp rx=0 tx=0).stop 2024-04-12T19:39:47.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.678+0000 7ffb60a00640 1 -- 172.21.15.131:0/483100624 shutdown_connections 2024-04-12T19:39:47.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.678+0000 7ffb60a00640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7ffb3c06c8f0 0x7ffb3c06edb0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.678+0000 7ffb60a00640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7ffb5c0bf720 0x7ffb5c0ba750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.678+0000 7ffb60a00640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffb5c0a4f80 0x7ffb5c1e7900 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.678+0000 7ffb60a00640 1 --2- 172.21.15.131:0/483100624 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7ffb5c073840 0x7ffb5c1da5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.678+0000 7ffb60a00640 1 -- 172.21.15.131:0/483100624 >> 172.21.15.131:0/483100624 conn(0x7ffb5c06be00 msgr2=0x7ffb5c06c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:47.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.678+0000 7ffb60a00640 1 -- 172.21.15.131:0/483100624 shutdown_connections 2024-04-12T19:39:47.679 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.678+0000 7ffb60a00640 1 -- 172.21.15.131:0/483100624 wait complete. 2024-04-12T19:39:47.696 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-12T19:39:47.905 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.905+0000 7f0dcd200640 1 Processor -- start 2024-04-12T19:39:47.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.905+0000 7f0dcd200640 1 -- start start 2024-04-12T19:39:47.906 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.906+0000 7f0dcd200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f0dc80a4d60 0x7f0dc81591d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.906+0000 7f0dcd200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dc806e380 con 0x7f0dc8159710 2024-04-12T19:39:47.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.906+0000 7f0dcd200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dc80bd660 con 0x7f0dc80bf720 2024-04-12T19:39:47.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.906+0000 7f0dcd200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f0dc806e660 con 0x7f0dc80a4d60 2024-04-12T19:39:47.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.907+0000 7f0dc6800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f0dc8159710 0x7f0dc815ff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34312/0 (socket says 172.21.15.131:34312) 2024-04-12T19:39:47.907 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.907+0000 7f0dc6800640 1 -- 172.21.15.131:0/1523627968 learned_addr learned my addr 172.21.15.131:0/1523627968 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.907+0000 7f0dbfe00640 1 --2- 172.21.15.131:0/1523627968 >> v2:172.21.15.171:3300/0 conn(0x7f0dc80a4d60 0x7f0dc81591d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.907+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385417501 0 0) 0x7f0dc806e380 con 0x7f0dc8159710 2024-04-12T19:39:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.907+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dac003520 con 0x7f0dc8159710 2024-04-12T19:39:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3420162778 0 0) 0x7f0dac003520 con 0x7f0dc8159710 2024-04-12T19:39:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 >> v2:172.21.15.171:3300/0 conn(0x7f0dc80a4d60 msgr2=0x7f0dc81591d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 --2- 172.21.15.131:0/1523627968 >> v2:172.21.15.171:3300/0 conn(0x7f0dc80a4d60 0x7f0dc81591d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 >> v1:172.21.15.171:6789/0 conn(0x7f0dc80bf720 legacy=0x7f0dc80be140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc80bd940 con 0x7f0dc8159710 2024-04-12T19:39:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f0dc00019f0 con 0x7f0dc8159710 2024-04-12T19:39:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 >> v1:172.21.15.131:6789/0 conn(0x7f0dc8159710 legacy=0x7f0dc815ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 --2- 172.21.15.131:0/1523627968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dac0039b0 0x7f0dac003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.909 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 --2- 172.21.15.131:0/1523627968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dac004800 0x7f0dac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 --2- 172.21.15.131:0/1523627968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dac0051c0 0x7f0dac00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc806e660 con 0x7f0dac0039b0 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0dac00c060 con 0x7f0dac004800 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0dac00c260 con 0x7f0dac0051c0 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc5e00640 1 --2- 172.21.15.131:0/1523627968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dac0039b0 0x7f0dac003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dc6800640 1 --2- 172.21.15.131:0/1523627968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dac0051c0 0x7f0dac00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.908+0000 7f0dbfe00640 1 --2- 172.21.15.131:0/1523627968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dac004800 0x7f0dac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.909+0000 7f0dc5e00640 1 -- 172.21.15.131:0/1523627968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dac0051c0 msgr2=0x7f0dac00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.909+0000 7f0dc5e00640 1 --2- 172.21.15.131:0/1523627968 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dac0051c0 0x7f0dac00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.909+0000 7f0dc5e00640 1 -- 172.21.15.131:0/1523627968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dac004800 msgr2=0x7f0dac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.909+0000 7f0dc5e00640 1 --2- 172.21.15.131:0/1523627968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dac004800 0x7f0dac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.909+0000 7f0dc5e00640 1 -- 172.21.15.131:0/1523627968 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dac003520 con 0x7f0dac0039b0 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.909+0000 7f0dc6800640 1 -- 172.21.15.131:0/1523627968 reap_dead start 2024-04-12T19:39:47.910 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.909+0000 7f0dbfe00640 1 --2- 172.21.15.131:0/1523627968 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dac004800 0x7f0dac004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T19:39:47.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.910+0000 7f0dc5e00640 1 --2- 172.21.15.131:0/1523627968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dac0039b0 0x7f0dac003dd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0db8001750 tx=0x7f0dac005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c2a193f0f18e487 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:47.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.910+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8001370 con 0x7f0dac0039b0 2024-04-12T19:39:47.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.910+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0db80052d0 con 0x7f0dac0039b0 2024-04-12T19:39:47.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.910+0000 7f0dc5400640 1 -- 172.21.15.131:0/1523627968 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0db8003830 con 0x7f0dac0039b0 2024-04-12T19:39:47.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.911+0000 7f0dcd200640 1 -- 172.21.15.131:0/1523627968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dac0039b0 msgr2=0x7f0dac003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.911+0000 7f0dcd200640 1 --2- 172.21.15.131:0/1523627968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dac0039b0 0x7f0dac003dd0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0db8001750 tx=0x7f0dac005830 comp rx=0 tx=0).stop 2024-04-12T19:39:47.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.911+0000 7f0dcd200640 1 -- 172.21.15.131:0/1523627968 shutdown_connections 2024-04-12T19:39:47.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.911+0000 7f0dcd200640 1 --2- 172.21.15.131:0/1523627968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dac0039b0 0x7f0dac003dd0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.911+0000 7f0dcd200640 1 -- 172.21.15.131:0/1523627968 >> 172.21.15.131:0/1523627968 conn(0x7f0dc806be00 msgr2=0x7f0dc806c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:47.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.911+0000 7f0dcd200640 1 -- 172.21.15.131:0/1523627968 shutdown_connections 2024-04-12T19:39:47.912 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.911+0000 7f0dcd200640 1 -- 172.21.15.131:0/1523627968 wait complete. 2024-04-12T19:39:47.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.913+0000 7f0dcd200640 1 Processor -- start 2024-04-12T19:39:47.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.913+0000 7f0dcd200640 1 -- start start 2024-04-12T19:39:47.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.913+0000 7f0dcd200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dac0039b0 0x7f0dc80c1db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.913+0000 7f0dcd200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dc80c22f0 0x7f0dc80bc150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.913+0000 7f0dcd200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dc80bc690 0x7f0dc81ee610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dcd200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc80bee20 con 0x7f0dc80bc690 2024-04-12T19:39:47.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dcd200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f0dc80bdcb0 con 0x7f0dc80c22f0 2024-04-12T19:39:47.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dcd200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f0dc80bfb00 con 0x7f0dac0039b0 2024-04-12T19:39:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dc6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dc80bc690 0x7f0dc81ee610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dc6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dc80bc690 0x7f0dc81ee610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41586/0 (socket says 172.21.15.131:41586) 2024-04-12T19:39:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dc6800640 1 -- 172.21.15.131:0/3004732955 learned_addr learned my addr 172.21.15.131:0/3004732955 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dc5e00640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dac0039b0 0x7f0dc80c1db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dc6800640 1 -- 172.21.15.131:0/3004732955 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dac0039b0 msgr2=0x7f0dc80c1db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dc6800640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dac0039b0 0x7f0dc80c1db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dc6800640 1 -- 172.21.15.131:0/3004732955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dc80c22f0 msgr2=0x7f0dc80bc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dc6800640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dc80c22f0 0x7f0dc80bc150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dc6800640 1 -- 172.21.15.131:0/3004732955 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dc8154110 con 0x7f0dc80bc690 2024-04-12T19:39:47.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.914+0000 7f0dc6800640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dc80bc690 0x7f0dc81ee610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80b8950 tx=0x7f0dc0007a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.915+0000 7f0dbe000640 1 -- 172.21.15.131:0/3004732955 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc0017020 con 0x7f0dc80bc690 2024-04-12T19:39:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.915+0000 7f0dbe000640 1 -- 172.21.15.131:0/3004732955 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0dc000aac0 con 0x7f0dc80bc690 2024-04-12T19:39:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.915+0000 7f0dbe000640 1 -- 172.21.15.131:0/3004732955 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc00133f0 con 0x7f0dc80bc690 2024-04-12T19:39:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.915+0000 7f0dcd200640 1 -- 172.21.15.131:0/3004732955 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dc81ef130 con 0x7f0dc80bc690 2024-04-12T19:39:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.915+0000 7f0dcd200640 1 -- 172.21.15.131:0/3004732955 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dc80c0490 con 0x7f0dc80bc690 2024-04-12T19:39:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.916+0000 7f0dcd200640 1 -- 172.21.15.131:0/3004732955 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dc804fd50 con 0x7f0dc80bc690 2024-04-12T19:39:47.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.917+0000 7f0dbe000640 1 -- 172.21.15.131:0/3004732955 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f0dc001a020 con 0x7f0dc80bc690 2024-04-12T19:39:47.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.918+0000 7f0dbe000640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0da406c920 0x7f0da406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:47.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.918+0000 7f0dbe000640 1 -- 172.21.15.131:0/3004732955 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0dc008c580 con 0x7f0dc80bc690 2024-04-12T19:39:47.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.918+0000 7f0dc5e00640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0da406c920 0x7f0da406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:47.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.919+0000 7f0dc5e00640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0da406c920 0x7f0da406ede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0db8033000 tx=0x7f0db8009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:47.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:47.922+0000 7f0dbe000640 1 -- 172.21.15.131:0/3004732955 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f0dc0021020 con 0x7f0dc80bc690 2024-04-12T19:39:48.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.124+0000 7f0dcd200640 1 -- 172.21.15.131:0/3004732955 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0dc8158c60 con 0x7f0dc80bc690 2024-04-12T19:39:48.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.125+0000 7f0dbe000640 1 -- 172.21.15.131:0/3004732955 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f0dc005a5d0 con 0x7f0dc80bc690 2024-04-12T19:39:48.125 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T19:39:48.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.128+0000 7f0dcd200640 1 -- 172.21.15.131:0/3004732955 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0da406c920 msgr2=0x7f0da406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.128+0000 7f0dcd200640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0da406c920 0x7f0da406ede0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f0db8033000 tx=0x7f0db8009030 comp rx=0 tx=0).stop 2024-04-12T19:39:48.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.128+0000 7f0dcd200640 1 -- 172.21.15.131:0/3004732955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dc80bc690 msgr2=0x7f0dc81ee610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.128+0000 7f0dcd200640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dc80bc690 0x7f0dc81ee610 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f0dc80b8950 tx=0x7f0dc0007a90 comp rx=0 tx=0).stop 2024-04-12T19:39:48.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.128+0000 7f0dcd200640 1 -- 172.21.15.131:0/3004732955 shutdown_connections 2024-04-12T19:39:48.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.128+0000 7f0dcd200640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f0da406c920 0x7f0da406ede0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.128 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.128+0000 7f0dcd200640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f0dc80c22f0 0x7f0dc80bc150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.128+0000 7f0dcd200640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0dc80bc690 0x7f0dc81ee610 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.128+0000 7f0dcd200640 1 --2- 172.21.15.131:0/3004732955 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f0dac0039b0 0x7f0dc80c1db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.129+0000 7f0dcd200640 1 -- 172.21.15.131:0/3004732955 >> 172.21.15.131:0/3004732955 conn(0x7f0dc806be00 msgr2=0x7f0dc80be040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:48.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.129+0000 7f0dcd200640 1 -- 172.21.15.131:0/3004732955 shutdown_connections 2024-04-12T19:39:48.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.129+0000 7f0dcd200640 1 -- 172.21.15.131:0/3004732955 wait complete. 2024-04-12T19:39:48.148 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-12T19:39:48.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.342+0000 7fd009200640 1 Processor -- start 2024-04-12T19:39:48.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.342+0000 7fd009200640 1 -- start start 2024-04-12T19:39:48.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.343+0000 7fd009200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fd0040a6950 0x7fd00415a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.343+0000 7fd009200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd004152d10 con 0x7fd0040bdbc0 2024-04-12T19:39:48.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.343+0000 7fd009200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0040be570 con 0x7fd0040734c0 2024-04-12T19:39:48.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.343+0000 7fd009200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fd0040be320 con 0x7fd0040a6950 2024-04-12T19:39:48.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.343+0000 7fcffbe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fd0040bdbc0 0x7fd0040a6240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34326/0 (socket says 172.21.15.131:34326) 2024-04-12T19:39:48.343 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.343+0000 7fcffbe00640 1 -- 172.21.15.131:0/1096756500 learned_addr learned my addr 172.21.15.131:0/1096756500 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:48.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd003e00640 1 --2- 172.21.15.131:0/1096756500 >> v2:172.21.15.171:3300/0 conn(0x7fd0040a6950 0x7fd00415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:48.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531222330 0 0) 0x7fd004152d10 con 0x7fd0040bdbc0 2024-04-12T19:39:48.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcfe8003520 con 0x7fd0040bdbc0 2024-04-12T19:39:48.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1871516334 0 0) 0x7fcfe8003520 con 0x7fd0040bdbc0 2024-04-12T19:39:48.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 >> v2:172.21.15.171:3300/0 conn(0x7fd0040a6950 msgr2=0x7fd00415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 --2- 172.21.15.131:0/1096756500 >> v2:172.21.15.171:3300/0 conn(0x7fd0040a6950 0x7fd00415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 >> v1:172.21.15.171:6789/0 conn(0x7fd0040734c0 legacy=0x7fd0041521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0040be850 con 0x7fd0040bdbc0 2024-04-12T19:39:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7fcfec001670 con 0x7fd0040bdbc0 2024-04-12T19:39:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 >> v1:172.21.15.131:6789/0 conn(0x7fd0040bdbc0 legacy=0x7fd0040a6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 --2- 172.21.15.131:0/1096756500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfe80039b0 0x7fcfe8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 --2- 172.21.15.131:0/1096756500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 0x7fcfe8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 --2- 172.21.15.131:0/1096756500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe80051c0 0x7fcfe800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd0040be320 con 0x7fcfe8004800 2024-04-12T19:39:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fcfe800c160 con 0x7fcfe80051c0 2024-04-12T19:39:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.344+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fcfe800c360 con 0x7fcfe80039b0 2024-04-12T19:39:48.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.345+0000 7fcffbe00640 1 --2- 172.21.15.131:0/1096756500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 0x7fcfe8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:48.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.345+0000 7fd003400640 1 --2- 172.21.15.131:0/1096756500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfe80039b0 0x7fcfe8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:48.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.345+0000 7fcffbe00640 1 -- 172.21.15.131:0/1096756500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfe80039b0 msgr2=0x7fcfe8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:48.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.345+0000 7fcffbe00640 1 --2- 172.21.15.131:0/1096756500 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fcfe80039b0 0x7fcfe8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.345+0000 7fcffbe00640 1 -- 172.21.15.131:0/1096756500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe80051c0 msgr2=0x7fcfe800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:48.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.345+0000 7fcffbe00640 1 --2- 172.21.15.131:0/1096756500 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fcfe80051c0 0x7fcfe800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.345+0000 7fcffbe00640 1 -- 172.21.15.131:0/1096756500 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfe8003520 con 0x7fcfe8004800 2024-04-12T19:39:48.347 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.345+0000 7fd003e00640 1 -- 172.21.15.131:0/1096756500 reap_dead start 2024-04-12T19:39:48.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.346+0000 7fcffbe00640 1 --2- 172.21.15.131:0/1096756500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 0x7fcfe8004c80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00c240 tx=0x7fcfe8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71eaf13ca75d6e15 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:48.348 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.346+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec007cf0 con 0x7fcfe8004800 2024-04-12T19:39:48.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.346+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfec030070 con 0x7fcfe8004800 2024-04-12T19:39:48.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.346+0000 7fd002a00640 1 -- 172.21.15.131:0/1096756500 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfec005d70 con 0x7fcfe8004800 2024-04-12T19:39:48.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.347+0000 7fd009200640 1 -- 172.21.15.131:0/1096756500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 msgr2=0x7fcfe8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.347+0000 7fd009200640 1 --2- 172.21.15.131:0/1096756500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 0x7fcfe8004c80 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fcfec00c240 tx=0x7fcfe8005830 comp rx=0 tx=0).stop 2024-04-12T19:39:48.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.347+0000 7fd009200640 1 -- 172.21.15.131:0/1096756500 shutdown_connections 2024-04-12T19:39:48.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.347+0000 7fd009200640 1 --2- 172.21.15.131:0/1096756500 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 0x7fcfe8004c80 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.347+0000 7fd009200640 1 -- 172.21.15.131:0/1096756500 >> 172.21.15.131:0/1096756500 conn(0x7fd0040c24d0 msgr2=0x7fd0040c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:48.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.347+0000 7fd009200640 1 -- 172.21.15.131:0/1096756500 shutdown_connections 2024-04-12T19:39:48.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.347+0000 7fd009200640 1 -- 172.21.15.131:0/1096756500 wait complete. 2024-04-12T19:39:48.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.348+0000 7fd009200640 1 Processor -- start 2024-04-12T19:39:48.349 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.349+0000 7fd009200640 1 -- start start 2024-04-12T19:39:48.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.349+0000 7fd009200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 0x7fd0041440d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.349+0000 7fd009200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0041e6b60 0x7fd004151020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.349+0000 7fd009200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd004151560 0x7fd0041e9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.351 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.349+0000 7fd009200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd0040738a0 con 0x7fcfe8004800 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.349+0000 7fd009200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0040a8320 con 0x7fd0041e6b60 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.349+0000 7fd009200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd0040a7cd0 con 0x7fd004151560 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.350+0000 7fd003400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 0x7fd0041440d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.350+0000 7fd003400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 0x7fd0041440d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41604/0 (socket says 172.21.15.131:41604) 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.350+0000 7fd003400640 1 -- 172.21.15.131:0/2267059577 learned_addr learned my addr 172.21.15.131:0/2267059577 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.350+0000 7fd003400640 1 -- 172.21.15.131:0/2267059577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd004151560 msgr2=0x7fd0041e9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.350+0000 7fd003400640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd004151560 0x7fd0041e9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.350+0000 7fd003400640 1 -- 172.21.15.131:0/2267059577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0041e6b60 msgr2=0x7fd004151020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.350+0000 7fcffbe00640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0041e6b60 0x7fd004151020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.350+0000 7fd003400640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0041e6b60 0x7fd004151020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.350+0000 7fd003400640 1 -- 172.21.15.131:0/2267059577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0041e74e0 con 0x7fcfe8004800 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.350+0000 7fd003400640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 0x7fd0041440d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcff4007fd0 tx=0x7fcff400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.351+0000 7fcffb400640 1 -- 172.21.15.131:0/2267059577 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4019070 con 0x7fcfe8004800 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.351+0000 7fcffb400640 1 -- 172.21.15.131:0/2267059577 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcff40053a0 con 0x7fcfe8004800 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.351+0000 7fcffb400640 1 -- 172.21.15.131:0/2267059577 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff4003810 con 0x7fcfe8004800 2024-04-12T19:39:48.352 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.351+0000 7fd009200640 1 -- 172.21.15.131:0/2267059577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0040bc140 con 0x7fcfe8004800 2024-04-12T19:39:48.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.351+0000 7fd009200640 1 -- 172.21.15.131:0/2267059577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd004144e70 con 0x7fcfe8004800 2024-04-12T19:39:48.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.352+0000 7fd009200640 1 -- 172.21.15.131:0/2267059577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd004075c30 con 0x7fcfe8004800 2024-04-12T19:39:48.353 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.353+0000 7fcffb400640 1 -- 172.21.15.131:0/2267059577 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fcff401c070 con 0x7fcfe8004800 2024-04-12T19:39:48.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.354+0000 7fcffb400640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcfe006c8f0 0x7fcfe006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.354+0000 7fcffb400640 1 -- 172.21.15.131:0/2267059577 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fcff408b490 con 0x7fcfe8004800 2024-04-12T19:39:48.354 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.354+0000 7fcffbe00640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcfe006c8f0 0x7fcfe006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:48.355 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.355+0000 7fcffbe00640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcfe006c8f0 0x7fcfe006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcfec034000 tx=0x7fcfec039040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:48.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.359+0000 7fcffb400640 1 -- 172.21.15.131:0/2267059577 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fcff4058e90 con 0x7fcfe8004800 2024-04-12T19:39:48.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.598+0000 7fd009200640 1 -- 172.21.15.131:0/2267059577 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0040bd9a0 con 0x7fcfe8004800 2024-04-12T19:39:48.599 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.599+0000 7fcffb400640 1 -- 172.21.15.131:0/2267059577 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5186 (secure 0 0 0) 0x7fcff405d190 con 0x7fcfe8004800 2024-04-12T19:39:48.599 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:48.599 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3941197710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3941197710},{"type":"v1","addr":"172.21.15.131:6836","nonce":3941197710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2898590457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2898590457},{"type":"v1","addr":"172.21.15.131:6837","nonce":2898590457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/373698102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":373698102},{"type":"v1","addr":"172.21.15.171:6835","nonce":373698102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T19:39:10.876760+0000","modified":"2024-04-12T19:39:37.561387+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6834/1013642393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1013642393},{"type":"v1","addr":"172.21.15.171:6834","nonce":1013642393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4257,"qdb_cluster":[4257]},"id":1}]} 2024-04-12T19:39:48.600 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-04-12T19:39:48.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.602+0000 7fd009200640 1 -- 172.21.15.131:0/2267059577 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcfe006c8f0 msgr2=0x7fcfe006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.602+0000 7fd009200640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcfe006c8f0 0x7fcfe006edb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fcfec034000 tx=0x7fcfec039040 comp rx=0 tx=0).stop 2024-04-12T19:39:48.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.602+0000 7fd009200640 1 -- 172.21.15.131:0/2267059577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 msgr2=0x7fd0041440d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.602+0000 7fd009200640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 0x7fd0041440d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fcff4007fd0 tx=0x7fcff400e820 comp rx=0 tx=0).stop 2024-04-12T19:39:48.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.602+0000 7fd009200640 1 -- 172.21.15.131:0/2267059577 shutdown_connections 2024-04-12T19:39:48.602 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.602+0000 7fd009200640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fcfe006c8f0 0x7fcfe006edb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.602+0000 7fd009200640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0041e6b60 0x7fd004151020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.602+0000 7fd009200640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd004151560 0x7fd0041e9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.602+0000 7fd009200640 1 --2- 172.21.15.131:0/2267059577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcfe8004800 0x7fd0041440d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.602+0000 7fd009200640 1 -- 172.21.15.131:0/2267059577 >> 172.21.15.131:0/2267059577 conn(0x7fd0040c24d0 msgr2=0x7fd004072240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:48.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.602+0000 7fd009200640 1 -- 172.21.15.131:0/2267059577 shutdown_connections 2024-04-12T19:39:48.603 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.602+0000 7fd009200640 1 -- 172.21.15.131:0/2267059577 wait complete. 2024-04-12T19:39:48.621 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:48.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.814+0000 7f4dda800640 1 Processor -- start 2024-04-12T19:39:48.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.815+0000 7f4dda800640 1 -- start start 2024-04-12T19:39:48.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.815+0000 7f4dda800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f4dd40c1520 0x7f4dd414b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.815+0000 7f4dda800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4dd414b600 0x7f4dd406da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.816+0000 7f4dda800640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4dd41553e0 con 0x7f4dd40c4730 2024-04-12T19:39:48.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.816+0000 7f4dda800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f4dd406c240 con 0x7f4dd40c1520 2024-04-12T19:39:48.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.816+0000 7f4dda800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd406cf90 con 0x7f4dd414b600 2024-04-12T19:39:48.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.816+0000 7f4dd2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4dd414b600 0x7f4dd406da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:48.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.816+0000 7f4dd2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4dd414b600 0x7f4dd406da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:46574/0 (socket says 172.21.15.131:46574) 2024-04-12T19:39:48.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.816+0000 7f4dd2a00640 1 -- 172.21.15.131:0/3404021502 learned_addr learned my addr 172.21.15.131:0/3404021502 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:48.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.816+0000 7f4dd3400640 1 --2- 172.21.15.131:0/3404021502 >> v2:172.21.15.171:3300/0 conn(0x7f4dd40c1520 0x7f4dd414b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:48.898 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.817+0000 7f4dd2a00640 1 -- 172.21.15.131:0/3404021502 >> v2:172.21.15.171:3300/0 conn(0x7f4dd40c1520 msgr2=0x7f4dd414b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:48.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.817+0000 7f4dd2a00640 1 --2- 172.21.15.131:0/3404021502 >> v2:172.21.15.171:3300/0 conn(0x7f4dd40c1520 0x7f4dd414b0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.817+0000 7f4dd2a00640 1 -- 172.21.15.131:0/3404021502 >> v1:172.21.15.171:6789/0 conn(0x7f4dd40c4730 legacy=0x7f4dd40bfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.817+0000 7f4dd2a00640 1 -- 172.21.15.131:0/3404021502 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd406d270 con 0x7f4dd414b600 2024-04-12T19:39:48.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.818+0000 7f4dd2a00640 1 --2- 172.21.15.131:0/3404021502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4dd414b600 0x7f4dd406da70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009870 tx=0x7f4dc402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3a911ad92ee3dd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:48.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.819+0000 7f4dd2000640 1 -- 172.21.15.131:0/3404021502 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4034070 con 0x7f4dd414b600 2024-04-12T19:39:48.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.819+0000 7f4dd2000640 1 -- 172.21.15.131:0/3404021502 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc4030840 con 0x7f4dd414b600 2024-04-12T19:39:48.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.819+0000 7f4dd2000640 1 -- 172.21.15.131:0/3404021502 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4030c10 con 0x7f4dd414b600 2024-04-12T19:39:48.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.819+0000 7f4dda800640 1 -- 172.21.15.131:0/3404021502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4dd414b600 msgr2=0x7f4dd406da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.899 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.819+0000 7f4dda800640 1 --2- 172.21.15.131:0/3404021502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4dd414b600 0x7f4dd406da70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009870 tx=0x7f4dc402b980 comp rx=0 tx=0).stop 2024-04-12T19:39:48.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.819+0000 7f4dda800640 1 -- 172.21.15.131:0/3404021502 shutdown_connections 2024-04-12T19:39:48.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.819+0000 7f4dda800640 1 --2- 172.21.15.131:0/3404021502 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4dd414b600 0x7f4dd406da70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.819+0000 7f4dda800640 1 --2- 172.21.15.131:0/3404021502 >> v2:172.21.15.171:3300/0 conn(0x7f4dd40c1520 0x7f4dd414b0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.819+0000 7f4dda800640 1 -- 172.21.15.131:0/3404021502 >> 172.21.15.131:0/3404021502 conn(0x7f4dd40a8420 msgr2=0x7f4dd40a8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:48.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.819+0000 7f4dda800640 1 -- 172.21.15.131:0/3404021502 shutdown_connections 2024-04-12T19:39:48.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.819+0000 7f4dda800640 1 -- 172.21.15.131:0/3404021502 wait complete. 2024-04-12T19:39:48.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.821+0000 7f4dda800640 1 Processor -- start 2024-04-12T19:39:48.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.821+0000 7f4dda800640 1 -- start start 2024-04-12T19:39:48.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.822+0000 7f4dda800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4dd40c1520 0x7f4dd41ddd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.822+0000 7f4dda800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dd40c4730 0x7f4dd40b8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.822+0000 7f4dda800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dd414b600 0x7f4dd40b8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.901 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.822+0000 7f4dda800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd40c0c10 con 0x7f4dd40c4730 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.822+0000 7f4dda800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4dd4155090 con 0x7f4dd414b600 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.822+0000 7f4dda800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4dd40c0d90 con 0x7f4dd40c1520 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.822+0000 7f4dd2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dd40c4730 0x7f4dd40b8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.822+0000 7f4dd2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dd40c4730 0x7f4dd40b8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41608/0 (socket says 172.21.15.131:41608) 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.822+0000 7f4dd2a00640 1 -- 172.21.15.131:0/475619787 learned_addr learned my addr 172.21.15.131:0/475619787 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.823+0000 7f4dd3400640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4dd40c1520 0x7f4dd41ddd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.823+0000 7f4dd3e00640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dd414b600 0x7f4dd40b8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.823+0000 7f4dd2a00640 1 -- 172.21.15.131:0/475619787 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4dd40c1520 msgr2=0x7f4dd41ddd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.823+0000 7f4dd2a00640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4dd40c1520 0x7f4dd41ddd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.823+0000 7f4dd2a00640 1 -- 172.21.15.131:0/475619787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dd414b600 msgr2=0x7f4dd40b8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.823+0000 7f4dd2a00640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dd414b600 0x7f4dd40b8ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.823+0000 7f4dd2a00640 1 -- 172.21.15.131:0/475619787 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4dd41de2a0 con 0x7f4dd40c4730 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.823+0000 7f4dd2a00640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dd40c4730 0x7f4dd40b8590 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009870 tx=0x7f4dc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:48.902 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.823+0000 7f4dcb400640 1 -- 172.21.15.131:0/475619787 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4034040 con 0x7f4dd40c4730 2024-04-12T19:39:48.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.823+0000 7f4dcb400640 1 -- 172.21.15.131:0/475619787 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dc4039d90 con 0x7f4dd40c4730 2024-04-12T19:39:48.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.824+0000 7f4dda800640 1 -- 172.21.15.131:0/475619787 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4dd4152250 con 0x7f4dd40c4730 2024-04-12T19:39:48.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.824+0000 7f4dcb400640 1 -- 172.21.15.131:0/475619787 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dc4043610 con 0x7f4dd40c4730 2024-04-12T19:39:48.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.824+0000 7f4dda800640 1 -- 172.21.15.131:0/475619787 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4dd414f100 con 0x7f4dd40c4730 2024-04-12T19:39:48.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.825+0000 7f4dda800640 1 -- 172.21.15.131:0/475619787 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4dd404fd50 con 0x7f4dd40c4730 2024-04-12T19:39:48.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.826+0000 7f4dcb400640 1 -- 172.21.15.131:0/475619787 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4dc404a060 con 0x7f4dd40c4730 2024-04-12T19:39:48.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.827+0000 7f4dcb400640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f4db006c8f0 0x7f4db006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:48.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.827+0000 7f4dcb400640 1 -- 172.21.15.131:0/475619787 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f4dc40adde0 con 0x7f4dd40c4730 2024-04-12T19:39:48.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.827+0000 7f4dd3400640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f4db006c8f0 0x7f4db006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:48.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.828+0000 7f4dd3400640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f4db006c8f0 0x7f4db006edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009ad0 tx=0x7f4dbc008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:48.903 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:48.831+0000 7f4dcb400640 1 -- 172.21.15.131:0/475619787 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f4dc403e070 con 0x7f4dd40c4730 2024-04-12T19:39:49.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.034+0000 7f4dda800640 1 -- 172.21.15.131:0/475619787 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4dd40a8f90 con 0x7f4dd40c4730 2024-04-12T19:39:49.036 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.036+0000 7f4dcb400640 1 -- 172.21.15.131:0/475619787 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f4dc402d330 con 0x7f4dd40c4730 2024-04-12T19:39:49.036 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:49.037 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":26,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:17.479662+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:49.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.039+0000 7f4dda800640 1 -- 172.21.15.131:0/475619787 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f4db006c8f0 msgr2=0x7f4db006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.039+0000 7f4dda800640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f4db006c8f0 0x7f4db006edb0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4dbc009ad0 tx=0x7f4dbc008040 comp rx=0 tx=0).stop 2024-04-12T19:39:49.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.039+0000 7f4dda800640 1 -- 172.21.15.131:0/475619787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dd40c4730 msgr2=0x7f4dd40b8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.039+0000 7f4dda800640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dd40c4730 0x7f4dd40b8590 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f4dc4009870 tx=0x7f4dc40046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.039+0000 7f4dda800640 1 -- 172.21.15.131:0/475619787 shutdown_connections 2024-04-12T19:39:49.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.039+0000 7f4dda800640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f4db006c8f0 0x7f4db006edb0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.039+0000 7f4dda800640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4dd414b600 0x7f4dd40b8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.039+0000 7f4dda800640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4dd40c4730 0x7f4dd40b8590 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.039+0000 7f4dda800640 1 --2- 172.21.15.131:0/475619787 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4dd40c1520 0x7f4dd41ddd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.039+0000 7f4dda800640 1 -- 172.21.15.131:0/475619787 >> 172.21.15.131:0/475619787 conn(0x7f4dd40a8420 msgr2=0x7f4dd40c3310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:49.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.039+0000 7f4dda800640 1 -- 172.21.15.131:0/475619787 shutdown_connections 2024-04-12T19:39:49.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.039+0000 7f4dda800640 1 -- 172.21.15.131:0/475619787 wait complete. 2024-04-12T19:39:49.059 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T19:39:04.855067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-12T19:39:09.370965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-12T19:39:09.858079+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-12T19:39:13.479306+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-12T19:39:49.060 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T19:39:49.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.272+0000 7f10d7200640 1 Processor -- start 2024-04-12T19:39:49.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.272+0000 7f10d7200640 1 -- start start 2024-04-12T19:39:49.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.274+0000 7f10d7200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10d80be030 0x7f10d81510b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.274+0000 7f10d7200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f10d81515f0 0x7f10d8158440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.274+0000 7f10d7200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10d80a7410 con 0x7f10d8147fb0 2024-04-12T19:39:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.274+0000 7f10d7200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f10d806d3d0 con 0x7f10d81515f0 2024-04-12T19:39:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.274+0000 7f10d7200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f10d80be9f0 con 0x7f10d80be030 2024-04-12T19:39:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.274+0000 7f10d6800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f10d81515f0 0x7f10d8158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.274+0000 7f10d6800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f10d81515f0 0x7f10d8158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41610/0 (socket says 172.21.15.131:41610) 2024-04-12T19:39:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.274+0000 7f10d6800640 1 -- 172.21.15.131:0/1664199492 learned_addr learned my addr 172.21.15.131:0/1664199492 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.274+0000 7f10cd400640 1 --2- 172.21.15.131:0/1664199492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10d80be030 0x7f10d81510b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.275+0000 7f10d6800640 1 -- 172.21.15.131:0/1664199492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10d80be030 msgr2=0x7f10d81510b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.275+0000 7f10d6800640 1 --2- 172.21.15.131:0/1664199492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10d80be030 0x7f10d81510b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.275+0000 7f10d6800640 1 -- 172.21.15.131:0/1664199492 >> v1:172.21.15.171:6789/0 conn(0x7f10d8147fb0 legacy=0x7f10d806f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.275+0000 7f10d6800640 1 -- 172.21.15.131:0/1664199492 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d80a7680 con 0x7f10d81515f0 2024-04-12T19:39:49.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.276+0000 7f10d6800640 1 --2- 172.21.15.131:0/1664199492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d81515f0 0x7f10d8158440 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009870 tx=0x7f10d002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a127cdaf73c4b414 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:49.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.276+0000 7f10d5400640 1 -- 172.21.15.131:0/1664199492 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0034070 con 0x7f10d81515f0 2024-04-12T19:39:49.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.276+0000 7f10d5400640 1 -- 172.21.15.131:0/1664199492 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d0030840 con 0x7f10d81515f0 2024-04-12T19:39:49.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.276+0000 7f10d5400640 1 -- 172.21.15.131:0/1664199492 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0030c10 con 0x7f10d81515f0 2024-04-12T19:39:49.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.277+0000 7f10d7200640 1 -- 172.21.15.131:0/1664199492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d81515f0 msgr2=0x7f10d8158440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.277+0000 7f10d7200640 1 --2- 172.21.15.131:0/1664199492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d81515f0 0x7f10d8158440 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f10d0009870 tx=0x7f10d002b980 comp rx=0 tx=0).stop 2024-04-12T19:39:49.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.277+0000 7f10d7200640 1 -- 172.21.15.131:0/1664199492 shutdown_connections 2024-04-12T19:39:49.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.277+0000 7f10d7200640 1 --2- 172.21.15.131:0/1664199492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d81515f0 0x7f10d8158440 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.277+0000 7f10d7200640 1 --2- 172.21.15.131:0/1664199492 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10d80be030 0x7f10d81510b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.277+0000 7f10d7200640 1 -- 172.21.15.131:0/1664199492 >> 172.21.15.131:0/1664199492 conn(0x7f10d806b9e0 msgr2=0x7f10d806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:49.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.277+0000 7f10d7200640 1 -- 172.21.15.131:0/1664199492 shutdown_connections 2024-04-12T19:39:49.277 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.277+0000 7f10d7200640 1 -- 172.21.15.131:0/1664199492 wait complete. 2024-04-12T19:39:49.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.278+0000 7f10d7200640 1 Processor -- start 2024-04-12T19:39:49.278 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.279+0000 7f10d7200640 1 -- start start 2024-04-12T19:39:49.279 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.279+0000 7f10d7200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10d80be030 0x7f10d81e7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.279+0000 7f10d7200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10d8147fb0 0x7f10d8141580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.279+0000 7f10d7200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d81515f0 0x7f10d8141ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.279+0000 7f10d7200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f10d806c980 con 0x7f10d81515f0 2024-04-12T19:39:49.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.279+0000 7f10d7200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f10d80a7c40 con 0x7f10d8147fb0 2024-04-12T19:39:49.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.279+0000 7f10d7200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f10d806f720 con 0x7f10d80be030 2024-04-12T19:39:49.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.280+0000 7f10d6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d81515f0 0x7f10d8141ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.280+0000 7f10d6800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d81515f0 0x7f10d8141ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41616/0 (socket says 172.21.15.131:41616) 2024-04-12T19:39:49.280 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.280+0000 7f10d6800640 1 -- 172.21.15.131:0/2137037860 learned_addr learned my addr 172.21.15.131:0/2137037860 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:49.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.280+0000 7f10d6800640 1 -- 172.21.15.131:0/2137037860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10d80be030 msgr2=0x7f10d81e7f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.280+0000 7f10d6800640 1 --2- 172.21.15.131:0/2137037860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10d80be030 0x7f10d81e7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.280+0000 7f10d6800640 1 -- 172.21.15.131:0/2137037860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10d8147fb0 msgr2=0x7f10d8141580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.280+0000 7f10d6800640 1 --2- 172.21.15.131:0/2137037860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10d8147fb0 0x7f10d8141580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.280+0000 7f10d6800640 1 -- 172.21.15.131:0/2137037860 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10d81e8c60 con 0x7f10d81515f0 2024-04-12T19:39:49.282 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.280+0000 7f10d6800640 1 --2- 172.21.15.131:0/2137037860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d81515f0 0x7f10d8141ac0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f10d00090b0 tx=0x7f10d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:49.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.281+0000 7f10cea00640 1 -- 172.21.15.131:0/2137037860 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0034040 con 0x7f10d81515f0 2024-04-12T19:39:49.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.281+0000 7f10cea00640 1 -- 172.21.15.131:0/2137037860 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10d003ada0 con 0x7f10d81515f0 2024-04-12T19:39:49.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.281+0000 7f10cea00640 1 -- 172.21.15.131:0/2137037860 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10d0044630 con 0x7f10d81515f0 2024-04-12T19:39:49.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.281+0000 7f10d7200640 1 -- 172.21.15.131:0/2137037860 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10d8073a00 con 0x7f10d81515f0 2024-04-12T19:39:49.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.281+0000 7f10d7200640 1 -- 172.21.15.131:0/2137037860 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10d80bb2c0 con 0x7f10d81515f0 2024-04-12T19:39:49.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.282+0000 7f10d7200640 1 -- 172.21.15.131:0/2137037860 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10d804fd50 con 0x7f10d81515f0 2024-04-12T19:39:49.283 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.283+0000 7f10cea00640 1 -- 172.21.15.131:0/2137037860 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f10d004b060 con 0x7f10d81515f0 2024-04-12T19:39:49.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.284+0000 7f10cea00640 1 --2- 172.21.15.131:0/2137037860 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f10b406c920 0x7f10b406ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.285+0000 7f10cea00640 1 -- 172.21.15.131:0/2137037860 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f10d00adea0 con 0x7f10d81515f0 2024-04-12T19:39:49.284 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.285+0000 7f10d5e00640 1 --2- 172.21.15.131:0/2137037860 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f10b406c920 0x7f10b406ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.285 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.285+0000 7f10d5e00640 1 --2- 172.21.15.131:0/2137037860 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f10b406c920 0x7f10b406ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f10c8000f60 tx=0x7f10c80079d0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:49.289 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.289+0000 7f10cea00640 1 -- 172.21.15.131:0/2137037860 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f10d003f070 con 0x7f10d81515f0 2024-04-12T19:39:49.488 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.488+0000 7f10d7200640 1 -- 172.21.15.131:0/2137037860 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f10d80bde10 con 0x7f10d81515f0 2024-04-12T19:39:49.489 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.489+0000 7f10cea00640 1 -- 172.21.15.131:0/2137037860 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f10d007c040 con 0x7f10d81515f0 2024-04-12T19:39:49.489 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-12T19:39:49.491 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.491+0000 7f10d7200640 1 -- 172.21.15.131:0/2137037860 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f10b406c920 msgr2=0x7f10b406ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.491+0000 7f10d7200640 1 --2- 172.21.15.131:0/2137037860 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f10b406c920 0x7f10b406ede0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f10c8000f60 tx=0x7f10c80079d0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.491+0000 7f10d7200640 1 -- 172.21.15.131:0/2137037860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d81515f0 msgr2=0x7f10d8141ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.491+0000 7f10d7200640 1 --2- 172.21.15.131:0/2137037860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d81515f0 0x7f10d8141ac0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f10d00090b0 tx=0x7f10d00046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.491+0000 7f10d7200640 1 -- 172.21.15.131:0/2137037860 shutdown_connections 2024-04-12T19:39:49.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.491+0000 7f10d7200640 1 --2- 172.21.15.131:0/2137037860 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f10b406c920 0x7f10b406ede0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.491+0000 7f10d7200640 1 --2- 172.21.15.131:0/2137037860 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f10d8147fb0 0x7f10d8141580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.491+0000 7f10d7200640 1 --2- 172.21.15.131:0/2137037860 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10d81515f0 0x7f10d8141ac0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.491+0000 7f10d7200640 1 --2- 172.21.15.131:0/2137037860 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f10d80be030 0x7f10d81e7f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.491+0000 7f10d7200640 1 -- 172.21.15.131:0/2137037860 >> 172.21.15.131:0/2137037860 conn(0x7f10d806b9e0 msgr2=0x7f10d806df20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:49.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.492+0000 7f10d7200640 1 -- 172.21.15.131:0/2137037860 shutdown_connections 2024-04-12T19:39:49.492 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.492+0000 7f10d7200640 1 -- 172.21.15.131:0/2137037860 wait complete. 2024-04-12T19:39:49.511 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-12T19:39:49.716 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.716+0000 7fb8cb000640 1 Processor -- start 2024-04-12T19:39:49.717 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.717+0000 7fb8cb000640 1 -- start start 2024-04-12T19:39:49.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.718+0000 7fb8cb000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fb8c40bf720 0x7fb8c40a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.718+0000 7fb8cb000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c40a4f80 0x7fb8c414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.718+0000 7fb8cb000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8c40a7ae0 con 0x7fb8c4073840 2024-04-12T19:39:49.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.718+0000 7fb8cb000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fb8c40a5c90 con 0x7fb8c40bf720 2024-04-12T19:39:49.718 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.718+0000 7fb8cb000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb8c40beed0 con 0x7fb8c40a4f80 2024-04-12T19:39:49.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.718+0000 7fb8c9000640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fb8c4073840 0x7fb8c41524d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:34330/0 (socket says 172.21.15.131:34330) 2024-04-12T19:39:49.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.718+0000 7fb8c9000640 1 -- 172.21.15.131:0/1252695919 learned_addr learned my addr 172.21.15.131:0/1252695919 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:49.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.718+0000 7fb8c3400640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c40a4f80 0x7fb8c414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.720 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c3e00640 1 --2- 172.21.15.131:0/1252695919 >> v2:172.21.15.171:3300/0 conn(0x7fb8c40bf720 0x7fb8c40a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 967062856 0 0) 0x7fb8c40a7ae0 con 0x7fb8c4073840 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8a8003520 con 0x7fb8c4073840 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2690190933 0 0) 0x7fb8a8003520 con 0x7fb8c4073840 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c40a4f80 msgr2=0x7fb8c414eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c40a4f80 0x7fb8c414eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 >> v2:172.21.15.171:3300/0 conn(0x7fb8c40bf720 msgr2=0x7fb8c40a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 --2- 172.21.15.131:0/1252695919 >> v2:172.21.15.171:3300/0 conn(0x7fb8c40bf720 0x7fb8c40a6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c40be2a0 con 0x7fb8c4073840 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7fb8bc0019f0 con 0x7fb8c4073840 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 >> v1:172.21.15.131:6789/0 conn(0x7fb8c4073840 legacy=0x7fb8c41524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c40a4f80 0x7fb8a80039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8a8003f80 0x7fb8a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a8004d40 0x7fb8a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c40a5c90 con 0x7fb8a8004d40 2024-04-12T19:39:49.721 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c40beed0 con 0x7fb8a8003f80 2024-04-12T19:39:49.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.719+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a800ba70 con 0x7fb8c40a4f80 2024-04-12T19:39:49.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.720+0000 7fb8c9000640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a8004d40 0x7fb8a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.720+0000 7fb8c3400640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8a8003f80 0x7fb8a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.720+0000 7fb8c3e00640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c40a4f80 0x7fb8a80039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.720+0000 7fb8c9000640 1 -- 172.21.15.131:0/1252695919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c40a4f80 msgr2=0x7fb8a80039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:49.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.720+0000 7fb8c9000640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c40a4f80 0x7fb8a80039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.720+0000 7fb8c9000640 1 -- 172.21.15.131:0/1252695919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8a8003f80 msgr2=0x7fb8a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:49.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.720+0000 7fb8c9000640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8a8003f80 0x7fb8a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.720+0000 7fb8c9000640 1 -- 172.21.15.131:0/1252695919 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a8003520 con 0x7fb8a8004d40 2024-04-12T19:39:49.722 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.720+0000 7fb8c3e00640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c40a4f80 0x7fb8a80039b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:49.723 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.721+0000 7fb8c9000640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a8004d40 0x7fb8a80051c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00a7a0 tx=0x7fb8a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f76aaae99a4eb3eb server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:49.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.721+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc00a3f0 con 0x7fb8a8004d40 2024-04-12T19:39:49.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.721+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8bc034650 con 0x7fb8a8004d40 2024-04-12T19:39:49.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.721+0000 7fb8c2a00640 1 -- 172.21.15.131:0/1252695919 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8bc034a40 con 0x7fb8a8004d40 2024-04-12T19:39:49.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.722+0000 7fb8cb000640 1 -- 172.21.15.131:0/1252695919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a8004d40 msgr2=0x7fb8a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.722+0000 7fb8cb000640 1 --2- 172.21.15.131:0/1252695919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a8004d40 0x7fb8a80051c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb8bc00a7a0 tx=0x7fb8a8005830 comp rx=0 tx=0).stop 2024-04-12T19:39:49.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.722+0000 7fb8c9000640 1 -- 172.21.15.131:0/1252695919 reap_dead start 2024-04-12T19:39:49.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.722+0000 7fb8cb000640 1 -- 172.21.15.131:0/1252695919 shutdown_connections 2024-04-12T19:39:49.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.722+0000 7fb8cb000640 1 -- 172.21.15.131:0/1252695919 >> 172.21.15.131:0/1252695919 conn(0x7fb8c406be00 msgr2=0x7fb8c406c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:49.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.722+0000 7fb8cb000640 1 -- 172.21.15.131:0/1252695919 shutdown_connections 2024-04-12T19:39:49.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.722+0000 7fb8cb000640 1 -- 172.21.15.131:0/1252695919 wait complete. 2024-04-12T19:39:49.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.724+0000 7fb8cb000640 1 Processor -- start 2024-04-12T19:39:49.724 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.724+0000 7fb8cb000640 1 -- start start 2024-04-12T19:39:49.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8cb000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a8004d40 0x7fb8c41da730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8cb000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c41e5570 0x7fb8c40bb3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8cb000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8c4153030 0x7fb8c4152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.726 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8cb000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c40bfb00 con 0x7fb8a8004d40 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8cb000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fb8c40beba0 con 0x7fb8c4153030 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8cb000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fb8c40bfc80 con 0x7fb8c41e5570 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8c3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a8004d40 0x7fb8c41da730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8c3e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a8004d40 0x7fb8c41da730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:41638/0 (socket says 172.21.15.131:41638) 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8c3e00640 1 -- 172.21.15.131:0/2527029280 learned_addr learned my addr 172.21.15.131:0/2527029280 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8c9000640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8c4153030 0x7fb8c4152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8c3e00640 1 -- 172.21.15.131:0/2527029280 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c41e5570 msgr2=0x7fb8c40bb3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8c3400640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c41e5570 0x7fb8c40bb3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8c3e00640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c41e5570 0x7fb8c40bb3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8c3e00640 1 -- 172.21.15.131:0/2527029280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8c4153030 msgr2=0x7fb8c4152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8c3e00640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8c4153030 0x7fb8c4152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8c3e00640 1 -- 172.21.15.131:0/2527029280 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8c41dac70 con 0x7fb8a8004d40 2024-04-12T19:39:49.727 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.725+0000 7fb8c9000640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8c4153030 0x7fb8c4152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:49.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.726+0000 7fb8c3e00640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a8004d40 0x7fb8c41da730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4010a00 tx=0x7fb8b4010ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:49.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.726+0000 7fb8bbe00640 1 -- 172.21.15.131:0/2527029280 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b400f040 con 0x7fb8a8004d40 2024-04-12T19:39:49.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.726+0000 7fb8bbe00640 1 -- 172.21.15.131:0/2527029280 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8b400ec20 con 0x7fb8a8004d40 2024-04-12T19:39:49.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.726+0000 7fb8cb000640 1 -- 172.21.15.131:0/2527029280 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8c41e7f20 con 0x7fb8a8004d40 2024-04-12T19:39:49.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.726+0000 7fb8bbe00640 1 -- 172.21.15.131:0/2527029280 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8b401c400 con 0x7fb8a8004d40 2024-04-12T19:39:49.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.726+0000 7fb8cb000640 1 -- 172.21.15.131:0/2527029280 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8c41e4d70 con 0x7fb8a8004d40 2024-04-12T19:39:49.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.727+0000 7fb8cb000640 1 -- 172.21.15.131:0/2527029280 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8c40c1d40 con 0x7fb8a8004d40 2024-04-12T19:39:49.728 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.728+0000 7fb8bbe00640 1 -- 172.21.15.131:0/2527029280 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fb8b401c5a0 con 0x7fb8a8004d40 2024-04-12T19:39:49.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.729+0000 7fb8bbe00640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb8a406c8f0 0x7fb8a406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:49.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.729+0000 7fb8bbe00640 1 -- 172.21.15.131:0/2527029280 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fb8b408c5e0 con 0x7fb8a8004d40 2024-04-12T19:39:49.729 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.730+0000 7fb8c3400640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb8a406c8f0 0x7fb8a406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:49.730 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.730+0000 7fb8c3400640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb8a406c8f0 0x7fb8a406edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4146390 tx=0x7fb8b0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:49.734 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.734+0000 7fb8bbe00640 1 -- 172.21.15.131:0/2527029280 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fb8c40c1d40 con 0x7fb8a8004d40 2024-04-12T19:39:49.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.918+0000 7fb8cb000640 1 -- 172.21.15.131:0/2527029280 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb8c404fd50 con 0x7fb8a8004d40 2024-04-12T19:39:49.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.920+0000 7fb8bbe00640 1 -- 172.21.15.131:0/2527029280 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fb8b4018030 con 0x7fb8a8004d40 2024-04-12T19:39:49.920 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T19:39:49.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.922+0000 7fb8cb000640 1 -- 172.21.15.131:0/2527029280 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb8a406c8f0 msgr2=0x7fb8a406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.922+0000 7fb8cb000640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb8a406c8f0 0x7fb8a406edb0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb8c4146390 tx=0x7fb8b0008040 comp rx=0 tx=0).stop 2024-04-12T19:39:49.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.922+0000 7fb8cb000640 1 -- 172.21.15.131:0/2527029280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a8004d40 msgr2=0x7fb8c41da730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:49.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.922+0000 7fb8cb000640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a8004d40 0x7fb8c41da730 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb8b4010a00 tx=0x7fb8b4010ec0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.922+0000 7fb8cb000640 1 -- 172.21.15.131:0/2527029280 shutdown_connections 2024-04-12T19:39:49.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.922+0000 7fb8cb000640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fb8a406c8f0 0x7fb8a406edb0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.922+0000 7fb8cb000640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fb8c4153030 0x7fb8c4152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.922+0000 7fb8cb000640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fb8c41e5570 0x7fb8c40bb3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.922+0000 7fb8cb000640 1 --2- 172.21.15.131:0/2527029280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8a8004d40 0x7fb8c41da730 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:49.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.922+0000 7fb8cb000640 1 -- 172.21.15.131:0/2527029280 >> 172.21.15.131:0/2527029280 conn(0x7fb8c406be00 msgr2=0x7fb8c40c0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:49.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.922+0000 7fb8cb000640 1 -- 172.21.15.131:0/2527029280 shutdown_connections 2024-04-12T19:39:49.925 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:49.922+0000 7fb8cb000640 1 -- 172.21.15.131:0/2527029280 wait complete. 2024-04-12T19:39:49.938 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-12T19:39:50.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.144+0000 7f9603000640 1 Processor -- start 2024-04-12T19:39:50.144 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.144+0000 7f9603000640 1 -- start start 2024-04-12T19:39:50.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.145+0000 7f9603000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f95fc0bf720 0x7f95fc0a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:50.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.145+0000 7f9603000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95fc14eee0 0x7f95fc159860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:50.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.145+0000 7f9603000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95fc14f370 con 0x7f95fc0a4f80 2024-04-12T19:39:50.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.145+0000 7f9603000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f95fc0a5c90 con 0x7f95fc0bf720 2024-04-12T19:39:50.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.145+0000 7f9603000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f95fc0beed0 con 0x7f95fc14eee0 2024-04-12T19:39:50.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.145+0000 7f95fbe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f95fc0bf720 0x7f95fc0a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:50.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.146+0000 7f95fbe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f95fc0bf720 0x7f95fc0a6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46808/0 (socket says 172.21.15.131:46808) 2024-04-12T19:39:50.146 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.146+0000 7f95fbe00640 1 -- 172.21.15.131:0/2128583578 learned_addr learned my addr 172.21.15.131:0/2128583578 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:50.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.146+0000 7f9601000640 1 --2- 172.21.15.131:0/2128583578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95fc14eee0 0x7f95fc159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:50.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.146+0000 7f95fbe00640 1 -- 172.21.15.131:0/2128583578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95fc14eee0 msgr2=0x7f95fc159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:50.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.146+0000 7f95fbe00640 1 --2- 172.21.15.131:0/2128583578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95fc14eee0 0x7f95fc159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.146+0000 7f95fbe00640 1 -- 172.21.15.131:0/2128583578 >> v1:172.21.15.171:6789/0 conn(0x7f95fc0a4f80 legacy=0x7f95fc073840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:50.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.146+0000 7f95fbe00640 1 -- 172.21.15.131:0/2128583578 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95fc0a7ae0 con 0x7f95fc0bf720 2024-04-12T19:39:50.147 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.146+0000 7f9601000640 1 --2- 172.21.15.131:0/2128583578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95fc14eee0 0x7f95fc159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:50.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.147+0000 7f95fbe00640 1 --2- 172.21.15.131:0/2128583578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc0bf720 0x7f95fc0a6120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009870 tx=0x7f95ec02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982d62433669dd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:50.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.147+0000 7f95faa00640 1 -- 172.21.15.131:0/2128583578 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec0317c0 con 0x7f95fc0bf720 2024-04-12T19:39:50.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.147+0000 7f95faa00640 1 -- 172.21.15.131:0/2128583578 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95ec037070 con 0x7f95fc0bf720 2024-04-12T19:39:50.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.147+0000 7f95faa00640 1 -- 172.21.15.131:0/2128583578 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec031b80 con 0x7f95fc0bf720 2024-04-12T19:39:50.148 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.148+0000 7f9603000640 1 -- 172.21.15.131:0/2128583578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc0bf720 msgr2=0x7f95fc0a6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:50.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.148+0000 7f9603000640 1 --2- 172.21.15.131:0/2128583578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc0bf720 0x7f95fc0a6120 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f95ec009870 tx=0x7f95ec02b860 comp rx=0 tx=0).stop 2024-04-12T19:39:50.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.148+0000 7f9603000640 1 -- 172.21.15.131:0/2128583578 shutdown_connections 2024-04-12T19:39:50.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.148+0000 7f9603000640 1 --2- 172.21.15.131:0/2128583578 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95fc14eee0 0x7f95fc159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.148+0000 7f9603000640 1 --2- 172.21.15.131:0/2128583578 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc0bf720 0x7f95fc0a6120 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.148+0000 7f9603000640 1 -- 172.21.15.131:0/2128583578 >> 172.21.15.131:0/2128583578 conn(0x7f95fc06be00 msgr2=0x7f95fc06c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:50.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.148+0000 7f9603000640 1 -- 172.21.15.131:0/2128583578 shutdown_connections 2024-04-12T19:39:50.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.148+0000 7f9603000640 1 -- 172.21.15.131:0/2128583578 wait complete. 2024-04-12T19:39:50.149 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.150+0000 7f9603000640 1 Processor -- start 2024-04-12T19:39:50.150 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.150+0000 7f9603000640 1 -- start start 2024-04-12T19:39:50.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.150+0000 7f9603000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95fc0a4f80 0x7f95fc0b9b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:50.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.150+0000 7f9603000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc0bf720 0x7f95fc1ea500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:50.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.150+0000 7f9603000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95fc14eee0 0x7f95fc1eaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:50.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.150+0000 7f9603000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc073f50 con 0x7f95fc0bf720 2024-04-12T19:39:50.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.150+0000 7f9603000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc0a5920 con 0x7f95fc0a4f80 2024-04-12T19:39:50.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.150+0000 7f9603000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f95fc0beba0 con 0x7f95fc14eee0 2024-04-12T19:39:50.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.151+0000 7f95fb400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc0bf720 0x7f95fc1ea500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:50.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.151+0000 7f95fb400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc0bf720 0x7f95fc1ea500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46810/0 (socket says 172.21.15.131:46810) 2024-04-12T19:39:50.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.151+0000 7f95fb400640 1 -- 172.21.15.131:0/2114217811 learned_addr learned my addr 172.21.15.131:0/2114217811 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:50.151 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.151+0000 7f95fb400640 1 -- 172.21.15.131:0/2114217811 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95fc14eee0 msgr2=0x7f95fc1eaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:50.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.151+0000 7f95fb400640 1 --2- 172.21.15.131:0/2114217811 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95fc14eee0 0x7f95fc1eaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.151+0000 7f95fb400640 1 -- 172.21.15.131:0/2114217811 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95fc0a4f80 msgr2=0x7f95fc0b9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:50.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.151+0000 7f95fb400640 1 --2- 172.21.15.131:0/2114217811 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95fc0a4f80 0x7f95fc0b9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.151+0000 7f95fb400640 1 -- 172.21.15.131:0/2114217811 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95fc0ba0d0 con 0x7f95fc0bf720 2024-04-12T19:39:50.152 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.151+0000 7f95fb400640 1 --2- 172.21.15.131:0/2114217811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc0bf720 0x7f95fc1ea500 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f95e800c430 tx=0x7f95e800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:50.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.152+0000 7f95f3e00640 1 -- 172.21.15.131:0/2114217811 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8011790 con 0x7f95fc0bf720 2024-04-12T19:39:50.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.152+0000 7f95f3e00640 1 -- 172.21.15.131:0/2114217811 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95e8017070 con 0x7f95fc0bf720 2024-04-12T19:39:50.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.152+0000 7f9603000640 1 -- 172.21.15.131:0/2114217811 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95fc1491d0 con 0x7f95fc0bf720 2024-04-12T19:39:50.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.152+0000 7f95f3e00640 1 -- 172.21.15.131:0/2114217811 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e8011b70 con 0x7f95fc0bf720 2024-04-12T19:39:50.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.152+0000 7f9603000640 1 -- 172.21.15.131:0/2114217811 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95fc0b9020 con 0x7f95fc0bf720 2024-04-12T19:39:50.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.153+0000 7f9603000640 1 -- 172.21.15.131:0/2114217811 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95fc14e590 con 0x7f95fc0bf720 2024-04-12T19:39:50.153 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.154+0000 7f95f3e00640 1 -- 172.21.15.131:0/2114217811 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f95e8011d10 con 0x7f95fc0bf720 2024-04-12T19:39:50.155 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.155+0000 7f95f3e00640 1 --2- 172.21.15.131:0/2114217811 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f95dc06c8f0 0x7f95dc06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:50.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.155+0000 7f95f3e00640 1 -- 172.21.15.131:0/2114217811 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f95e808be10 con 0x7f95fc0bf720 2024-04-12T19:39:50.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.155+0000 7f95fbe00640 1 --2- 172.21.15.131:0/2114217811 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f95dc06c8f0 0x7f95dc06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:50.156 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.156+0000 7f95fbe00640 1 --2- 172.21.15.131:0/2114217811 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f95dc06c8f0 0x7f95dc06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f95ec036000 tx=0x7f95ec030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:50.159 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.159+0000 7f95f3e00640 1 -- 172.21.15.131:0/2114217811 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f95fc14e590 con 0x7f95fc0bf720 2024-04-12T19:39:50.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.382+0000 7f9603000640 1 -- 172.21.15.131:0/2114217811 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f95fc1ea1c0 con 0x7f95fc0bf720 2024-04-12T19:39:50.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.383+0000 7f95f3e00640 1 -- 172.21.15.131:0/2114217811 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f95e808f030 con 0x7f95fc0bf720 2024-04-12T19:39:50.383 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-12T19:39:50.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.385+0000 7f9603000640 1 -- 172.21.15.131:0/2114217811 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f95dc06c8f0 msgr2=0x7f95dc06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:50.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.385+0000 7f9603000640 1 --2- 172.21.15.131:0/2114217811 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f95dc06c8f0 0x7f95dc06edb0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f95ec036000 tx=0x7f95ec030000 comp rx=0 tx=0).stop 2024-04-12T19:39:50.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.385+0000 7f9603000640 1 -- 172.21.15.131:0/2114217811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc0bf720 msgr2=0x7f95fc1ea500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:50.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.385+0000 7f9603000640 1 --2- 172.21.15.131:0/2114217811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc0bf720 0x7f95fc1ea500 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f95e800c430 tx=0x7f95e800c8f0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.385+0000 7f9603000640 1 -- 172.21.15.131:0/2114217811 shutdown_connections 2024-04-12T19:39:50.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.385+0000 7f9603000640 1 --2- 172.21.15.131:0/2114217811 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f95dc06c8f0 0x7f95dc06edb0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.385+0000 7f9603000640 1 --2- 172.21.15.131:0/2114217811 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f95fc14eee0 0x7f95fc1eaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.385+0000 7f9603000640 1 --2- 172.21.15.131:0/2114217811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f95fc0bf720 0x7f95fc1ea500 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.385+0000 7f9603000640 1 --2- 172.21.15.131:0/2114217811 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f95fc0a4f80 0x7f95fc0b9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.385+0000 7f9603000640 1 -- 172.21.15.131:0/2114217811 >> 172.21.15.131:0/2114217811 conn(0x7f95fc06be00 msgr2=0x7f95fc14e790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:50.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.385+0000 7f9603000640 1 -- 172.21.15.131:0/2114217811 shutdown_connections 2024-04-12T19:39:50.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.385+0000 7f9603000640 1 -- 172.21.15.131:0/2114217811 wait complete. 2024-04-12T19:39:50.405 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-12T19:39:50.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.609+0000 7f2953800640 1 Processor -- start 2024-04-12T19:39:50.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.609+0000 7f2953800640 1 -- start start 2024-04-12T19:39:50.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.610+0000 7f2953800640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f294c0bf810 0x7f294c151d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:50.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.610+0000 7f2953800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f294c14deb0 0x7f294c14e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:50.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.610+0000 7f2953800640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294c073da0 con 0x7f294c0b75b0 2024-04-12T19:39:50.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.610+0000 7f2953800640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f294c0be710 con 0x7f294c14deb0 2024-04-12T19:39:50.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.610+0000 7f2953800640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f294c1518a0 con 0x7f294c0bf810 2024-04-12T19:39:50.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.610+0000 7f2943e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f294c14deb0 0x7f294c14e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:50.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.610+0000 7f2951800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f294c0b75b0 0x7f294c0b8a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:51174/0 (socket says 172.21.15.131:51174) 2024-04-12T19:39:50.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.611+0000 7f2951800640 1 -- 172.21.15.131:0/969129027 learned_addr learned my addr 172.21.15.131:0/969129027 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:50.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.611+0000 7f2950e00640 1 --2- 172.21.15.131:0/969129027 >> v2:172.21.15.171:3300/0 conn(0x7f294c0bf810 0x7f294c151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:50.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.611+0000 7f2943e00640 1 -- 172.21.15.131:0/969129027 >> v2:172.21.15.171:3300/0 conn(0x7f294c0bf810 msgr2=0x7f294c151d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:50.611 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.611+0000 7f2943e00640 1 --2- 172.21.15.131:0/969129027 >> v2:172.21.15.171:3300/0 conn(0x7f294c0bf810 0x7f294c151d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.611+0000 7f2943e00640 1 -- 172.21.15.131:0/969129027 >> v1:172.21.15.131:6789/0 conn(0x7f294c0b75b0 legacy=0x7f294c0b8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:50.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.611+0000 7f2943e00640 1 -- 172.21.15.131:0/969129027 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294c073b00 con 0x7f294c14deb0 2024-04-12T19:39:50.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.611+0000 7f294be00640 1 -- 172.21.15.131:0/969129027 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296207742 0 0) 0x7f294c073da0 con 0x7f294c0b75b0 2024-04-12T19:39:50.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.611+0000 7f2950e00640 1 --2- 172.21.15.131:0/969129027 >> v2:172.21.15.171:3300/0 conn(0x7f294c0bf810 0x7f294c151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:50.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.612+0000 7f2943e00640 1 --2- 172.21.15.131:0/969129027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f294c14deb0 0x7f294c14e5d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f294c0c0030 tx=0x7f293402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6337dfa8c59b8e39 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:50.612 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.612+0000 7f294be00640 1 -- 172.21.15.131:0/969129027 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934035020 con 0x7f294c14deb0 2024-04-12T19:39:50.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.612+0000 7f294be00640 1 -- 172.21.15.131:0/969129027 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2934031830 con 0x7f294c14deb0 2024-04-12T19:39:50.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.613+0000 7f294be00640 1 -- 172.21.15.131:0/969129027 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2934031c00 con 0x7f294c14deb0 2024-04-12T19:39:50.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.613+0000 7f2953800640 1 -- 172.21.15.131:0/969129027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f294c14deb0 msgr2=0x7f294c14e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:50.613 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.613+0000 7f2953800640 1 --2- 172.21.15.131:0/969129027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f294c14deb0 0x7f294c14e5d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f294c0c0030 tx=0x7f293402b8d0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.613+0000 7f2953800640 1 -- 172.21.15.131:0/969129027 shutdown_connections 2024-04-12T19:39:50.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.613+0000 7f2953800640 1 --2- 172.21.15.131:0/969129027 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f294c14deb0 0x7f294c14e5d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.613+0000 7f2953800640 1 --2- 172.21.15.131:0/969129027 >> v2:172.21.15.171:3300/0 conn(0x7f294c0bf810 0x7f294c151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.613+0000 7f2953800640 1 -- 172.21.15.131:0/969129027 >> 172.21.15.131:0/969129027 conn(0x7f294c06be00 msgr2=0x7f294c06c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:50.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.613+0000 7f2953800640 1 -- 172.21.15.131:0/969129027 shutdown_connections 2024-04-12T19:39:50.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.613+0000 7f2953800640 1 -- 172.21.15.131:0/969129027 wait complete. 2024-04-12T19:39:50.614 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.615+0000 7f2953800640 1 Processor -- start 2024-04-12T19:39:50.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.615+0000 7f2953800640 1 -- start start 2024-04-12T19:39:50.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.616+0000 7f2953800640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f294c0b75b0 0x7f294c150820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:50.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.616+0000 7f2953800640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c0bf810 0x7f294c1e6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:50.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.616+0000 7f2953800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f294c0bc7c0 0x7f294c0bb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:50.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.616+0000 7f2953800640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f294c0be960 con 0x7f294c0bc7c0 2024-04-12T19:39:50.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.616+0000 7f2953800640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f294c151530 con 0x7f294c0b75b0 2024-04-12T19:39:50.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.616+0000 7f2953800640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f294c152270 con 0x7f294c0bf810 2024-04-12T19:39:50.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.616+0000 7f2951800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f294c0bc7c0 0x7f294c0bb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:50.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.616+0000 7f2951800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f294c0bc7c0 0x7f294c0bb990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46834/0 (socket says 172.21.15.131:46834) 2024-04-12T19:39:50.617 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.616+0000 7f2951800640 1 -- 172.21.15.131:0/2445642082 learned_addr learned my addr 172.21.15.131:0/2445642082 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.616+0000 7f2950e00640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f294c0b75b0 0x7f294c150820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.616+0000 7f2943e00640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c0bf810 0x7f294c1e6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2951800640 1 -- 172.21.15.131:0/2445642082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c0bf810 msgr2=0x7f294c1e6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2951800640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c0bf810 0x7f294c1e6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2951800640 1 -- 172.21.15.131:0/2445642082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f294c0b75b0 msgr2=0x7f294c150820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2951800640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f294c0b75b0 0x7f294c150820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2951800640 1 -- 172.21.15.131:0/2445642082 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f294c150d60 con 0x7f294c0bc7c0 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2950e00640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f294c0b75b0 0x7f294c150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2943e00640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c0bf810 0x7f294c1e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2951800640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f294c0bc7c0 0x7f294c0bb990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f294400c7a0 tx=0x7f294400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2949600640 1 -- 172.21.15.131:0/2445642082 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944018070 con 0x7f294c0bc7c0 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2949600640 1 -- 172.21.15.131:0/2445642082 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f294400a640 con 0x7f294c0bc7c0 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2949600640 1 -- 172.21.15.131:0/2445642082 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f294400aab0 con 0x7f294c0bc7c0 2024-04-12T19:39:50.618 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2953800640 1 -- 172.21.15.131:0/2445642082 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f294c1eac30 con 0x7f294c0bc7c0 2024-04-12T19:39:50.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.617+0000 7f2953800640 1 -- 172.21.15.131:0/2445642082 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f294c072410 con 0x7f294c0bc7c0 2024-04-12T19:39:50.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.618+0000 7f2953800640 1 -- 172.21.15.131:0/2445642082 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f294c04fd50 con 0x7f294c0bc7c0 2024-04-12T19:39:50.619 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.619+0000 7f2949600640 1 -- 172.21.15.131:0/2445642082 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f294400ac50 con 0x7f294c0bc7c0 2024-04-12T19:39:50.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.620+0000 7f2949600640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f292806c8f0 0x7f292806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:50.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.620+0000 7f2949600640 1 -- 172.21.15.131:0/2445642082 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f294408b5a0 con 0x7f294c0bc7c0 2024-04-12T19:39:50.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.621+0000 7f2950e00640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f292806c8f0 0x7f292806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:50.621 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.621+0000 7f2950e00640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f292806c8f0 0x7f292806edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f293c006fd0 tx=0x7f293c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:50.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.625+0000 7f2949600640 1 -- 172.21.15.131:0/2445642082 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f29440595f0 con 0x7f294c0bc7c0 2024-04-12T19:39:50.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.823+0000 7f2953800640 1 -- 172.21.15.131:0/2445642082 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f294c0a4440 con 0x7f294c0bc7c0 2024-04-12T19:39:50.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.824+0000 7f2949600640 1 -- 172.21.15.131:0/2445642082 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f2944058ef0 con 0x7f294c0bc7c0 2024-04-12T19:39:50.824 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T19:39:50.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.827+0000 7f2953800640 1 -- 172.21.15.131:0/2445642082 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f292806c8f0 msgr2=0x7f292806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:50.827 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.827+0000 7f2953800640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f292806c8f0 0x7f292806edb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f293c006fd0 tx=0x7f293c008040 comp rx=0 tx=0).stop 2024-04-12T19:39:50.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.827+0000 7f2953800640 1 -- 172.21.15.131:0/2445642082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f294c0bc7c0 msgr2=0x7f294c0bb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:50.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.827+0000 7f2953800640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f294c0bc7c0 0x7f294c0bb990 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f294400c7a0 tx=0x7f294400cc60 comp rx=0 tx=0).stop 2024-04-12T19:39:50.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.827+0000 7f2953800640 1 -- 172.21.15.131:0/2445642082 shutdown_connections 2024-04-12T19:39:50.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.827+0000 7f2953800640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f292806c8f0 0x7f292806edb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.827+0000 7f2953800640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f294c0bc7c0 0x7f294c0bb990 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.827+0000 7f2953800640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f294c0bf810 0x7f294c1e6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.827+0000 7f2953800640 1 --2- 172.21.15.131:0/2445642082 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f294c0b75b0 0x7f294c150820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:50.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.827+0000 7f2953800640 1 -- 172.21.15.131:0/2445642082 >> 172.21.15.131:0/2445642082 conn(0x7f294c06be00 msgr2=0x7f294c14c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:50.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.827+0000 7f2953800640 1 -- 172.21.15.131:0/2445642082 shutdown_connections 2024-04-12T19:39:50.828 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:50.828+0000 7f2953800640 1 -- 172.21.15.131:0/2445642082 wait complete. 2024-04-12T19:39:50.847 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-12T19:39:51.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.050+0000 7f9522000640 1 Processor -- start 2024-04-12T19:39:51.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.050+0000 7f9522000640 1 -- start start 2024-04-12T19:39:51.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f9522000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f951c0a8120 0x7f951c0728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f9522000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f951c0a8500 0x7f951c1526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.052 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f9522000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f951c0a4e60 0x7f951c14f100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f9522000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f951c153680 con 0x7f951c0a8500 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f9522000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f951c1531a0 con 0x7f951c0a4e60 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f9522000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f951c071df0 con 0x7f951c0a8120 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f951aa00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f951c0a8500 0x7f951c1526f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f951aa00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f951c0a8500 0x7f951c1526f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46844/0 (socket says 172.21.15.131:46844) 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f951aa00640 1 -- 172.21.15.131:0/3920864356 learned_addr learned my addr 172.21.15.131:0/3920864356 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f951b400640 1 --2- 172.21.15.131:0/3920864356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f951c0a8120 0x7f951c0728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f951be00640 1 --2- 172.21.15.131:0/3920864356 >> v2:172.21.15.171:3300/0 conn(0x7f951c0a4e60 0x7f951c14f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f951aa00640 1 -- 172.21.15.131:0/3920864356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f951c0a8120 msgr2=0x7f951c0728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f951aa00640 1 --2- 172.21.15.131:0/3920864356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f951c0a8120 0x7f951c0728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f951aa00640 1 -- 172.21.15.131:0/3920864356 >> v2:172.21.15.171:3300/0 conn(0x7f951c0a4e60 msgr2=0x7f951c14f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f951aa00640 1 --2- 172.21.15.131:0/3920864356 >> v2:172.21.15.171:3300/0 conn(0x7f951c0a4e60 0x7f951c14f100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f951aa00640 1 -- 172.21.15.131:0/3920864356 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951c0720d0 con 0x7f951c0a8500 2024-04-12T19:39:51.053 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.052+0000 7f951be00640 1 --2- 172.21.15.131:0/3920864356 >> v2:172.21.15.171:3300/0 conn(0x7f951c0a4e60 0x7f951c14f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:51.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.054+0000 7f951aa00640 1 --2- 172.21.15.131:0/3920864356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c0a8500 0x7f951c1526f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f951c1499f0 tx=0x7f950402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d776187d36aeba47 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:51.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.054+0000 7f951a000640 1 -- 172.21.15.131:0/3920864356 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504035020 con 0x7f951c0a8500 2024-04-12T19:39:51.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.054+0000 7f951a000640 1 -- 172.21.15.131:0/3920864356 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9504031870 con 0x7f951c0a8500 2024-04-12T19:39:51.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.054+0000 7f951a000640 1 -- 172.21.15.131:0/3920864356 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9504031c40 con 0x7f951c0a8500 2024-04-12T19:39:51.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.054+0000 7f9522000640 1 -- 172.21.15.131:0/3920864356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c0a8500 msgr2=0x7f951c1526f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.054+0000 7f9522000640 1 --2- 172.21.15.131:0/3920864356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c0a8500 0x7f951c1526f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f951c1499f0 tx=0x7f950402b910 comp rx=0 tx=0).stop 2024-04-12T19:39:51.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.055+0000 7f9522000640 1 -- 172.21.15.131:0/3920864356 shutdown_connections 2024-04-12T19:39:51.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.055+0000 7f9522000640 1 --2- 172.21.15.131:0/3920864356 >> v2:172.21.15.171:3300/0 conn(0x7f951c0a4e60 0x7f951c14f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.055+0000 7f9522000640 1 --2- 172.21.15.131:0/3920864356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c0a8500 0x7f951c1526f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.055+0000 7f9522000640 1 --2- 172.21.15.131:0/3920864356 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f951c0a8120 0x7f951c0728d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.055+0000 7f9522000640 1 -- 172.21.15.131:0/3920864356 >> 172.21.15.131:0/3920864356 conn(0x7f951c0c2590 msgr2=0x7f951c0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:51.055 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.055+0000 7f9522000640 1 -- 172.21.15.131:0/3920864356 shutdown_connections 2024-04-12T19:39:51.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.055+0000 7f9522000640 1 -- 172.21.15.131:0/3920864356 wait complete. 2024-04-12T19:39:51.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.056+0000 7f9522000640 1 Processor -- start 2024-04-12T19:39:51.056 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.057+0000 7f9522000640 1 -- start start 2024-04-12T19:39:51.058 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.057+0000 7f9522000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f951c0a4e60 0x7f951c14b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.057+0000 7f9522000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f951c0a8120 0x7f951c14c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.057+0000 7f9522000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c0a8500 0x7f951c14faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.057+0000 7f9522000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f951c06d970 con 0x7f951c0a8500 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.057+0000 7f9522000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f951c072e10 con 0x7f951c0a4e60 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.057+0000 7f9522000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f951c06f520 con 0x7f951c0a8120 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.058+0000 7f951be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c0a8500 0x7f951c14faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.058+0000 7f951be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c0a8500 0x7f951c14faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46856/0 (socket says 172.21.15.131:46856) 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.058+0000 7f951be00640 1 -- 172.21.15.131:0/1951453420 learned_addr learned my addr 172.21.15.131:0/1951453420 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.058+0000 7f951be00640 1 -- 172.21.15.131:0/1951453420 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f951c0a8120 msgr2=0x7f951c14c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.058+0000 7f951be00640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f951c0a8120 0x7f951c14c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.058+0000 7f951be00640 1 -- 172.21.15.131:0/1951453420 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f951c0a4e60 msgr2=0x7f951c14b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.058+0000 7f951b400640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f951c0a4e60 0x7f951c14b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.058+0000 7f951be00640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f951c0a4e60 0x7f951c14b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.059 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.058+0000 7f951be00640 1 -- 172.21.15.131:0/1951453420 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f951c14b9a0 con 0x7f951c0a8500 2024-04-12T19:39:51.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.058+0000 7f951be00640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c0a8500 0x7f951c14faf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f951400cd50 tx=0x7f951400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:51.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.059+0000 7f9513400640 1 -- 172.21.15.131:0/1951453420 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951401a070 con 0x7f951c0a8500 2024-04-12T19:39:51.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.059+0000 7f9513400640 1 -- 172.21.15.131:0/1951453420 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f951400d840 con 0x7f951c0a8500 2024-04-12T19:39:51.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.059+0000 7f9513400640 1 -- 172.21.15.131:0/1951453420 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f951400dc30 con 0x7f951c0a8500 2024-04-12T19:39:51.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.059+0000 7f9522000640 1 -- 172.21.15.131:0/1951453420 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f951c151c90 con 0x7f951c0a8500 2024-04-12T19:39:51.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.059+0000 7f9522000640 1 -- 172.21.15.131:0/1951453420 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f951c152250 con 0x7f951c0a8500 2024-04-12T19:39:51.060 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.060+0000 7f9522000640 1 -- 172.21.15.131:0/1951453420 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f951c1533e0 con 0x7f951c0a8500 2024-04-12T19:39:51.061 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.061+0000 7f9513400640 1 -- 172.21.15.131:0/1951453420 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f951401d070 con 0x7f951c0a8500 2024-04-12T19:39:51.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.062+0000 7f9513400640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f94f806c8f0 0x7f94f806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.062+0000 7f9513400640 1 -- 172.21.15.131:0/1951453420 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f951408c550 con 0x7f951c0a8500 2024-04-12T19:39:51.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.062+0000 7f951b400640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f94f806c8f0 0x7f94f806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.062 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.063+0000 7f951b400640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f94f806c8f0 0x7f94f806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f950c006fd0 tx=0x7f950c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:51.066 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.066+0000 7f9513400640 1 -- 172.21.15.131:0/1951453420 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f951c1533e0 con 0x7f951c0a8500 2024-04-12T19:39:51.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.296+0000 7f9522000640 1 -- 172.21.15.131:0/1951453420 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f951c152490 con 0x7f951c0a8500 2024-04-12T19:39:51.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.297+0000 7f9513400640 1 -- 172.21.15.131:0/1951453420 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5186 (secure 0 0 0) 0x7f951c152490 con 0x7f951c0a8500 2024-04-12T19:39:51.297 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:51.297 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3941197710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3941197710},{"type":"v1","addr":"172.21.15.131:6836","nonce":3941197710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2898590457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2898590457},{"type":"v1","addr":"172.21.15.131:6837","nonce":2898590457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/373698102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":373698102},{"type":"v1","addr":"172.21.15.171:6835","nonce":373698102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T19:39:10.876760+0000","modified":"2024-04-12T19:39:37.561387+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6834/1013642393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1013642393},{"type":"v1","addr":"172.21.15.171:6834","nonce":1013642393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4257,"qdb_cluster":[4257]},"id":1}]} 2024-04-12T19:39:51.298 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-04-12T19:39:51.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.300+0000 7f9522000640 1 -- 172.21.15.131:0/1951453420 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f94f806c8f0 msgr2=0x7f94f806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.300+0000 7f9522000640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f94f806c8f0 0x7f94f806edb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f950c006fd0 tx=0x7f950c008040 comp rx=0 tx=0).stop 2024-04-12T19:39:51.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.300+0000 7f9522000640 1 -- 172.21.15.131:0/1951453420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c0a8500 msgr2=0x7f951c14faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.300+0000 7f9522000640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c0a8500 0x7f951c14faf0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f951400cd50 tx=0x7f951400a710 comp rx=0 tx=0).stop 2024-04-12T19:39:51.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.300+0000 7f9522000640 1 -- 172.21.15.131:0/1951453420 shutdown_connections 2024-04-12T19:39:51.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.300+0000 7f9522000640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f94f806c8f0 0x7f94f806edb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.300+0000 7f9522000640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f951c0a8500 0x7f951c14faf0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.300+0000 7f9522000640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f951c0a8120 0x7f951c14c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.300+0000 7f9522000640 1 --2- 172.21.15.131:0/1951453420 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f951c0a4e60 0x7f951c14b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.300+0000 7f9522000640 1 -- 172.21.15.131:0/1951453420 >> 172.21.15.131:0/1951453420 conn(0x7f951c0c2590 msgr2=0x7f951c0bd8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:51.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.300+0000 7f9522000640 1 -- 172.21.15.131:0/1951453420 shutdown_connections 2024-04-12T19:39:51.301 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.300+0000 7f9522000640 1 -- 172.21.15.131:0/1951453420 wait complete. 2024-04-12T19:39:51.319 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T19:39:51.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.522+0000 7f7c6ac00640 1 Processor -- start 2024-04-12T19:39:51.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.522+0000 7f7c6ac00640 1 -- start start 2024-04-12T19:39:51.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.523+0000 7f7c6ac00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c640a6950 0x7f7c6415a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.523+0000 7f7c6ac00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c64152d10 con 0x7f7c640734c0 2024-04-12T19:39:51.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.523+0000 7f7c6ac00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c640be570 con 0x7f7c640bdbc0 2024-04-12T19:39:51.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.523+0000 7f7c6ac00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c640be320 con 0x7f7c640a6950 2024-04-12T19:39:51.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c69800640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f7c640734c0 0x7f7c641521f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:51176/0 (socket says 172.21.15.131:51176) 2024-04-12T19:39:51.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c69800640 1 -- 172.21.15.131:0/1075824515 learned_addr learned my addr 172.21.15.131:0/1075824515 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:51.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c6a200640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c640a6950 0x7f7c6415a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699286829 0 0) 0x7f7c64152d10 con 0x7f7c640734c0 2024-04-12T19:39:51.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7c4c003520 con 0x7f7c640734c0 2024-04-12T19:39:51.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3889924844 0 0) 0x7f7c4c003520 con 0x7f7c640734c0 2024-04-12T19:39:51.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c640a6950 msgr2=0x7f7c6415a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:51.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c63e00640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c640a6950 0x7f7c6415a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 >> v1:172.21.15.171:6789/0 conn(0x7f7c640bdbc0 legacy=0x7f7c640a6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c640be850 con 0x7f7c640734c0 2024-04-12T19:39:51.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f7c58001670 con 0x7f7c640734c0 2024-04-12T19:39:51.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 >> v1:172.21.15.131:6789/0 conn(0x7f7c640734c0 legacy=0x7f7c641521f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.524+0000 7f7c63e00640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c640a6950 0x7f7c4c0039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c63e00640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c4c003fb0 0x7f7c4c004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c63e00640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c4c004d40 0x7f7c4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7c640be320 con 0x7f7c4c004d40 2024-04-12T19:39:51.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c00bbb0 con 0x7f7c4c003fb0 2024-04-12T19:39:51.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c00bdb0 con 0x7f7c640a6950 2024-04-12T19:39:51.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c6a200640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c4c004d40 0x7f7c4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c68e00640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c4c003fb0 0x7f7c4c004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c69800640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c640a6950 0x7f7c4c0039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c6a200640 1 -- 172.21.15.131:0/1075824515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c640a6950 msgr2=0x7f7c4c0039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:51.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c6a200640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c640a6950 0x7f7c4c0039e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c6a200640 1 -- 172.21.15.131:0/1075824515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c4c003fb0 msgr2=0x7f7c4c004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:51.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c6a200640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c4c003fb0 0x7f7c4c004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c6a200640 1 -- 172.21.15.131:0/1075824515 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c003520 con 0x7f7c4c004d40 2024-04-12T19:39:51.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.525+0000 7f7c68e00640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c4c003fb0 0x7f7c4c004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:51.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.526+0000 7f7c6a200640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c4c004d40 0x7f7c4c0051c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009fc0 tx=0x7f7c4c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9bd7ba107138c5 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:51.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.526+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c039070 con 0x7f7c4c004d40 2024-04-12T19:39:51.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.526+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c5c02cc20 con 0x7f7c4c004d40 2024-04-12T19:39:51.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.527+0000 7f7c63e00640 1 -- 172.21.15.131:0/1075824515 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c5c009c10 con 0x7f7c4c004d40 2024-04-12T19:39:51.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.527+0000 7f7c6ac00640 1 -- 172.21.15.131:0/1075824515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c4c004d40 msgr2=0x7f7c4c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.527+0000 7f7c6ac00640 1 --2- 172.21.15.131:0/1075824515 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c4c004d40 0x7f7c4c0051c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f7c5c009fc0 tx=0x7f7c4c005830 comp rx=0 tx=0).stop 2024-04-12T19:39:51.530 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.527+0000 7f7c6a200640 1 -- 172.21.15.131:0/1075824515 reap_dead start 2024-04-12T19:39:51.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.527+0000 7f7c6ac00640 1 -- 172.21.15.131:0/1075824515 shutdown_connections 2024-04-12T19:39:51.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.527+0000 7f7c6ac00640 1 -- 172.21.15.131:0/1075824515 >> 172.21.15.131:0/1075824515 conn(0x7f7c640c24d0 msgr2=0x7f7c640c28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:51.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.527+0000 7f7c6ac00640 1 -- 172.21.15.131:0/1075824515 shutdown_connections 2024-04-12T19:39:51.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.527+0000 7f7c6ac00640 1 -- 172.21.15.131:0/1075824515 wait complete. 2024-04-12T19:39:51.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.529+0000 7f7c6ac00640 1 Processor -- start 2024-04-12T19:39:51.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.529+0000 7f7c6ac00640 1 -- start start 2024-04-12T19:39:51.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.530+0000 7f7c6ac00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c4c004d40 0x7f7c640b7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.530+0000 7f7c6ac00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c64151b40 0x7f7c64150e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.530+0000 7f7c6ac00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c641d8fb0 0x7f7c641d9430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.530+0000 7f7c6ac00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7c640738a0 con 0x7f7c64151b40 2024-04-12T19:39:51.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.530+0000 7f7c6ac00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7c640a8320 con 0x7f7c4c004d40 2024-04-12T19:39:51.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.530+0000 7f7c6ac00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7c640a7cd0 con 0x7f7c641d8fb0 2024-04-12T19:39:51.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.530+0000 7f7c68e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c64151b40 0x7f7c64150e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.530+0000 7f7c68e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c64151b40 0x7f7c64150e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46878/0 (socket says 172.21.15.131:46878) 2024-04-12T19:39:51.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.530+0000 7f7c68e00640 1 -- 172.21.15.131:0/3229522809 learned_addr learned my addr 172.21.15.131:0/3229522809 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:51.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.530+0000 7f7c6a200640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c641d8fb0 0x7f7c641d9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.530+0000 7f7c69800640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c4c004d40 0x7f7c640b7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.531+0000 7f7c68e00640 1 -- 172.21.15.131:0/3229522809 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c641d8fb0 msgr2=0x7f7c641d9430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.531+0000 7f7c68e00640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c641d8fb0 0x7f7c641d9430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.531+0000 7f7c68e00640 1 -- 172.21.15.131:0/3229522809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c4c004d40 msgr2=0x7f7c640b7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.531+0000 7f7c68e00640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c4c004d40 0x7f7c640b7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.531+0000 7f7c68e00640 1 -- 172.21.15.131:0/3229522809 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c640b8340 con 0x7f7c64151b40 2024-04-12T19:39:51.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.531+0000 7f7c68e00640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c64151b40 0x7f7c64150e80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000d7d0 tx=0x7f7c5000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:51.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.531+0000 7f7c61600640 1 -- 172.21.15.131:0/3229522809 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50019070 con 0x7f7c64151b40 2024-04-12T19:39:51.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.531+0000 7f7c61600640 1 -- 172.21.15.131:0/3229522809 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c50005290 con 0x7f7c64151b40 2024-04-12T19:39:51.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.531+0000 7f7c61600640 1 -- 172.21.15.131:0/3229522809 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c50007030 con 0x7f7c64151b40 2024-04-12T19:39:51.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.531+0000 7f7c6ac00640 1 -- 172.21.15.131:0/3229522809 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c640a58a0 con 0x7f7c64151b40 2024-04-12T19:39:51.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.531+0000 7f7c6ac00640 1 -- 172.21.15.131:0/3229522809 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c640a5b40 con 0x7f7c64151b40 2024-04-12T19:39:51.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.532+0000 7f7c6ac00640 1 -- 172.21.15.131:0/3229522809 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c64075c30 con 0x7f7c64151b40 2024-04-12T19:39:51.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.533+0000 7f7c61600640 1 -- 172.21.15.131:0/3229522809 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7c500071d0 con 0x7f7c64151b40 2024-04-12T19:39:51.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.534+0000 7f7c61600640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c4406c8f0 0x7f7c4406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.534+0000 7f7c61600640 1 -- 172.21.15.131:0/3229522809 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f7c5008b650 con 0x7f7c64151b40 2024-04-12T19:39:51.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.534+0000 7f7c69800640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c4406c8f0 0x7f7c4406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.535+0000 7f7c69800640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c4406c8f0 0x7f7c4406edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7c641db180 tx=0x7f7c58009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:51.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.539+0000 7f7c61600640 1 -- 172.21.15.131:0/3229522809 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7c50059730 con 0x7f7c64151b40 2024-04-12T19:39:51.739 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.739+0000 7f7c6ac00640 1 -- 172.21.15.131:0/3229522809 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c640bd9a0 con 0x7f7c64151b40 2024-04-12T19:39:51.742 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.742+0000 7f7c61600640 1 -- 172.21.15.131:0/3229522809 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18502 (secure 0 0 0) 0x7f7c50059030 con 0x7f7c64151b40 2024-04-12T19:39:51.743 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:51.743 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":26,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T19:39:17.479662+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T19:39:51.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.745+0000 7f7c6ac00640 1 -- 172.21.15.131:0/3229522809 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c4406c8f0 msgr2=0x7f7c4406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.745+0000 7f7c6ac00640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c4406c8f0 0x7f7c4406edb0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7c641db180 tx=0x7f7c58009040 comp rx=0 tx=0).stop 2024-04-12T19:39:51.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.745+0000 7f7c6ac00640 1 -- 172.21.15.131:0/3229522809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c64151b40 msgr2=0x7f7c64150e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.745+0000 7f7c6ac00640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c64151b40 0x7f7c64150e80 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7c5000d7d0 tx=0x7f7c5000dc90 comp rx=0 tx=0).stop 2024-04-12T19:39:51.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.745+0000 7f7c6ac00640 1 -- 172.21.15.131:0/3229522809 shutdown_connections 2024-04-12T19:39:51.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.745+0000 7f7c6ac00640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f7c4406c8f0 0x7f7c4406edb0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.745+0000 7f7c6ac00640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7c641d8fb0 0x7f7c641d9430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.745+0000 7f7c6ac00640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c64151b40 0x7f7c64150e80 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.745+0000 7f7c6ac00640 1 --2- 172.21.15.131:0/3229522809 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f7c4c004d40 0x7f7c640b7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.745+0000 7f7c6ac00640 1 -- 172.21.15.131:0/3229522809 >> 172.21.15.131:0/3229522809 conn(0x7f7c640c24d0 msgr2=0x7f7c6406dee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:51.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.745+0000 7f7c6ac00640 1 -- 172.21.15.131:0/3229522809 shutdown_connections 2024-04-12T19:39:51.746 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.745+0000 7f7c6ac00640 1 -- 172.21.15.131:0/3229522809 wait complete. 2024-04-12T19:39:51.765 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-12T19:39:51.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.971+0000 7fc2d3200640 1 Processor -- start 2024-04-12T19:39:51.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.971+0000 7fc2d3200640 1 -- start start 2024-04-12T19:39:51.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.973+0000 7fc2d3200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc2cc1484e0 0x7fc2cc159960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.973+0000 7fc2d3200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2cc06f770 con 0x7fc2cc073d00 2024-04-12T19:39:51.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.973+0000 7fc2d3200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2cc0716c0 con 0x7fc2cc0be310 2024-04-12T19:39:51.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.973+0000 7fc2d3200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc2cc06f520 con 0x7fc2cc1484e0 2024-04-12T19:39:51.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.973+0000 7fc2cb400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fc2cc073d00 0x7fc2cc147dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:51180/0 (socket says 172.21.15.131:51180) 2024-04-12T19:39:51.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.973+0000 7fc2cb400640 1 -- 172.21.15.131:0/890993581 learned_addr learned my addr 172.21.15.131:0/890993581 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T19:39:51.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.973+0000 7fc2d1200640 1 --2- 172.21.15.131:0/890993581 >> v2:172.21.15.131:3300/0 conn(0x7fc2cc1484e0 0x7fc2cc159960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.974+0000 7fc2caa00640 1 -- 172.21.15.131:0/890993581 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840338115 0 0) 0x7fc2cc06f770 con 0x7fc2cc073d00 2024-04-12T19:39:51.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.974+0000 7fc2d1200640 1 -- 172.21.15.131:0/890993581 >> v1:172.21.15.171:6789/0 conn(0x7fc2cc0be310 legacy=0x7fc2cc0735f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.974+0000 7fc2d1200640 1 -- 172.21.15.131:0/890993581 >> v1:172.21.15.131:6789/0 conn(0x7fc2cc073d00 legacy=0x7fc2cc147dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.974 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.974+0000 7fc2d1200640 1 -- 172.21.15.131:0/890993581 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2cc0719a0 con 0x7fc2cc1484e0 2024-04-12T19:39:51.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.975+0000 7fc2d1200640 1 --2- 172.21.15.131:0/890993581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2cc1484e0 0x7fc2cc159960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009d90 tx=0x7fc2c402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8c8b1f5bd176fe8 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:51.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.975+0000 7fc2caa00640 1 -- 172.21.15.131:0/890993581 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4039070 con 0x7fc2cc1484e0 2024-04-12T19:39:51.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.975+0000 7fc2caa00640 1 -- 172.21.15.131:0/890993581 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c402cc60 con 0x7fc2cc1484e0 2024-04-12T19:39:51.975 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.975+0000 7fc2caa00640 1 -- 172.21.15.131:0/890993581 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c4034660 con 0x7fc2cc1484e0 2024-04-12T19:39:51.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.976+0000 7fc2d3200640 1 -- 172.21.15.131:0/890993581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2cc1484e0 msgr2=0x7fc2cc159960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.976+0000 7fc2d3200640 1 --2- 172.21.15.131:0/890993581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2cc1484e0 0x7fc2cc159960 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4009d90 tx=0x7fc2c402beb0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.976+0000 7fc2d3200640 1 -- 172.21.15.131:0/890993581 shutdown_connections 2024-04-12T19:39:51.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.976+0000 7fc2d3200640 1 --2- 172.21.15.131:0/890993581 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2cc1484e0 0x7fc2cc159960 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.976+0000 7fc2d3200640 1 -- 172.21.15.131:0/890993581 >> 172.21.15.131:0/890993581 conn(0x7fc2cc0c2590 msgr2=0x7fc2cc0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:51.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.976+0000 7fc2d3200640 1 -- 172.21.15.131:0/890993581 shutdown_connections 2024-04-12T19:39:51.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.976+0000 7fc2d3200640 1 -- 172.21.15.131:0/890993581 wait complete. 2024-04-12T19:39:51.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.977+0000 7fc2d3200640 1 Processor -- start 2024-04-12T19:39:51.977 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.978+0000 7fc2d3200640 1 -- start start 2024-04-12T19:39:51.979 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.978+0000 7fc2d3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2cc073d00 0x7fc2cc0b96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.978+0000 7fc2d3200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2cc0be310 0x7fc2cc141a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.978+0000 7fc2d3200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2cc1484e0 0x7fc2cc1ea940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.978+0000 7fc2d3200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc06fa30 con 0x7fc2cc073d00 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.978+0000 7fc2d3200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc2cc06d5a0 con 0x7fc2cc0be310 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.978+0000 7fc2d3200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc2cc0be6f0 con 0x7fc2cc1484e0 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.979+0000 7fc2cbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2cc073d00 0x7fc2cc0b96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.979+0000 7fc2cbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2cc073d00 0x7fc2cc0b96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46894/0 (socket says 172.21.15.131:46894) 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.979+0000 7fc2cbe00640 1 -- 172.21.15.131:0/1805832361 learned_addr learned my addr 172.21.15.131:0/1805832361 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.979+0000 7fc2cbe00640 1 -- 172.21.15.131:0/1805832361 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2cc1484e0 msgr2=0x7fc2cc1ea940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.979+0000 7fc2cbe00640 1 --2- 172.21.15.131:0/1805832361 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2cc1484e0 0x7fc2cc1ea940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.979+0000 7fc2cbe00640 1 -- 172.21.15.131:0/1805832361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2cc0be310 msgr2=0x7fc2cc141a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.979+0000 7fc2cbe00640 1 --2- 172.21.15.131:0/1805832361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2cc0be310 0x7fc2cc141a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.979+0000 7fc2cbe00640 1 -- 172.21.15.131:0/1805832361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2cc0bad90 con 0x7fc2cc073d00 2024-04-12T19:39:51.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.979+0000 7fc2cbe00640 1 --2- 172.21.15.131:0/1805832361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2cc073d00 0x7fc2cc0b96f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00c450 tx=0x7fc2bc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:51.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.980+0000 7fc2c3e00640 1 -- 172.21.15.131:0/1805832361 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc0052d0 con 0x7fc2cc073d00 2024-04-12T19:39:51.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.980+0000 7fc2c3e00640 1 -- 172.21.15.131:0/1805832361 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2bc005470 con 0x7fc2cc073d00 2024-04-12T19:39:51.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.980+0000 7fc2c3e00640 1 -- 172.21.15.131:0/1805832361 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2bc012870 con 0x7fc2cc073d00 2024-04-12T19:39:51.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.980+0000 7fc2d3200640 1 -- 172.21.15.131:0/1805832361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2cc140f70 con 0x7fc2cc073d00 2024-04-12T19:39:51.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.980+0000 7fc2d3200640 1 -- 172.21.15.131:0/1805832361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2cc141530 con 0x7fc2cc073d00 2024-04-12T19:39:51.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.981+0000 7fc2d3200640 1 -- 172.21.15.131:0/1805832361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2cc0bffa0 con 0x7fc2cc073d00 2024-04-12T19:39:51.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.982+0000 7fc2c3e00640 1 -- 172.21.15.131:0/1805832361 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc2bc012a10 con 0x7fc2cc073d00 2024-04-12T19:39:51.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.983+0000 7fc2c3e00640 1 --2- 172.21.15.131:0/1805832361 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc2ac06c920 0x7fc2ac06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:51.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.983+0000 7fc2c3e00640 1 -- 172.21.15.131:0/1805832361 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fc2bc08b9f0 con 0x7fc2cc073d00 2024-04-12T19:39:51.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.983+0000 7fc2cb400640 1 --2- 172.21.15.131:0/1805832361 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc2ac06c920 0x7fc2ac06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:51.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.984+0000 7fc2cb400640 1 --2- 172.21.15.131:0/1805832361 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc2ac06c920 0x7fc2ac06ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8000c00 tx=0x7fc2b80079c0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:51.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:51.988+0000 7fc2c3e00640 1 -- 172.21.15.131:0/1805832361 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc2cc0bffa0 con 0x7fc2cc073d00 2024-04-12T19:39:52.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.235+0000 7fc2d3200640 1 -- 172.21.15.131:0/1805832361 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc2cc04fd50 con 0x7fc2cc073d00 2024-04-12T19:39:52.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.237+0000 7fc2c3e00640 1 -- 172.21.15.131:0/1805832361 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+5186 (secure 0 0 0) 0x7fc2bc059b70 con 0x7fc2cc073d00 2024-04-12T19:39:52.237 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T19:39:52.237 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4245,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6836/3941197710","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6834","nonce":3941197710},{"type":"v1","addr":"172.21.15.131:6836","nonce":3941197710}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6837/2898590457","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6835","nonce":2898590457},{"type":"v1","addr":"172.21.15.131:6837","nonce":2898590457}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4252,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.171:6835/373698102","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6833","nonce":373698102},{"type":"v1","addr":"172.21.15.171:6835","nonce":373698102}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-12T19:39:10.876760+0000","modified":"2024-04-12T19:39:37.561387+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4257":{"gid":4257,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.171:6834/1013642393","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6832","nonce":1013642393},{"type":"v1","addr":"172.21.15.171:6834","nonce":1013642393}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4257,"qdb_cluster":[4257]},"id":1}]} 2024-04-12T19:39:52.237 INFO:teuthology.orchestra.run.smithi131.stderr:dumped fsmap epoch 8 2024-04-12T19:39:52.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.239+0000 7fc2d3200640 1 -- 172.21.15.131:0/1805832361 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc2ac06c920 msgr2=0x7fc2ac06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:52.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.239+0000 7fc2d3200640 1 --2- 172.21.15.131:0/1805832361 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc2ac06c920 0x7fc2ac06ede0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fc2b8000c00 tx=0x7fc2b80079c0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.239+0000 7fc2d3200640 1 -- 172.21.15.131:0/1805832361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2cc073d00 msgr2=0x7fc2cc0b96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:52.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.239+0000 7fc2d3200640 1 --2- 172.21.15.131:0/1805832361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2cc073d00 0x7fc2cc0b96f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc2bc00c450 tx=0x7fc2bc00c910 comp rx=0 tx=0).stop 2024-04-12T19:39:52.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.240+0000 7fc2d3200640 1 -- 172.21.15.131:0/1805832361 shutdown_connections 2024-04-12T19:39:52.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.240+0000 7fc2d3200640 1 --2- 172.21.15.131:0/1805832361 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc2ac06c920 0x7fc2ac06ede0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.240+0000 7fc2d3200640 1 --2- 172.21.15.131:0/1805832361 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc2cc0be310 0x7fc2cc141a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.240+0000 7fc2d3200640 1 --2- 172.21.15.131:0/1805832361 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc2cc1484e0 0x7fc2cc1ea940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.240+0000 7fc2d3200640 1 --2- 172.21.15.131:0/1805832361 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc2cc073d00 0x7fc2cc0b96f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.240 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.240+0000 7fc2d3200640 1 -- 172.21.15.131:0/1805832361 >> 172.21.15.131:0/1805832361 conn(0x7fc2cc0c2590 msgr2=0x7fc2cc144c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:52.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.240+0000 7fc2d3200640 1 -- 172.21.15.131:0/1805832361 shutdown_connections 2024-04-12T19:39:52.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.240+0000 7fc2d3200640 1 -- 172.21.15.131:0/1805832361 wait complete. 2024-04-12T19:39:52.659 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-12T19:39:10.876760+0000', 'modified': '2024-04-12T19:39:37.561387+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4257}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4257': {'gid': 4257, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.171:6834/1013642393', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.171:6832', 'nonce': 1013642393}, {'type': 'v1', 'addr': '172.21.15.171:6834', 'nonce': 1013642393}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4257, 'qdb_cluster': [4257]} 2024-04-12T19:39:52.660 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-12T19:39:52.660 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-12T19:39:52.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.869+0000 7f04a2a00640 1 Processor -- start 2024-04-12T19:39:52.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.869+0000 7f04a2a00640 1 -- start start 2024-04-12T19:39:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.871+0000 7f04a2a00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f049c0bf720 0x7f049c06e380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.871+0000 7f04a2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f049c0beb40 0x7f049c15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.871+0000 7f04a2a00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f049c0be300 con 0x7f049c0b8460 2024-04-12T19:39:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.871+0000 7f04a2a00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f049c0b76e0 con 0x7f049c0bf720 2024-04-12T19:39:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.871+0000 7f04a2a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f049c0bd140 con 0x7f049c0beb40 2024-04-12T19:39:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.871+0000 7f049be00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f049c0bf720 0x7f049c06e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.871+0000 7f049be00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f049c0bf720 0x7f049c06e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46900/0 (socket says 172.21.15.131:46900) 2024-04-12T19:39:52.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.871+0000 7f049be00640 1 -- 172.21.15.131:0/4095010675 learned_addr learned my addr 172.21.15.131:0/4095010675 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:52.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.872+0000 7f04a0a00640 1 --2- 172.21.15.131:0/4095010675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f049c0beb40 0x7f049c15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.872+0000 7f049be00640 1 -- 172.21.15.131:0/4095010675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f049c0beb40 msgr2=0x7f049c15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:52.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.872+0000 7f049be00640 1 --2- 172.21.15.131:0/4095010675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f049c0beb40 0x7f049c15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.872+0000 7f049be00640 1 -- 172.21.15.131:0/4095010675 >> v1:172.21.15.131:6789/0 conn(0x7f049c0b8460 legacy=0x7f049c151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:52.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.872+0000 7f049be00640 1 -- 172.21.15.131:0/4095010675 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c0b7980 con 0x7f049c0bf720 2024-04-12T19:39:52.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.872+0000 7f04a0a00640 1 --2- 172.21.15.131:0/4095010675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f049c0beb40 0x7f049c15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:52.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.873+0000 7f049be00640 1 --2- 172.21.15.131:0/4095010675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f049c0bf720 0x7f049c06e380 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f048c009870 tx=0x7f048c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=157b7ffce831cdd2 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:52.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.873+0000 7f049aa00640 1 -- 172.21.15.131:0/4095010675 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c034070 con 0x7f049c0bf720 2024-04-12T19:39:52.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.873+0000 7f049aa00640 1 -- 172.21.15.131:0/4095010675 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c030840 con 0x7f049c0bf720 2024-04-12T19:39:52.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.873+0000 7f049aa00640 1 -- 172.21.15.131:0/4095010675 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c030c10 con 0x7f049c0bf720 2024-04-12T19:39:52.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.874+0000 7f04a2a00640 1 -- 172.21.15.131:0/4095010675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f049c0bf720 msgr2=0x7f049c06e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:52.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.874+0000 7f04a2a00640 1 --2- 172.21.15.131:0/4095010675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f049c0bf720 0x7f049c06e380 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f048c009870 tx=0x7f048c02b980 comp rx=0 tx=0).stop 2024-04-12T19:39:52.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.874+0000 7f04a2a00640 1 -- 172.21.15.131:0/4095010675 shutdown_connections 2024-04-12T19:39:52.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.874+0000 7f04a2a00640 1 --2- 172.21.15.131:0/4095010675 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f049c0beb40 0x7f049c15bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.874+0000 7f04a2a00640 1 --2- 172.21.15.131:0/4095010675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f049c0bf720 0x7f049c06e380 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.874+0000 7f04a2a00640 1 -- 172.21.15.131:0/4095010675 >> 172.21.15.131:0/4095010675 conn(0x7f049c06be00 msgr2=0x7f049c06c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:52.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.874+0000 7f04a2a00640 1 -- 172.21.15.131:0/4095010675 shutdown_connections 2024-04-12T19:39:52.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.874+0000 7f04a2a00640 1 -- 172.21.15.131:0/4095010675 wait complete. 2024-04-12T19:39:52.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.876+0000 7f04a2a00640 1 Processor -- start 2024-04-12T19:39:52.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.876+0000 7f04a2a00640 1 -- start start 2024-04-12T19:39:52.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.877+0000 7f04a2a00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f049c0b8460 0x7f049c153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.877+0000 7f04a2a00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f049c0beb40 0x7f049c072500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.877+0000 7f04a2a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f049c0bf720 0x7f049c1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.877+0000 7f04a2a00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f049c0b92f0 con 0x7f049c0bf720 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.877+0000 7f04a2a00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f049c0b7f40 con 0x7f049c0beb40 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.877+0000 7f04a2a00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f049c0bdfd0 con 0x7f049c0b8460 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.877+0000 7f04a0a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f049c0bf720 0x7f049c1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.877+0000 7f04a0a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f049c0bf720 0x7f049c1523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46914/0 (socket says 172.21.15.131:46914) 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.877+0000 7f04a0a00640 1 -- 172.21.15.131:0/876627815 learned_addr learned my addr 172.21.15.131:0/876627815 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.877+0000 7f049be00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f049c0b8460 0x7f049c153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.877+0000 7f049b400640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f049c0beb40 0x7f049c072500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f04a0a00640 1 -- 172.21.15.131:0/876627815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f049c0b8460 msgr2=0x7f049c153d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f04a0a00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f049c0b8460 0x7f049c153d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f04a0a00640 1 -- 172.21.15.131:0/876627815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f049c0beb40 msgr2=0x7f049c072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f04a0a00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f049c0beb40 0x7f049c072500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f04a0a00640 1 -- 172.21.15.131:0/876627815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f049c072a40 con 0x7f049c0bf720 2024-04-12T19:39:52.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f049b400640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f049c0beb40 0x7f049c072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:52.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f049be00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f049c0b8460 0x7f049c153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:52.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f04a0a00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f049c0bf720 0x7f049c1523f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f049400c7f0 tx=0x7f049400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:52.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f0493e00640 1 -- 172.21.15.131:0/876627815 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494015070 con 0x7f049c0bf720 2024-04-12T19:39:52.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f0493e00640 1 -- 172.21.15.131:0/876627815 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0494004240 con 0x7f049c0bf720 2024-04-12T19:39:52.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f04a2a00640 1 -- 172.21.15.131:0/876627815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f049c0bb6a0 con 0x7f049c0bf720 2024-04-12T19:39:52.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f0493e00640 1 -- 172.21.15.131:0/876627815 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494007620 con 0x7f049c0bf720 2024-04-12T19:39:52.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.878+0000 7f04a2a00640 1 -- 172.21.15.131:0/876627815 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f049c0bbf90 con 0x7f049c0bf720 2024-04-12T19:39:52.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.880+0000 7f0493e00640 1 -- 172.21.15.131:0/876627815 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04940079d0 con 0x7f049c0bf720 2024-04-12T19:39:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.881+0000 7f0493e00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f047806c920 0x7f047806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.881+0000 7f0493e00640 1 -- 172.21.15.131:0/876627815 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f049408bfa0 con 0x7f049c0bf720 2024-04-12T19:39:52.882 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.881+0000 7f049be00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f047806c920 0x7f047806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.882+0000 7f04a59a3740 1 Processor -- start 2024-04-12T19:39:52.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.882+0000 7f04a59a3740 1 -- start start 2024-04-12T19:39:52.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.882+0000 7f049be00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f047806c920 0x7f047806ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f048c036000 tx=0x7f048c03b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:52.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a59a3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5af9d4e0 0x55dd5af5c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a59a3740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af62a00 0x55dd5af5cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a59a3740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af612a0 0x55dd5af7ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a59a3740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55dd5aec7990 con 0x55dd5af612a0 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a59a3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55dd5ae6e530 con 0x55dd5af9d4e0 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a59a3740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55dd5aec3950 con 0x55dd5af62a00 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a0a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af612a0 0x55dd5af7ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a0a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af612a0 0x55dd5af7ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46930/0 (socket says 172.21.15.131:46930) 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a0a00640 1 -- 172.21.15.131:0/1276538347 learned_addr learned my addr 172.21.15.131:0/1276538347 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a0a00640 1 -- 172.21.15.131:0/1276538347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af62a00 msgr2=0x55dd5af5cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a0a00640 1 --2- 172.21.15.131:0/1276538347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af62a00 0x55dd5af5cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a0a00640 1 -- 172.21.15.131:0/1276538347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5af9d4e0 msgr2=0x55dd5af5c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a0a00640 1 --2- 172.21.15.131:0/1276538347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5af9d4e0 0x55dd5af5c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.883+0000 7f04a0a00640 1 -- 172.21.15.131:0/1276538347 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd5abda2d0 con 0x55dd5af612a0 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.884+0000 7f04a0a00640 1 --2- 172.21.15.131:0/1276538347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af612a0 0x55dd5af7ecb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0494004770 tx=0x7f049405dd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=982a12c803c82d70 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:52.885 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.884+0000 7f048be00640 1 -- 172.21.15.131:0/1276538347 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f049401e040 con 0x55dd5af612a0 2024-04-12T19:39:52.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.884+0000 7f048be00640 1 -- 172.21.15.131:0/1276538347 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0494057c80 con 0x55dd5af612a0 2024-04-12T19:39:52.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.884+0000 7f048be00640 1 -- 172.21.15.131:0/1276538347 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0494007cc0 con 0x55dd5af612a0 2024-04-12T19:39:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.884+0000 7f04a59a3740 1 -- 172.21.15.131:0/1276538347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af612a0 msgr2=0x55dd5af7ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.884+0000 7f04a59a3740 1 --2- 172.21.15.131:0/1276538347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af612a0 0x55dd5af7ecb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0494004770 tx=0x7f049405dd30 comp rx=0 tx=0).stop 2024-04-12T19:39:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.884+0000 7f04a59a3740 1 -- 172.21.15.131:0/1276538347 shutdown_connections 2024-04-12T19:39:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.884+0000 7f04a59a3740 1 --2- 172.21.15.131:0/1276538347 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af612a0 0x55dd5af7ecb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.884+0000 7f04a59a3740 1 --2- 172.21.15.131:0/1276538347 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af62a00 0x55dd5af5cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.884+0000 7f04a59a3740 1 --2- 172.21.15.131:0/1276538347 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5af9d4e0 0x55dd5af5c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.884+0000 7f04a59a3740 1 -- 172.21.15.131:0/1276538347 >> 172.21.15.131:0/1276538347 conn(0x55dd5af5e680 msgr2=0x55dd5af9cbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.885+0000 7f04a59a3740 1 -- 172.21.15.131:0/1276538347 shutdown_connections 2024-04-12T19:39:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.885+0000 7f04a59a3740 1 -- 172.21.15.131:0/1276538347 wait complete. 2024-04-12T19:39:52.888 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.885+0000 7f04a59a3740 1 -- start start 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.885+0000 7f04a59a3740 1 Processor -- start 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.886+0000 7f04a59a3740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 0x55dd5af970e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.886+0000 7f04a59a3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5af9d4e0 0x55dd5af96390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.886+0000 7f04a59a3740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5afaa040 0x55dd5af8e8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.886+0000 7f04a59a3740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55dd5af977b0 con 0x55dd5af62a00 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.886+0000 7f04a59a3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x55dd5ae818f0 con 0x55dd5af9d4e0 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.886+0000 7f04a59a3740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55dd5af62e20 con 0x55dd5afaa040 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.886+0000 7f04a59a3740 10 client.0 _ll_register_callbacks cb 0x55dd5ae812e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f049be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 0x55dd5af970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f049be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 0x55dd5af970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46946/0 (socket says 172.21.15.131:46946) 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f049be00640 1 -- 172.21.15.131:0/3629275012 learned_addr learned my addr 172.21.15.131:0/3629275012 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f049be00640 1 -- 172.21.15.131:0/3629275012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5afaa040 msgr2=0x55dd5af8e8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f049be00640 1 --2- 172.21.15.131:0/3629275012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5afaa040 0x55dd5af8e8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f049be00640 1 -- 172.21.15.131:0/3629275012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5af9d4e0 msgr2=0x55dd5af96390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f049be00640 1 --2- 172.21.15.131:0/3629275012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5af9d4e0 0x55dd5af96390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f049be00640 1 -- 172.21.15.131:0/3629275012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd5aca46b0 con 0x55dd5af62a00 2024-04-12T19:39:52.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f049be00640 1 --2- 172.21.15.131:0/3629275012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 0x55dd5af970e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f048c0396d0 tx=0x7f048c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721f0789ddd58932 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:52.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f0488c00640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-04-12T19:39:52.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f0488c00640 1 -- 172.21.15.131:0/3629275012 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c034040 con 0x55dd5af62a00 2024-04-12T19:39:52.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f0488c00640 1 -- 172.21.15.131:0/3629275012 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f048c0446d0 con 0x55dd5af62a00 2024-04-12T19:39:52.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.887+0000 7f04a59a3740 1 -- 172.21.15.131:0/3629275012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0494057c80 con 0x55dd5af62a00 2024-04-12T19:39:52.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.888+0000 7f0488c00640 1 -- 172.21.15.131:0/3629275012 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f048c0448d0 con 0x55dd5af62a00 2024-04-12T19:39:52.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.888+0000 7f04a59a3740 10 client.4809 fetch_fsmap learned FSMap version 8 2024-04-12T19:39:52.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.888+0000 7f04a59a3740 1 -- 172.21.15.131:0/3629275012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55dd5afa0990 con 0x55dd5af62a00 2024-04-12T19:39:52.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.888+0000 7f0488c00640 1 -- 172.21.15.131:0/3629275012 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0494057c80 con 0x55dd5af62a00 2024-04-12T19:39:52.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.888+0000 7f0488c00640 1 -- 172.21.15.131:0/3629275012 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f048c04c070 con 0x55dd5af62a00 2024-04-12T19:39:52.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.888+0000 7f04a59a3740 10 client.4809 fetch_fsmap finished waiting for FSMap version 8 2024-04-12T19:39:52.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.888+0000 7f04a59a3740 10 client.4809 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-12T19:39:52.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.888+0000 7f04a59a3740 20 client.4809 populate_metadata read hostname 'smithi131' 2024-04-12T19:39:52.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.888+0000 7f04a59a3740 1 --2- 172.21.15.131:0/3629275012 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x55dd5afb61d0 0x55dd5afb85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.888+0000 7f04a59a3740 4 client.4809 mds_command: new command op to 4257 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-12T19:39:52.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.888+0000 7f04a59a3740 1 -- 172.21.15.131:0/3629275012 --> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd5ae6db40 con 0x55dd5afb61d0 2024-04-12T19:39:52.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.889+0000 7f049b400640 1 --2- 172.21.15.131:0/3629275012 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x55dd5afb61d0 0x55dd5afb85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.890+0000 7f049b400640 1 --2- 172.21.15.131:0/3629275012 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x55dd5afb61d0 0x55dd5afb85c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92090d66d87bf61d server_cookie=89fe19fd6ac294de in_seq=0 out_seq=0 2024-04-12T19:39:52.892 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.890+0000 7f0488c00640 10 client.4809 ms_handle_connect on v2:172.21.15.171:6832/1013642393 2024-04-12T19:39:52.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f0488c00640 1 -- 172.21.15.131:0/3629275012 <== mds.0 v2:172.21.15.171:6832/1013642393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55dd5ae6db40 con 0x55dd5afb61d0 2024-04-12T19:39:52.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f0488c00640 10 client.4809 handle_command_reply: tid=0 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f04a59a3740 1 client.4809 shutdown 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f04a59a3740 1 -- 172.21.15.131:0/3629275012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 msgr2=0x55dd5af970e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f04a59a3740 1 --2- 172.21.15.131:0/3629275012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 0x55dd5af970e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f048c0396d0 tx=0x7f048c0046c0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f04a59a3740 1 -- 172.21.15.131:0/3629275012 shutdown_connections 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f04a59a3740 1 --2- 172.21.15.131:0/3629275012 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x55dd5afb61d0 0x55dd5afb85c0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f04a59a3740 1 --2- 172.21.15.131:0/3629275012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5af9d4e0 0x55dd5af96390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f04a59a3740 1 --2- 172.21.15.131:0/3629275012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5afaa040 0x55dd5af8e8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f0488c00640 0 client.4809 ms_handle_reset on v2:172.21.15.171:6832/1013642393 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f04a59a3740 1 --2- 172.21.15.131:0/3629275012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 0x55dd5af970e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f04a59a3740 1 -- 172.21.15.131:0/3629275012 >> 172.21.15.131:0/3629275012 conn(0x55dd5af612a0 msgr2=0x55dd5af5bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f04a59a3740 1 -- 172.21.15.131:0/3629275012 shutdown_connections 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f04a59a3740 1 -- 172.21.15.131:0/3629275012 wait complete. 2024-04-12T19:39:52.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.892+0000 7f04a59a3740 20 client.4809 trim_cache size 0 max 16384 2024-04-12T19:39:52.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.912+0000 7f04a59a3740 1 Processor -- start 2024-04-12T19:39:52.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.912+0000 7f04a59a3740 1 -- start start 2024-04-12T19:39:52.913 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.912+0000 7f04a59a3740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 0x55dd5af57c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.912+0000 7f04a59a3740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af9d4e0 0x55dd5af924c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.912+0000 7f04a59a3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5afaa040 0x55dd5af92a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.912+0000 7f04a59a3740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1f5090 con 0x55dd5af62a00 2024-04-12T19:39:52.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f04a59a3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1f4070 con 0x55dd5afaa040 2024-04-12T19:39:52.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f04a59a3740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f049c1eacb0 con 0x55dd5af9d4e0 2024-04-12T19:39:52.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f049be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 0x55dd5af57c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f049be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 0x55dd5af57c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46956/0 (socket says 172.21.15.131:46956) 2024-04-12T19:39:52.914 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f049be00640 1 -- 172.21.15.131:0/521862470 learned_addr learned my addr 172.21.15.131:0/521862470 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:52.915 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f049b400640 1 --2- 172.21.15.131:0/521862470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af9d4e0 0x55dd5af924c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f04a0a00640 1 --2- 172.21.15.131:0/521862470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5afaa040 0x55dd5af92a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f049be00640 1 -- 172.21.15.131:0/521862470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af9d4e0 msgr2=0x55dd5af924c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f049be00640 1 --2- 172.21.15.131:0/521862470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af9d4e0 0x55dd5af924c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f049be00640 1 -- 172.21.15.131:0/521862470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5afaa040 msgr2=0x55dd5af92a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f049be00640 1 --2- 172.21.15.131:0/521862470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5afaa040 0x55dd5af92a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f049be00640 1 -- 172.21.15.131:0/521862470 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd5afac9d0 con 0x55dd5af62a00 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f049b400640 1 --2- 172.21.15.131:0/521862470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af9d4e0 0x55dd5af924c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.913+0000 7f04a0a00640 1 --2- 172.21.15.131:0/521862470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5afaa040 0x55dd5af92a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.914+0000 7f049be00640 1 --2- 172.21.15.131:0/521862470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 0x55dd5af57c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f048c030920 tx=0x7f048c048000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f370e90928a941 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.914+0000 7f048b400640 1 -- 172.21.15.131:0/521862470 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c05c070 con 0x55dd5af62a00 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.914+0000 7f048b400640 1 -- 172.21.15.131:0/521862470 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c039450 con 0x55dd5af62a00 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.914+0000 7f048b400640 1 -- 172.21.15.131:0/521862470 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c034040 con 0x55dd5af62a00 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.915+0000 7f04a59a3740 1 -- 172.21.15.131:0/521862470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 msgr2=0x55dd5af57c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:52.916 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.915+0000 7f04a59a3740 1 --2- 172.21.15.131:0/521862470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 0x55dd5af57c90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f048c030920 tx=0x7f048c048000 comp rx=0 tx=0).stop 2024-04-12T19:39:52.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.915+0000 7f04a59a3740 1 -- 172.21.15.131:0/521862470 shutdown_connections 2024-04-12T19:39:52.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.915+0000 7f04a59a3740 1 --2- 172.21.15.131:0/521862470 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5afaa040 0x55dd5af92a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.915+0000 7f04a59a3740 1 --2- 172.21.15.131:0/521862470 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af9d4e0 0x55dd5af924c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.915+0000 7f04a59a3740 1 --2- 172.21.15.131:0/521862470 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5af62a00 0x55dd5af57c90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.915+0000 7f04a59a3740 1 -- 172.21.15.131:0/521862470 >> 172.21.15.131:0/521862470 conn(0x55dd5af612a0 msgr2=0x55dd5af96200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:52.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.915+0000 7f04a59a3740 1 -- 172.21.15.131:0/521862470 shutdown_connections 2024-04-12T19:39:52.917 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.915+0000 7f04a59a3740 1 -- 172.21.15.131:0/521862470 wait complete. 2024-04-12T19:39:52.919 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.915+0000 7f04a59a3740 1 -- start start 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.916+0000 7f04a59a3740 1 Processor -- start 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.916+0000 7f04a59a3740 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af9d4e0 0x55dd5af99c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.916+0000 7f04a59a3740 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5afaa040 0x55dd5af94c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.916+0000 7f04a59a3740 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5af92650 0x55dd5af92ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.916+0000 7f04a59a3740 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x55dd5afa9b20 con 0x55dd5afaa040 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.916+0000 7f04a59a3740 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f049c1f3a50 con 0x55dd5af92650 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.916+0000 7f04a59a3740 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x55dd5af8f670 con 0x55dd5af9d4e0 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.916+0000 7f04a59a3740 10 client.0 _ll_register_callbacks cb 0x7f048c030dd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.917+0000 7f049b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5afaa040 0x55dd5af94c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.917+0000 7f049b400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5afaa040 0x55dd5af94c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46960/0 (socket says 172.21.15.131:46960) 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.917+0000 7f049b400640 1 -- 172.21.15.131:0/589774643 learned_addr learned my addr 172.21.15.131:0/589774643 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.917+0000 7f049b400640 1 -- 172.21.15.131:0/589774643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af9d4e0 msgr2=0x55dd5af99c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.917+0000 7f049b400640 1 --2- 172.21.15.131:0/589774643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af9d4e0 0x55dd5af99c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.920 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.917+0000 7f049b400640 1 -- 172.21.15.131:0/589774643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5af92650 msgr2=0x55dd5af92ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.917+0000 7f049b400640 1 --2- 172.21.15.131:0/589774643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5af92650 0x55dd5af92ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.917+0000 7f049b400640 1 -- 172.21.15.131:0/589774643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd5af5d3e0 con 0x55dd5afaa040 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.917+0000 7f049b400640 1 --2- 172.21.15.131:0/589774643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5afaa040 0x55dd5af94c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0484001bf0 tx=0x7f0484004d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20dbf2c68cd065e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.917+0000 7f0488c00640 10 client.0 ms_handle_connect on v2:172.21.15.131:3300/0 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.917+0000 7f0488c00640 1 -- 172.21.15.131:0/589774643 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04840052c0 con 0x55dd5afaa040 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f0488c00640 1 -- 172.21.15.131:0/589774643 <== mon.0 v2:172.21.15.131:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7f0484005460 con 0x55dd5afaa040 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f04a59a3740 1 -- 172.21.15.131:0/589774643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f048c039450 con 0x55dd5afaa040 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f0488c00640 1 -- 172.21.15.131:0/589774643 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) ==== 24+0+0 (secure 0 0 0) 0x7f0484025050 con 0x55dd5afaa040 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f04a59a3740 10 client.4815 fetch_fsmap learned FSMap version 8 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f04a59a3740 1 -- 172.21.15.131:0/589774643 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) -- 0x55dd5af61b90 con 0x55dd5afaa040 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f0488c00640 1 -- 172.21.15.131:0/589774643 <== mon.0 v2:172.21.15.131:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f048c039450 con 0x55dd5afaa040 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f0488c00640 1 -- 172.21.15.131:0/589774643 <== mon.0 v2:172.21.15.131:3300/0 5 ==== fsmap(e 8) ==== 3502+0+0 (secure 0 0 0) 0x7f0484005660 con 0x55dd5afaa040 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f04a59a3740 10 client.4815 fetch_fsmap finished waiting for FSMap version 8 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f04a59a3740 10 client.4815 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-12T19:39:52.921 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f04a59a3740 20 client.4815 populate_metadata read hostname 'smithi131' 2024-04-12T19:39:52.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f04a59a3740 1 --2- 172.21.15.131:0/589774643 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x55dd5b019210 0x55dd5b0195f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:52.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f04a59a3740 4 client.4815 mds_command: new command op to 4257 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-12T19:39:52.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.918+0000 7f04a59a3740 1 -- 172.21.15.131:0/589774643 --> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] -- command(tid 0: {"prefix": "status"}) -- 0x55dd5aed53b0 con 0x55dd5b019210 2024-04-12T19:39:52.922 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.919+0000 7f049be00640 1 --2- 172.21.15.131:0/589774643 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x55dd5b019210 0x55dd5b0195f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:52.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.920+0000 7f0488c00640 10 client.4815 ms_handle_connect on v2:172.21.15.171:6832/1013642393 2024-04-12T19:39:52.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.920+0000 7f049be00640 1 --2- 172.21.15.131:0/589774643 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x55dd5b019210 0x55dd5b0195f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b64ef6051ad5a36 server_cookie=50d84df88e6e0cdb in_seq=0 out_seq=0 2024-04-12T19:39:52.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.920+0000 7f0488c00640 1 -- 172.21.15.131:0/589774643 <== mds.0 v2:172.21.15.171:6832/1013642393 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55dd5aed53b0 con 0x55dd5b019210 2024-04-12T19:39:52.923 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.920+0000 7f0488c00640 10 client.4815 handle_command_reply: tid=0 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.920+0000 7f04a59a3740 1 client.4815 shutdown 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.921+0000 7f04a59a3740 1 -- 172.21.15.131:0/589774643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5afaa040 msgr2=0x55dd5af94c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.921+0000 7f04a59a3740 1 --2- 172.21.15.131:0/589774643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5afaa040 0x55dd5af94c40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0484001bf0 tx=0x7f0484004d50 comp rx=0 tx=0).stop 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.921+0000 7f04a59a3740 1 -- 172.21.15.131:0/589774643 shutdown_connections 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.921+0000 7f04a59a3740 1 --2- 172.21.15.131:0/589774643 >> [v2:172.21.15.171:6832/1013642393,v1:172.21.15.171:6834/1013642393] conn(0x55dd5b019210 0x55dd5b0195f0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.921+0000 7f04a59a3740 1 --2- 172.21.15.131:0/589774643 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x55dd5af92650 0x55dd5af92ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.921+0000 7f04a59a3740 1 --2- 172.21.15.131:0/589774643 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x55dd5afaa040 0x55dd5af94c40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.921+0000 7f0488c00640 0 client.4815 ms_handle_reset on v2:172.21.15.171:6832/1013642393 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.921+0000 7f04a59a3740 1 --2- 172.21.15.131:0/589774643 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x55dd5af9d4e0 0x55dd5af99c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.921+0000 7f04a59a3740 1 -- 172.21.15.131:0/589774643 >> 172.21.15.131:0/589774643 conn(0x55dd5af612a0 msgr2=0x55dd5af57c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.921+0000 7f04a59a3740 1 -- 172.21.15.131:0/589774643 shutdown_connections 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.921+0000 7f04a59a3740 1 -- 172.21.15.131:0/589774643 wait complete. 2024-04-12T19:39:52.924 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.921+0000 7f04a59a3740 20 client.4815 trim_cache size 0 max 16384 2024-04-12T19:39:52.925 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-12T19:39:52.925 INFO:teuthology.orchestra.run.smithi131.stdout: "cluster_fsid": "7d934d91-9372-4a63-bf09-7016009c45b3", 2024-04-12T19:39:52.925 INFO:teuthology.orchestra.run.smithi131.stdout: "whoami": 0, 2024-04-12T19:39:52.925 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4257, 2024-04-12T19:39:52.925 INFO:teuthology.orchestra.run.smithi131.stdout: "want_state": "up:active", 2024-04-12T19:39:52.925 INFO:teuthology.orchestra.run.smithi131.stdout: "state": "up:active", 2024-04-12T19:39:52.925 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs", 2024-04-12T19:39:52.925 INFO:teuthology.orchestra.run.smithi131.stdout: "rank_uptime": 41.469599438000003, 2024-04-12T19:39:52.925 INFO:teuthology.orchestra.run.smithi131.stdout: "mdsmap_epoch": 8, 2024-04-12T19:39:52.925 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch": 26, 2024-04-12T19:39:52.925 INFO:teuthology.orchestra.run.smithi131.stdout: "osdmap_epoch_barrier": 26, 2024-04-12T19:39:52.925 INFO:teuthology.orchestra.run.smithi131.stdout: "uptime": 48.689847813 2024-04-12T19:39:52.926 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-12T19:39:52.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.922+0000 7f04a2a00640 1 -- 172.21.15.131:0/876627815 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f047806c920 msgr2=0x7f047806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:52.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.922+0000 7f04a2a00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f047806c920 0x7f047806ede0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f048c036000 tx=0x7f048c03b040 comp rx=0 tx=0).stop 2024-04-12T19:39:52.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.922+0000 7f04a2a00640 1 -- 172.21.15.131:0/876627815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f049c0bf720 msgr2=0x7f049c1523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:52.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.922+0000 7f04a2a00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f049c0bf720 0x7f049c1523f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f049400c7f0 tx=0x7f049400ccb0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.922+0000 7f04a2a00640 1 -- 172.21.15.131:0/876627815 shutdown_connections 2024-04-12T19:39:52.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.922+0000 7f04a2a00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f047806c920 0x7f047806ede0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.922+0000 7f04a2a00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f049c0beb40 0x7f049c072500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.922+0000 7f04a2a00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f049c0bf720 0x7f049c1523f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.922+0000 7f04a2a00640 1 --2- 172.21.15.131:0/876627815 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f049c0b8460 0x7f049c153d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:52.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.922+0000 7f04a2a00640 1 -- 172.21.15.131:0/876627815 >> 172.21.15.131:0/876627815 conn(0x7f049c06be00 msgr2=0x7f049c14e430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:52.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.922+0000 7f04a2a00640 1 -- 172.21.15.131:0/876627815 shutdown_connections 2024-04-12T19:39:52.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:52.922+0000 7f04a2a00640 1 -- 172.21.15.131:0/876627815 wait complete. 2024-04-12T19:39:52.938 INFO:teuthology.run_tasks:Running task sequential... 2024-04-12T19:39:52.947 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-12T19:39:52.947 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-12T19:39:52.948 INFO:teuthology.task.print:Enabling mgr modules 2024-04-12T19:39:52.948 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-12T19:39:52.957 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-12T19:39:52.958 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-12T19:39:52.958 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-12T19:39:52.958 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-12T19:39:52.958 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-12T19:39:52.958 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:52.958 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-04-12T19:39:53.007 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-12T19:39:53.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:53.008 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-12T19:39:53.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:53.100 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-04-12T19:39:53.226 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-12T19:39:53.227 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-12T19:39:53.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.408+0000 7fa3e3000640 1 Processor -- start 2024-04-12T19:39:53.409 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.408+0000 7fa3e3000640 1 -- start start 2024-04-12T19:39:53.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.409+0000 7fa3e3000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3dc158c00 0x7fa3dc158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:53.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.409+0000 7fa3e3000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa3dc0b8760 0x7fa3dc15ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:53.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.409+0000 7fa3e3000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3dc159620 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.409+0000 7fa3e3000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa3dc14fd40 con 0x7fa3dc0b8760 2024-04-12T19:39:53.410 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.409+0000 7fa3e3000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa3dc159900 con 0x7fa3dc158c00 2024-04-12T19:39:53.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.410+0000 7fa3dbe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3dc158c00 0x7fa3dc158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:53.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.410+0000 7fa3dbe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3dc158c00 0x7fa3dc158fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:51276/0 (socket says 172.21.15.131:51276) 2024-04-12T19:39:53.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.410+0000 7fa3dbe00640 1 -- 172.21.15.131:0/708957539 learned_addr learned my addr 172.21.15.131:0/708957539 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:53.411 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.410+0000 7fa3e1000640 1 --2- 172.21.15.131:0/708957539 >> v2:172.21.15.171:3300/0 conn(0x7fa3dc0b8760 0x7fa3dc15ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:53.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.411+0000 7fa3dbe00640 1 -- 172.21.15.131:0/708957539 >> v2:172.21.15.171:3300/0 conn(0x7fa3dc0b8760 msgr2=0x7fa3dc15ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T19:39:53.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.411+0000 7fa3dbe00640 1 --2- 172.21.15.131:0/708957539 >> v2:172.21.15.171:3300/0 conn(0x7fa3dc0b8760 0x7fa3dc15ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:53.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.411+0000 7fa3dbe00640 1 -- 172.21.15.131:0/708957539 >> v1:172.21.15.171:6789/0 conn(0x7fa3dc0a4cd0 legacy=0x7fa3dc0b8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:53.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.411+0000 7fa3dbe00640 1 -- 172.21.15.131:0/708957539 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc0b8e40 con 0x7fa3dc158c00 2024-04-12T19:39:53.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.412+0000 7fa3dbe00640 1 --2- 172.21.15.131:0/708957539 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3dc158c00 0x7fa3dc158fe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009e50 tx=0x7fa3d402bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=895d867610d9988e server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:53.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.412+0000 7fa3daa00640 1 -- 172.21.15.131:0/708957539 <== mon.2 v2:172.21.15.171:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d402cb00 con 0x7fa3dc158c00 2024-04-12T19:39:53.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.412+0000 7fa3daa00640 1 -- 172.21.15.131:0/708957539 <== mon.2 v2:172.21.15.171:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d402cca0 con 0x7fa3dc158c00 2024-04-12T19:39:53.413 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.412+0000 7fa3daa00640 1 -- 172.21.15.131:0/708957539 <== mon.2 v2:172.21.15.171:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4034610 con 0x7fa3dc158c00 2024-04-12T19:39:53.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.413+0000 7fa3e3000640 1 -- 172.21.15.131:0/708957539 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3dc158c00 msgr2=0x7fa3dc158fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:53.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.413+0000 7fa3e3000640 1 --2- 172.21.15.131:0/708957539 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3dc158c00 0x7fa3dc158fe0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009e50 tx=0x7fa3d402bf60 comp rx=0 tx=0).stop 2024-04-12T19:39:53.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.413+0000 7fa3e3000640 1 -- 172.21.15.131:0/708957539 shutdown_connections 2024-04-12T19:39:53.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.413+0000 7fa3e3000640 1 --2- 172.21.15.131:0/708957539 >> v2:172.21.15.171:3300/0 conn(0x7fa3dc0b8760 0x7fa3dc15ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:53.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.413+0000 7fa3e3000640 1 --2- 172.21.15.131:0/708957539 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3dc158c00 0x7fa3dc158fe0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:53.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.413+0000 7fa3e3000640 1 -- 172.21.15.131:0/708957539 >> 172.21.15.131:0/708957539 conn(0x7fa3dc0c2590 msgr2=0x7fa3dc0c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:53.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.413+0000 7fa3e3000640 1 -- 172.21.15.131:0/708957539 shutdown_connections 2024-04-12T19:39:53.415 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.413+0000 7fa3e3000640 1 -- 172.21.15.131:0/708957539 wait complete. 2024-04-12T19:39:53.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.415+0000 7fa3e3000640 1 Processor -- start 2024-04-12T19:39:53.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.415+0000 7fa3e3000640 1 -- start start 2024-04-12T19:39:53.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3e3000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3dc0a4cd0 0x7fa3dc157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:53.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3e3000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3dc0b8760 0x7fa3dc0bc0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:53.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3e3000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3dc158c00 0x7fa3dc1eeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:53.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3e3000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc0becf0 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3e3000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa3dc073e80 con 0x7fa3dc158c00 2024-04-12T19:39:53.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3e3000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa3dc0bee70 con 0x7fa3dc0b8760 2024-04-12T19:39:53.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3dbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3dc0a4cd0 0x7fa3dc157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:53.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3dbe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3dc0a4cd0 0x7fa3dc157a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:46966/0 (socket says 172.21.15.131:46966) 2024-04-12T19:39:53.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3dbe00640 1 -- 172.21.15.131:0/2410850212 learned_addr learned my addr 172.21.15.131:0/2410850212 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T19:39:53.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3db400640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3dc0b8760 0x7fa3dc0bc0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:53.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3e1000640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3dc158c00 0x7fa3dc1eeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:53.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3dbe00640 1 -- 172.21.15.131:0/2410850212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3dc0b8760 msgr2=0x7fa3dc0bc0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:53.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3dbe00640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3dc0b8760 0x7fa3dc0bc0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:53.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3dbe00640 1 -- 172.21.15.131:0/2410850212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3dc158c00 msgr2=0x7fa3dc1eeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:53.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.417+0000 7fa3dbe00640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3dc158c00 0x7fa3dc1eeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:53.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.418+0000 7fa3dbe00640 1 -- 172.21.15.131:0/2410850212 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc157fd0 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.418+0000 7fa3dbe00640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3dc0a4cd0 0x7fa3dc157a90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009e50 tx=0x7fa3d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:53.420 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.418+0000 7fa3d3e00640 1 -- 172.21.15.131:0/2410850212 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4043020 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.418+0000 7fa3d3e00640 1 -- 172.21.15.131:0/2410850212 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3d402ce50 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.418+0000 7fa3d3e00640 1 -- 172.21.15.131:0/2410850212 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3d4009510 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.418+0000 7fa3e3000640 1 -- 172.21.15.131:0/2410850212 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3dc1eb4f0 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.418+0000 7fa3e3000640 1 -- 172.21.15.131:0/2410850212 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3dc1eba50 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.419+0000 7fa3e3000640 1 -- 172.21.15.131:0/2410850212 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3dc0bffa0 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.420+0000 7fa3d3e00640 1 -- 172.21.15.131:0/2410850212 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa3d4046020 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.421+0000 7fa3d3e00640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa3b806c8f0 0x7fa3b806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T19:39:53.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.421+0000 7fa3d3e00640 1 -- 172.21.15.131:0/2410850212 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6532+0+0 (secure 0 0 0) 0x7fa3d40ae4f0 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.421+0000 7fa3db400640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa3b806c8f0 0x7fa3b806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T19:39:53.423 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.422+0000 7fa3db400640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa3b806c8f0 0x7fa3b806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc068d70 tx=0x7fa3c4009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T19:39:53.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.425+0000 7fa3d3e00640 1 -- 172.21.15.131:0/2410850212 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa3dc0bffa0 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.668+0000 7fa3e3000640 1 -- 172.21.15.131:0/2410850212 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fa3dc14c050 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.669+0000 7fa3d3e00640 1 -- 172.21.15.131:0/2410850212 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) ==== 53+0+88 (secure 0 0 0) 0x7fa3d404d030 con 0x7fa3dc0a4cd0 2024-04-12T19:39:53.670 INFO:teuthology.orchestra.run.smithi131.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-12T19:39:53.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.672+0000 7fa3e3000640 1 -- 172.21.15.131:0/2410850212 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa3b806c8f0 msgr2=0x7fa3b806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:53.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.672+0000 7fa3e3000640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa3b806c8f0 0x7fa3b806edb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc068d70 tx=0x7fa3c4009040 comp rx=0 tx=0).stop 2024-04-12T19:39:53.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.672+0000 7fa3e3000640 1 -- 172.21.15.131:0/2410850212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3dc0a4cd0 msgr2=0x7fa3dc157a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T19:39:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.672+0000 7fa3e3000640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3dc0a4cd0 0x7fa3dc157a90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fa3d4009e50 tx=0x7fa3d4004a40 comp rx=0 tx=0).stop 2024-04-12T19:39:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.672+0000 7fa3e3000640 1 -- 172.21.15.131:0/2410850212 shutdown_connections 2024-04-12T19:39:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.672+0000 7fa3e3000640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa3b806c8f0 0x7fa3b806edb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.672+0000 7fa3e3000640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa3dc158c00 0x7fa3dc1eeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.672+0000 7fa3e3000640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa3dc0b8760 0x7fa3dc0bc0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.672+0000 7fa3e3000640 1 --2- 172.21.15.131:0/2410850212 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa3dc0a4cd0 0x7fa3dc157a90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T19:39:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.672+0000 7fa3e3000640 1 -- 172.21.15.131:0/2410850212 >> 172.21.15.131:0/2410850212 conn(0x7fa3dc0c2590 msgr2=0x7fa3dc14f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T19:39:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.672+0000 7fa3e3000640 1 -- 172.21.15.131:0/2410850212 shutdown_connections 2024-04-12T19:39:53.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53.672+0000 7fa3e3000640 1 -- 172.21.15.131:0/2410850212 wait complete. 2024-04-12T19:39:53.693 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-12T19:39:53.693 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-12T19:39:53.693 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-04-12T19:39:53.693 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-12T19:39:53.693 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-12T19:39:53.693 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-12T19:39:53.693 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-12T19:39:53.693 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-12T19:39:53.693 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-12T19:39:53.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:53.694 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-12T19:39:53.745 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-04-12T19:39:53.746 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-12T19:39:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-04-12T19:39:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-04-12T19:39:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42468sec preferred_lft 42468sec 2024-04-12T19:39:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link 2024-04-12T19:39:53.746 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-04-12T19:39:53.746 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-12T19:39:53.746 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T19:39:53.746 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-12T19:39:53.746 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add name ceph-brx type bridge 2024-04-12T19:39:53.746 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr flush dev ceph-brx 2024-04-12T19:39:53.747 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set ceph-brx up 2024-04-12T19:39:53.747 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-12T19:39:53.747 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-12T19:39:53.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:53 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T19:39:54.014 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:54.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:54.025 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-12T19:39:54.096 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-04-12T19:39:54.100 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:54.100 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-04-12T19:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-04-12T19:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-12T19:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-12T19:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-12T19:39:54.151 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-12T19:39:54.152 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T19:39:54.152 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-12T19:39:54.152 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-12T19:39:54.152 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-12T19:39:54.152 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-12T19:39:54.152 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-12T19:39:54.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T19:39:54.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:54.400 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:54.400 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-04-12T19:39:54.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:54.450 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-04-12T19:39:54.502 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T19:39:54.502 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-12T19:39:54.502 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T19:39:54.502 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-12T19:39:54.502 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-12T19:39:54.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T19:39:54.701 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:54.711 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-12T19:39:54.711 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T19:39:54.711 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-12T19:39:54.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-12T19:39:54.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-12T19:39:54.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-12T19:39:54.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-12T19:39:54.711 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-12T19:39:54.711 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-12T19:39:54.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T19:39:55.013 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:55.022 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-12T19:39:55.022 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-04-12T19:39:55.022 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2024-04-12T19:39:55.022 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.0 master ceph-brx 2024-04-12T19:39:55.022 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-04-12T19:39:55.115 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-12T19:39:55.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:55.241 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-12T19:39:55.241 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-12T19:39:55.242 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-12T19:39:55.290 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-12T19:39:55.290 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-12T19:39:55.290 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-12T19:39:55.337 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-04-12T19:39:55.477 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T19:39:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-04-12T19:39:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-04-12T19:39:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-04-12T19:39:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-04-12T19:39:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-04-12T19:39:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-04-12T19:39:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-04-12T19:39:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-04-12T19:39:55.532 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/selinux 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-04-12T19:39:55.533 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-04-12T19:39:55.534 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-0 2024-04-12T19:39:55.534 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-1 2024-04-12T19:39:55.534 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-2 2024-04-12T19:39:55.534 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-3 2024-04-12T19:39:55.534 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-04-12T19:39:55.534 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T19:39:55.534 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T19:39:55.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:55.535 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-04-12T19:39:55.581 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-12T19:39:55.582 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-12T19:39:55.630 DEBUG:teuthology.orchestra.run.smithi131:> sudo modprobe fuse 2024-04-12T19:39:55.710 DEBUG:teuthology.orchestra.run.smithi131:> cat /proc/self/mounts | awk '{print $2}' 2024-04-12T19:39:55.750 INFO:teuthology.orchestra.run.smithi131.stdout:/proc 2024-04-12T19:39:55.750 INFO:teuthology.orchestra.run.smithi131.stdout:/sys 2024-04-12T19:39:55.750 INFO:teuthology.orchestra.run.smithi131.stdout:/dev 2024-04-12T19:39:55.750 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/security 2024-04-12T19:39:55.750 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/shm 2024-04-12T19:39:55.750 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/pts 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/run 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/cgroup 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/pstore 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/bpf 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/ 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/selinux 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/proc/sys/fs/binfmt_misc 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/hugepages 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/dev/mqueue 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/debug 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/tracing 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/fs/fuse/connections 2024-04-12T19:39:55.751 INFO:teuthology.orchestra.run.smithi131.stdout:/sys/kernel/config 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-sysctl.service 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/nfs/rpc_pipefs 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/run/user/1000 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-0 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-1 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-2 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/var/lib/ceph/osd/ceph-3 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T19:39:55.752 INFO:teuthology.orchestra.run.smithi131.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-12T19:39:55.753 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:55.753 DEBUG:teuthology.orchestra.run.smithi131:> ls /sys/fs/fuse/connections 2024-04-12T19:39:55.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi131.stderr:2024-04-12T19:39:55.818+0000 7f4b2fc3b480 -1 init, newargv = 0x557c7fa13880 newargc=15 2024-04-12T19:39:55.819 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi131.stderr:ceph-fuse[45582]: starting ceph client 2024-04-12T19:39:55.832 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi131.stderr:ceph-fuse[45582]: starting fuse 2024-04-12T19:39:55.840 INFO:teuthology.orchestra.run.smithi131.stdout:43 2024-04-12T19:39:55.840 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [43] 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> sudo stdin-killer -- python3 -c ' 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> import glob 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> import re 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> import os 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> import subprocess 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> def _find_admin_socket(client_name): 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> files = glob.glob(asok_path) 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> # Given a non-glob path, it better be there 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> if "*" not in asok_path: 2024-04-12T19:39:55.841 DEBUG:teuthology.orchestra.run.smithi131:> assert(len(files) == 1) 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> return files[0] 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> for f in files: 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> contents = proc_f.read() 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> if mountpoint in contents: 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> return f 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> print(_find_admin_socket("client.0")) 2024-04-12T19:39:55.842 DEBUG:teuthology.orchestra.run.smithi131:> ' 2024-04-12T19:39:56.044 INFO:teuthology.orchestra.run.smithi131.stdout:/var/run/ceph/ceph-client.0.45582.asok 2024-04-12T19:39:56.048 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T19:39:56 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-12T19:39:56.061 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45582.asok 2024-04-12T19:39:56.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:56.062 DEBUG:teuthology.orchestra.run.smithi131:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45582.asok status 2024-04-12T19:39:56.299 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-04-12T19:39:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: "metadata": { 2024-04-12T19:39:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_sha1": "324baf8ddb91dea46cac50cb535c306115791355", 2024-04-12T19:39:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev)", 2024-04-12T19:39:56.299 INFO:teuthology.orchestra.run.smithi131.stdout: "entity_id": "0", 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: "hostname": "smithi131", 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: "pid": "45582", 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: "root": "/" 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_count": 0, 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: "dentry_pinned_count": 0, 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: "id": 4827, 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: "inst": { 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: "name": { 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "client", 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: "num": 4827 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-12T19:39:56.300 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 2728202354 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: } 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": { 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: "type": "v1", 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: "addr": "192.168.0.1:0", 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: "nonce": 2728202354 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: }, 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: "inst_str": "client.4827 192.168.0.1:0/2728202354", 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: "addr_str": "192.168.0.1:0/2728202354", 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: "inode_count": 1, 2024-04-12T19:39:56.301 INFO:teuthology.orchestra.run.smithi131.stdout: "mds_epoch": 8, 2024-04-12T19:39:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch": 26, 2024-04-12T19:39:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: "osd_epoch_barrier": 0, 2024-04-12T19:39:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: "blocklisted": false, 2024-04-12T19:39:56.302 INFO:teuthology.orchestra.run.smithi131.stdout: "fs_name": "cephfs" 2024-04-12T19:39:56.302 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-04-12T19:39:56.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:56.315 DEBUG:teuthology.orchestra.run.smithi131:> stat --file-system '--printf=%T 2024-04-12T19:39:56.315 DEBUG:teuthology.orchestra.run.smithi131:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-12T19:39:56.368 INFO:teuthology.orchestra.run.smithi131.stdout:fuseblk 2024-04-12T19:39:56.368 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-12T19:39:56.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T19:39:56.368 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-12T19:39:56.463 INFO:teuthology.run_tasks:Running task workunit... 2024-04-12T19:39:56.475 INFO:tasks.workunit:Pulling workunits from ref 324baf8ddb91dea46cac50cb535c306115791355 2024-04-12T19:39:56.475 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-12T19:39:56.475 INFO:tasks.workunit:timeout=6h 2024-04-12T19:39:56.475 INFO:tasks.workunit:cleanup=True 2024-04-12T19:39:56.476 DEBUG:teuthology.orchestra.run.smithi131:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-12T19:39:56.532 INFO:teuthology.orchestra.run.smithi131.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-12T19:39:56.532 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-12T19:39:56.533 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 2bh/43d Inode: 1 Links: 2 2024-04-12T19:39:56.533 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-12T19:39:56.533 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-12T19:39:56.533 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-12T19:39:56.533 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-04-12 19:39:11.457370340 +0000 2024-04-12T19:39:56.533 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-04-12 19:39:23.738567665 +0000 2024-04-12T19:39:56.533 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: - 2024-04-12T19:39:56.533 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-12T19:39:56.533 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-12T19:39:56.637 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 324baf8ddb91dea46cac50cb535c306115791355 2024-04-12T19:39:56.690 INFO:tasks.workunit.client.0.smithi131.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-12T19:40:09.180 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:40:09.188 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:40:39.335 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:40:39.344 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:41:09.473 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:41:09.478 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:41:38.134 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 62% (7631/12271) Updating files: 63% (7731/12271) Updating files: 64% (7854/12271) Updating files: 65% (7977/12271) Updating files: 66% (8099/12271) Updating files: 67% (8222/12271) Updating files: 68% (8345/12271) Updating files: 69% (8467/12271) Updating files: 70% (8590/12271) Updating files: 71% (8713/12271) Updating files: 72% (8836/12271) Updating files: 73% (8958/12271) Updating files: 74% (9081/12271) Updating files: 75% (9204/12271) Updating files: 76% (9326/12271) Updating files: 77% (9449/12271) Updating files: 78% (9572/12271) Updating files: 79% (9695/12271) Updating files: 80% (9817/12271) Updating files: 81% (9940/12271) Updating files: 82% (10063/12271) Updating files: 83% (10185/12271) Updating files: 84% (10308/12271) Updating files: 85% (10431/12271) Updating files: 86% (10554/12271) Updating files: 87% (10676/12271) Updating files: 88% (10799/12271) Updating files: 89% (10922/12271) Updating files: 90% (11044/12271) Updating files: 91% (11167/12271) Updating files: 92% (11290/12271) Updating files: 93% (11413/12271) Updating files: 94% (11535/12271) Updating files: 95% (11658/12271) Updating files: 96% (11781/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-12T19:41:38.656 INFO:tasks.workunit.client.0.smithi131.stderr:Note: switching to '324baf8ddb91dea46cac50cb535c306115791355'. 2024-04-12T19:41:38.657 INFO:tasks.workunit.client.0.smithi131.stderr: 2024-04-12T19:41:38.657 INFO:tasks.workunit.client.0.smithi131.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-12T19:41:38.657 INFO:tasks.workunit.client.0.smithi131.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-12T19:41:38.657 INFO:tasks.workunit.client.0.smithi131.stderr:state without impacting any branches by switching back to a branch. 2024-04-12T19:41:38.657 INFO:tasks.workunit.client.0.smithi131.stderr: 2024-04-12T19:41:38.657 INFO:tasks.workunit.client.0.smithi131.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-12T19:41:38.657 INFO:tasks.workunit.client.0.smithi131.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-12T19:41:38.657 INFO:tasks.workunit.client.0.smithi131.stderr: 2024-04-12T19:41:38.657 INFO:tasks.workunit.client.0.smithi131.stderr: git switch -c 2024-04-12T19:41:38.657 INFO:tasks.workunit.client.0.smithi131.stderr: 2024-04-12T19:41:38.657 INFO:tasks.workunit.client.0.smithi131.stderr:Or undo this operation with: 2024-04-12T19:41:38.658 INFO:tasks.workunit.client.0.smithi131.stderr: 2024-04-12T19:41:38.658 INFO:tasks.workunit.client.0.smithi131.stderr: git switch - 2024-04-12T19:41:38.658 INFO:tasks.workunit.client.0.smithi131.stderr: 2024-04-12T19:41:38.658 INFO:tasks.workunit.client.0.smithi131.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-12T19:41:38.658 INFO:tasks.workunit.client.0.smithi131.stderr: 2024-04-12T19:41:38.658 INFO:tasks.workunit.client.0.smithi131.stderr:HEAD is now at 324baf8ddb9 Merge PR #55421 into wip-vshankar-testing-20240411.061452 2024-04-12T19:41:38.669 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-12T19:41:38.728 INFO:tasks.workunit.client.0.smithi131.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-12T19:41:38.735 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-12T19:41:38.735 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-12T19:41:39.582 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-12T19:41:39.605 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:41:39.611 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:41:39.694 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-12T19:41:39.790 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-12T19:41:39.796 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-12T19:41:39.796 INFO:tasks.workunit.client.0.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-12T19:41:39.879 INFO:tasks.workunit.client.0.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-12T19:41:39.889 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T19:41:39.889 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-12T19:41:39.939 INFO:tasks.workunit:Running workunits matching fs/snaps on client.0... 2024-04-12T19:41:39.940 INFO:tasks.workunit:Running workunit fs/snaps/snap-rm-diff.sh... 2024-04-12T19:41:39.941 DEBUG:teuthology.orchestra.run.smithi131:workunit test fs/snaps/snap-rm-diff.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=324baf8ddb91dea46cac50cb535c306115791355 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snap-rm-diff.sh 2024-04-12T19:41:40.084 INFO:tasks.workunit.client.0.smithi131.stderr:+ wget -q http://download.ceph.com/qa/linux-2.6.33.tar.bz2 2024-04-12T19:41:51.416 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir foo 2024-04-12T19:41:51.444 INFO:tasks.workunit.client.0.smithi131.stderr:+ cp linux-2.6.33.tar.bz2 foo 2024-04-12T19:41:54.124 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir foo/.snap/barsnap 2024-04-12T19:41:54.168 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm foo/linux-2.6.33.tar.bz2 2024-04-12T19:41:54.219 INFO:tasks.workunit.client.0.smithi131.stderr:+ diff -q foo/.snap/barsnap/linux-2.6.33.tar.bz2 linux-2.6.33.tar.bz2 2024-04-12T19:41:54.647 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo 'passed: files are identical' 2024-04-12T19:41:54.648 INFO:tasks.workunit.client.0.smithi131.stdout:passed: files are identical 2024-04-12T19:41:54.648 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir foo/.snap/barsnap 2024-04-12T19:41:54.689 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo OK 2024-04-12T19:41:54.689 INFO:tasks.workunit.client.0.smithi131.stdout:OK 2024-04-12T19:41:54.690 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-12T19:41:54.691 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-12T19:41:54.851 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-1.sh... 2024-04-12T19:41:54.852 DEBUG:teuthology.orchestra.run.smithi131:workunit test fs/snaps/snaptest-1.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=324baf8ddb91dea46cac50cb535c306115791355 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-1.sh 2024-04-12T19:41:54.943 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo 1 2024-04-12T19:41:54.950 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo 2 2024-04-12T19:41:54.957 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo 3 2024-04-12T19:41:54.963 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' -e file4 ']' 2024-04-12T19:41:54.964 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/snap1 2024-04-12T19:41:54.999 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo 4 2024-04-12T19:41:55.005 INFO:tasks.workunit.client.0.smithi131.stderr:++ ls 2024-04-12T19:41:55.024 INFO:tasks.workunit.client.0.smithi131.stderr:+ now='file1 2024-04-12T19:41:55.024 INFO:tasks.workunit.client.0.smithi131.stderr:file2 2024-04-12T19:41:55.024 INFO:tasks.workunit.client.0.smithi131.stderr:file3 2024-04-12T19:41:55.024 INFO:tasks.workunit.client.0.smithi131.stderr:file4' 2024-04-12T19:41:55.025 INFO:tasks.workunit.client.0.smithi131.stderr:++ ls .snap/snap1 2024-04-12T19:41:55.049 INFO:tasks.workunit.client.0.smithi131.stderr:+ then='file1 2024-04-12T19:41:55.050 INFO:tasks.workunit.client.0.smithi131.stderr:file2 2024-04-12T19:41:55.050 INFO:tasks.workunit.client.0.smithi131.stderr:file3' 2024-04-12T19:41:55.050 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir .snap/snap1 2024-04-12T19:41:55.076 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 'file1 2024-04-12T19:41:55.077 INFO:tasks.workunit.client.0.smithi131.stderr:file2 2024-04-12T19:41:55.077 INFO:tasks.workunit.client.0.smithi131.stderr:file3 2024-04-12T19:41:55.077 INFO:tasks.workunit.client.0.smithi131.stderr:file4' = 'file1 2024-04-12T19:41:55.077 INFO:tasks.workunit.client.0.smithi131.stderr:file2 2024-04-12T19:41:55.077 INFO:tasks.workunit.client.0.smithi131.stderr:file3' ']' 2024-04-12T19:41:55.077 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo 1 2024-04-12T19:41:55.094 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo 2 2024-04-12T19:41:55.116 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo 3 2024-04-12T19:41:55.136 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/snap1 2024-04-12T19:41:55.162 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo 4 2024-04-12T19:41:55.183 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir .snap/snap1 2024-04-12T19:41:55.216 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm file1 file2 file3 file4 2024-04-12T19:41:55.252 INFO:tasks.workunit.client.0.smithi131.stdout:OK 2024-04-12T19:41:55.252 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo OK 2024-04-12T19:41:55.254 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-12T19:41:55.254 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-12T19:41:55.381 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-2.sh... 2024-04-12T19:41:55.381 DEBUG:teuthology.orchestra.run.smithi131:workunit test fs/snaps/snaptest-2.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=324baf8ddb91dea46cac50cb535c306115791355 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-2.sh 2024-04-12T19:41:55.481 INFO:tasks.workunit.client.0.smithi131.stdout:Create dir 100 to 199 ... 2024-04-12T19:41:55.499 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 100 2024-04-12T19:41:55.591 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 101 2024-04-12T19:41:55.676 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 102 2024-04-12T19:41:55.754 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 103 2024-04-12T19:41:55.836 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 104 2024-04-12T19:41:55.916 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 105 2024-04-12T19:41:56.004 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 106 2024-04-12T19:41:56.089 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 107 2024-04-12T19:41:56.180 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 108 2024-04-12T19:41:56.259 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 109 2024-04-12T19:41:56.343 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 110 2024-04-12T19:41:56.433 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 111 2024-04-12T19:41:56.522 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 112 2024-04-12T19:41:56.601 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 113 2024-04-12T19:41:56.682 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 114 2024-04-12T19:41:56.773 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 115 2024-04-12T19:41:56.823 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 116 2024-04-12T19:41:56.862 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 117 2024-04-12T19:41:56.904 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 118 2024-04-12T19:41:56.948 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 119 2024-04-12T19:41:56.992 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 120 2024-04-12T19:41:57.038 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 121 2024-04-12T19:41:57.088 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 122 2024-04-12T19:41:57.142 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 123 2024-04-12T19:41:57.197 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 124 2024-04-12T19:41:57.258 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 125 2024-04-12T19:41:57.325 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 126 2024-04-12T19:41:57.400 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 127 2024-04-12T19:41:57.483 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 128 2024-04-12T19:41:57.568 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 129 2024-04-12T19:41:57.650 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 130 2024-04-12T19:41:57.735 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 131 2024-04-12T19:41:57.796 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 132 2024-04-12T19:41:57.854 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 133 2024-04-12T19:41:57.917 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 134 2024-04-12T19:41:57.991 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 135 2024-04-12T19:41:58.065 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 136 2024-04-12T19:41:58.146 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 137 2024-04-12T19:41:58.229 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 138 2024-04-12T19:41:58.312 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 139 2024-04-12T19:41:58.397 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 140 2024-04-12T19:41:58.478 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 141 2024-04-12T19:41:58.565 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 142 2024-04-12T19:41:58.650 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 143 2024-04-12T19:41:58.738 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 144 2024-04-12T19:41:58.825 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 145 2024-04-12T19:41:58.900 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 146 2024-04-12T19:41:58.971 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 147 2024-04-12T19:41:59.045 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 148 2024-04-12T19:41:59.125 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 149 2024-04-12T19:41:59.206 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 150 2024-04-12T19:41:59.285 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 151 2024-04-12T19:41:59.349 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 152 2024-04-12T19:41:59.399 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 153 2024-04-12T19:41:59.444 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 154 2024-04-12T19:41:59.489 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 155 2024-04-12T19:41:59.589 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 156 2024-04-12T19:41:59.644 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 157 2024-04-12T19:41:59.697 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 158 2024-04-12T19:41:59.755 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 159 2024-04-12T19:41:59.815 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 160 2024-04-12T19:41:59.871 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 161 2024-04-12T19:41:59.944 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 162 2024-04-12T19:42:00.027 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 163 2024-04-12T19:42:00.093 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 164 2024-04-12T19:42:00.132 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 165 2024-04-12T19:42:00.170 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 166 2024-04-12T19:42:00.210 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 167 2024-04-12T19:42:00.252 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 168 2024-04-12T19:42:00.295 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 169 2024-04-12T19:42:00.347 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 170 2024-04-12T19:42:00.398 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 171 2024-04-12T19:42:00.460 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 172 2024-04-12T19:42:00.527 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 173 2024-04-12T19:42:00.593 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 174 2024-04-12T19:42:00.666 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 175 2024-04-12T19:42:00.750 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 176 2024-04-12T19:42:00.838 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 177 2024-04-12T19:42:00.966 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 178 2024-04-12T19:42:01.057 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 179 2024-04-12T19:42:01.146 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 180 2024-04-12T19:42:01.234 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 181 2024-04-12T19:42:01.317 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 182 2024-04-12T19:42:01.402 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 183 2024-04-12T19:42:01.485 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 184 2024-04-12T19:42:01.572 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 185 2024-04-12T19:42:01.656 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 186 2024-04-12T19:42:01.746 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 187 2024-04-12T19:42:01.831 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 188 2024-04-12T19:42:01.918 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 189 2024-04-12T19:42:02.080 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 190 2024-04-12T19:42:02.174 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 191 2024-04-12T19:42:02.268 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 192 2024-04-12T19:42:02.361 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 193 2024-04-12T19:42:02.450 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 194 2024-04-12T19:42:02.546 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 195 2024-04-12T19:42:02.640 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 196 2024-04-12T19:42:02.730 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 197 2024-04-12T19:42:02.819 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 198 2024-04-12T19:42:02.912 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 199 2024-04-12T19:42:03.126 INFO:tasks.workunit.client.0.smithi131.stdout:Take first snapshot .snap/test1 2024-04-12T19:42:03.564 INFO:tasks.workunit.client.0.smithi131.stdout:Create dir 200 to 299 ... 2024-04-12T19:42:03.568 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 200 2024-04-12T19:42:04.233 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 201 2024-04-12T19:42:04.319 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 202 2024-04-12T19:42:04.481 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 203 2024-04-12T19:42:04.563 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 204 2024-04-12T19:42:04.652 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 205 2024-04-12T19:42:04.729 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 206 2024-04-12T19:42:04.806 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 207 2024-04-12T19:42:04.883 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 208 2024-04-12T19:42:04.961 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 209 2024-04-12T19:42:05.140 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 210 2024-04-12T19:42:05.223 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 211 2024-04-12T19:42:05.311 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 212 2024-04-12T19:42:05.392 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 213 2024-04-12T19:42:05.474 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 214 2024-04-12T19:42:05.556 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 215 2024-04-12T19:42:05.639 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 216 2024-04-12T19:42:05.718 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 217 2024-04-12T19:42:05.800 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 218 2024-04-12T19:42:05.884 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 219 2024-04-12T19:42:05.968 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 220 2024-04-12T19:42:06.142 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 221 2024-04-12T19:42:06.227 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 222 2024-04-12T19:42:06.308 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 223 2024-04-12T19:42:06.388 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 224 2024-04-12T19:42:06.468 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 225 2024-04-12T19:42:06.544 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 226 2024-04-12T19:42:06.621 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 227 2024-04-12T19:42:06.669 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 228 2024-04-12T19:42:06.709 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 229 2024-04-12T19:42:06.752 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 230 2024-04-12T19:42:06.800 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 231 2024-04-12T19:42:06.855 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 232 2024-04-12T19:42:06.921 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 233 2024-04-12T19:42:06.995 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 234 2024-04-12T19:42:07.143 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 235 2024-04-12T19:42:07.229 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 236 2024-04-12T19:42:07.311 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 237 2024-04-12T19:42:07.392 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 238 2024-04-12T19:42:07.477 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 239 2024-04-12T19:42:07.551 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 240 2024-04-12T19:42:07.628 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 241 2024-04-12T19:42:07.706 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 242 2024-04-12T19:42:07.786 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 243 2024-04-12T19:42:07.873 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 244 2024-04-12T19:42:07.954 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 245 2024-04-12T19:42:08.115 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 246 2024-04-12T19:42:08.193 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 247 2024-04-12T19:42:08.280 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 248 2024-04-12T19:42:08.360 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 249 2024-04-12T19:42:08.449 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 250 2024-04-12T19:42:08.524 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 251 2024-04-12T19:42:08.593 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 252 2024-04-12T19:42:08.646 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 253 2024-04-12T19:42:08.692 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 254 2024-04-12T19:42:08.738 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 255 2024-04-12T19:42:08.783 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 256 2024-04-12T19:42:08.829 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 257 2024-04-12T19:42:08.876 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 258 2024-04-12T19:42:08.918 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 259 2024-04-12T19:42:08.959 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 260 2024-04-12T19:42:09.002 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 261 2024-04-12T19:42:09.061 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 262 2024-04-12T19:42:09.123 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 263 2024-04-12T19:42:09.190 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 264 2024-04-12T19:42:09.262 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 265 2024-04-12T19:42:09.333 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 266 2024-04-12T19:42:09.396 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 267 2024-04-12T19:42:09.447 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 268 2024-04-12T19:42:09.500 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 269 2024-04-12T19:42:09.563 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 270 2024-04-12T19:42:09.622 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 271 2024-04-12T19:42:09.696 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 272 2024-04-12T19:42:09.773 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 273 2024-04-12T19:42:09.827 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:42:09.836 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:42:09.851 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 274 2024-04-12T19:42:09.895 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 275 2024-04-12T19:42:09.939 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 276 2024-04-12T19:42:09.982 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 277 2024-04-12T19:42:10.036 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 278 2024-04-12T19:42:10.165 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 279 2024-04-12T19:42:10.228 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 280 2024-04-12T19:42:10.288 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 281 2024-04-12T19:42:10.342 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 282 2024-04-12T19:42:10.395 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 283 2024-04-12T19:42:10.450 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 284 2024-04-12T19:42:10.507 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 285 2024-04-12T19:42:10.557 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 286 2024-04-12T19:42:10.610 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 287 2024-04-12T19:42:10.665 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 288 2024-04-12T19:42:10.733 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 289 2024-04-12T19:42:10.805 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 290 2024-04-12T19:42:10.870 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 291 2024-04-12T19:42:10.932 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 292 2024-04-12T19:42:11.001 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 293 2024-04-12T19:42:11.139 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 294 2024-04-12T19:42:11.226 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 295 2024-04-12T19:42:11.312 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 296 2024-04-12T19:42:11.397 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 297 2024-04-12T19:42:11.470 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 298 2024-04-12T19:42:11.553 INFO:tasks.workunit.client.0.smithi131.stdout: create dir 299 2024-04-12T19:42:11.635 INFO:tasks.workunit.client.0.smithi131.stdout:Create a snapshot in every first level dir ... 2024-04-12T19:42:12.041 INFO:tasks.workunit.client.0.smithi131.stdout: create 100/.snap/snap-subdir-test 2024-04-12T19:42:12.103 INFO:tasks.workunit.client.0.smithi131.stdout: create 100/30 file after the snapshot 2024-04-12T19:42:12.170 INFO:tasks.workunit.client.0.smithi131.stdout: create 100/31 file after the snapshot 2024-04-12T19:42:12.177 INFO:tasks.workunit.client.0.smithi131.stdout: create 100/32 file after the snapshot 2024-04-12T19:42:12.185 INFO:tasks.workunit.client.0.smithi131.stdout: create 100/33 file after the snapshot 2024-04-12T19:42:12.193 INFO:tasks.workunit.client.0.smithi131.stdout: create 100/34 file after the snapshot 2024-04-12T19:42:12.200 INFO:tasks.workunit.client.0.smithi131.stdout: create 100/35 file after the snapshot 2024-04-12T19:42:12.208 INFO:tasks.workunit.client.0.smithi131.stdout: create 100/36 file after the snapshot 2024-04-12T19:42:12.216 INFO:tasks.workunit.client.0.smithi131.stdout: create 100/37 file after the snapshot 2024-04-12T19:42:12.223 INFO:tasks.workunit.client.0.smithi131.stdout: create 100/38 file after the snapshot 2024-04-12T19:42:12.230 INFO:tasks.workunit.client.0.smithi131.stdout: create 100/39 file after the snapshot 2024-04-12T19:42:12.238 INFO:tasks.workunit.client.0.smithi131.stdout: create 101/.snap/snap-subdir-test 2024-04-12T19:42:12.329 INFO:tasks.workunit.client.0.smithi131.stdout: create 101/30 file after the snapshot 2024-04-12T19:42:12.334 INFO:tasks.workunit.client.0.smithi131.stdout: create 101/31 file after the snapshot 2024-04-12T19:42:12.342 INFO:tasks.workunit.client.0.smithi131.stdout: create 101/32 file after the snapshot 2024-04-12T19:42:12.349 INFO:tasks.workunit.client.0.smithi131.stdout: create 101/33 file after the snapshot 2024-04-12T19:42:12.356 INFO:tasks.workunit.client.0.smithi131.stdout: create 101/34 file after the snapshot 2024-04-12T19:42:12.364 INFO:tasks.workunit.client.0.smithi131.stdout: create 101/35 file after the snapshot 2024-04-12T19:42:12.372 INFO:tasks.workunit.client.0.smithi131.stdout: create 101/36 file after the snapshot 2024-04-12T19:42:12.380 INFO:tasks.workunit.client.0.smithi131.stdout: create 101/37 file after the snapshot 2024-04-12T19:42:12.388 INFO:tasks.workunit.client.0.smithi131.stdout: create 101/38 file after the snapshot 2024-04-12T19:42:12.396 INFO:tasks.workunit.client.0.smithi131.stdout: create 101/39 file after the snapshot 2024-04-12T19:42:12.405 INFO:tasks.workunit.client.0.smithi131.stdout: create 102/.snap/snap-subdir-test 2024-04-12T19:42:12.448 INFO:tasks.workunit.client.0.smithi131.stdout: create 102/30 file after the snapshot 2024-04-12T19:42:12.453 INFO:tasks.workunit.client.0.smithi131.stdout: create 102/31 file after the snapshot 2024-04-12T19:42:12.461 INFO:tasks.workunit.client.0.smithi131.stdout: create 102/32 file after the snapshot 2024-04-12T19:42:12.469 INFO:tasks.workunit.client.0.smithi131.stdout: create 102/33 file after the snapshot 2024-04-12T19:42:12.477 INFO:tasks.workunit.client.0.smithi131.stdout: create 102/34 file after the snapshot 2024-04-12T19:42:12.485 INFO:tasks.workunit.client.0.smithi131.stdout: create 102/35 file after the snapshot 2024-04-12T19:42:12.493 INFO:tasks.workunit.client.0.smithi131.stdout: create 102/36 file after the snapshot 2024-04-12T19:42:12.500 INFO:tasks.workunit.client.0.smithi131.stdout: create 102/37 file after the snapshot 2024-04-12T19:42:12.507 INFO:tasks.workunit.client.0.smithi131.stdout: create 102/38 file after the snapshot 2024-04-12T19:42:12.514 INFO:tasks.workunit.client.0.smithi131.stdout: create 102/39 file after the snapshot 2024-04-12T19:42:12.522 INFO:tasks.workunit.client.0.smithi131.stdout: create 103/.snap/snap-subdir-test 2024-04-12T19:42:12.562 INFO:tasks.workunit.client.0.smithi131.stdout: create 103/30 file after the snapshot 2024-04-12T19:42:12.568 INFO:tasks.workunit.client.0.smithi131.stdout: create 103/31 file after the snapshot 2024-04-12T19:42:12.575 INFO:tasks.workunit.client.0.smithi131.stdout: create 103/32 file after the snapshot 2024-04-12T19:42:12.582 INFO:tasks.workunit.client.0.smithi131.stdout: create 103/33 file after the snapshot 2024-04-12T19:42:12.589 INFO:tasks.workunit.client.0.smithi131.stdout: create 103/34 file after the snapshot 2024-04-12T19:42:12.597 INFO:tasks.workunit.client.0.smithi131.stdout: create 103/35 file after the snapshot 2024-04-12T19:42:12.604 INFO:tasks.workunit.client.0.smithi131.stdout: create 103/36 file after the snapshot 2024-04-12T19:42:12.613 INFO:tasks.workunit.client.0.smithi131.stdout: create 103/37 file after the snapshot 2024-04-12T19:42:12.620 INFO:tasks.workunit.client.0.smithi131.stdout: create 103/38 file after the snapshot 2024-04-12T19:42:12.628 INFO:tasks.workunit.client.0.smithi131.stdout: create 103/39 file after the snapshot 2024-04-12T19:42:12.638 INFO:tasks.workunit.client.0.smithi131.stdout: create 104/.snap/snap-subdir-test 2024-04-12T19:42:12.673 INFO:tasks.workunit.client.0.smithi131.stdout: create 104/30 file after the snapshot 2024-04-12T19:42:12.679 INFO:tasks.workunit.client.0.smithi131.stdout: create 104/31 file after the snapshot 2024-04-12T19:42:12.685 INFO:tasks.workunit.client.0.smithi131.stdout: create 104/32 file after the snapshot 2024-04-12T19:42:12.692 INFO:tasks.workunit.client.0.smithi131.stdout: create 104/33 file after the snapshot 2024-04-12T19:42:12.700 INFO:tasks.workunit.client.0.smithi131.stdout: create 104/34 file after the snapshot 2024-04-12T19:42:12.707 INFO:tasks.workunit.client.0.smithi131.stdout: create 104/35 file after the snapshot 2024-04-12T19:42:12.714 INFO:tasks.workunit.client.0.smithi131.stdout: create 104/36 file after the snapshot 2024-04-12T19:42:12.722 INFO:tasks.workunit.client.0.smithi131.stdout: create 104/37 file after the snapshot 2024-04-12T19:42:12.729 INFO:tasks.workunit.client.0.smithi131.stdout: create 104/38 file after the snapshot 2024-04-12T19:42:12.737 INFO:tasks.workunit.client.0.smithi131.stdout: create 104/39 file after the snapshot 2024-04-12T19:42:12.745 INFO:tasks.workunit.client.0.smithi131.stdout: create 105/.snap/snap-subdir-test 2024-04-12T19:42:12.782 INFO:tasks.workunit.client.0.smithi131.stdout: create 105/30 file after the snapshot 2024-04-12T19:42:12.786 INFO:tasks.workunit.client.0.smithi131.stdout: create 105/31 file after the snapshot 2024-04-12T19:42:12.794 INFO:tasks.workunit.client.0.smithi131.stdout: create 105/32 file after the snapshot 2024-04-12T19:42:12.800 INFO:tasks.workunit.client.0.smithi131.stdout: create 105/33 file after the snapshot 2024-04-12T19:42:12.807 INFO:tasks.workunit.client.0.smithi131.stdout: create 105/34 file after the snapshot 2024-04-12T19:42:12.814 INFO:tasks.workunit.client.0.smithi131.stdout: create 105/35 file after the snapshot 2024-04-12T19:42:12.821 INFO:tasks.workunit.client.0.smithi131.stdout: create 105/36 file after the snapshot 2024-04-12T19:42:12.830 INFO:tasks.workunit.client.0.smithi131.stdout: create 105/37 file after the snapshot 2024-04-12T19:42:12.838 INFO:tasks.workunit.client.0.smithi131.stdout: create 105/38 file after the snapshot 2024-04-12T19:42:12.845 INFO:tasks.workunit.client.0.smithi131.stdout: create 105/39 file after the snapshot 2024-04-12T19:42:12.853 INFO:tasks.workunit.client.0.smithi131.stdout: create 106/.snap/snap-subdir-test 2024-04-12T19:42:12.890 INFO:tasks.workunit.client.0.smithi131.stdout: create 106/30 file after the snapshot 2024-04-12T19:42:12.895 INFO:tasks.workunit.client.0.smithi131.stdout: create 106/31 file after the snapshot 2024-04-12T19:42:12.903 INFO:tasks.workunit.client.0.smithi131.stdout: create 106/32 file after the snapshot 2024-04-12T19:42:12.911 INFO:tasks.workunit.client.0.smithi131.stdout: create 106/33 file after the snapshot 2024-04-12T19:42:12.919 INFO:tasks.workunit.client.0.smithi131.stdout: create 106/34 file after the snapshot 2024-04-12T19:42:12.927 INFO:tasks.workunit.client.0.smithi131.stdout: create 106/35 file after the snapshot 2024-04-12T19:42:12.935 INFO:tasks.workunit.client.0.smithi131.stdout: create 106/36 file after the snapshot 2024-04-12T19:42:12.943 INFO:tasks.workunit.client.0.smithi131.stdout: create 106/37 file after the snapshot 2024-04-12T19:42:12.951 INFO:tasks.workunit.client.0.smithi131.stdout: create 106/38 file after the snapshot 2024-04-12T19:42:12.959 INFO:tasks.workunit.client.0.smithi131.stdout: create 106/39 file after the snapshot 2024-04-12T19:42:12.967 INFO:tasks.workunit.client.0.smithi131.stdout: create 107/.snap/snap-subdir-test 2024-04-12T19:42:13.005 INFO:tasks.workunit.client.0.smithi131.stdout: create 107/30 file after the snapshot 2024-04-12T19:42:13.011 INFO:tasks.workunit.client.0.smithi131.stdout: create 107/31 file after the snapshot 2024-04-12T19:42:13.018 INFO:tasks.workunit.client.0.smithi131.stdout: create 107/32 file after the snapshot 2024-04-12T19:42:13.026 INFO:tasks.workunit.client.0.smithi131.stdout: create 107/33 file after the snapshot 2024-04-12T19:42:13.034 INFO:tasks.workunit.client.0.smithi131.stdout: create 107/34 file after the snapshot 2024-04-12T19:42:13.042 INFO:tasks.workunit.client.0.smithi131.stdout: create 107/35 file after the snapshot 2024-04-12T19:42:13.050 INFO:tasks.workunit.client.0.smithi131.stdout: create 107/36 file after the snapshot 2024-04-12T19:42:13.059 INFO:tasks.workunit.client.0.smithi131.stdout: create 107/37 file after the snapshot 2024-04-12T19:42:13.078 INFO:tasks.workunit.client.0.smithi131.stdout: create 107/38 file after the snapshot 2024-04-12T19:42:13.141 INFO:tasks.workunit.client.0.smithi131.stdout: create 107/39 file after the snapshot 2024-04-12T19:42:13.149 INFO:tasks.workunit.client.0.smithi131.stdout: create 108/.snap/snap-subdir-test 2024-04-12T19:42:13.241 INFO:tasks.workunit.client.0.smithi131.stdout: create 108/30 file after the snapshot 2024-04-12T19:42:13.247 INFO:tasks.workunit.client.0.smithi131.stdout: create 108/31 file after the snapshot 2024-04-12T19:42:13.254 INFO:tasks.workunit.client.0.smithi131.stdout: create 108/32 file after the snapshot 2024-04-12T19:42:13.261 INFO:tasks.workunit.client.0.smithi131.stdout: create 108/33 file after the snapshot 2024-04-12T19:42:13.269 INFO:tasks.workunit.client.0.smithi131.stdout: create 108/34 file after the snapshot 2024-04-12T19:42:13.277 INFO:tasks.workunit.client.0.smithi131.stdout: create 108/35 file after the snapshot 2024-04-12T19:42:13.285 INFO:tasks.workunit.client.0.smithi131.stdout: create 108/36 file after the snapshot 2024-04-12T19:42:13.292 INFO:tasks.workunit.client.0.smithi131.stdout: create 108/37 file after the snapshot 2024-04-12T19:42:13.300 INFO:tasks.workunit.client.0.smithi131.stdout: create 108/38 file after the snapshot 2024-04-12T19:42:13.308 INFO:tasks.workunit.client.0.smithi131.stdout: create 108/39 file after the snapshot 2024-04-12T19:42:13.316 INFO:tasks.workunit.client.0.smithi131.stdout: create 109/.snap/snap-subdir-test 2024-04-12T19:42:13.356 INFO:tasks.workunit.client.0.smithi131.stdout: create 109/30 file after the snapshot 2024-04-12T19:42:13.362 INFO:tasks.workunit.client.0.smithi131.stdout: create 109/31 file after the snapshot 2024-04-12T19:42:13.369 INFO:tasks.workunit.client.0.smithi131.stdout: create 109/32 file after the snapshot 2024-04-12T19:42:13.376 INFO:tasks.workunit.client.0.smithi131.stdout: create 109/33 file after the snapshot 2024-04-12T19:42:13.383 INFO:tasks.workunit.client.0.smithi131.stdout: create 109/34 file after the snapshot 2024-04-12T19:42:13.391 INFO:tasks.workunit.client.0.smithi131.stdout: create 109/35 file after the snapshot 2024-04-12T19:42:13.399 INFO:tasks.workunit.client.0.smithi131.stdout: create 109/36 file after the snapshot 2024-04-12T19:42:13.407 INFO:tasks.workunit.client.0.smithi131.stdout: create 109/37 file after the snapshot 2024-04-12T19:42:13.414 INFO:tasks.workunit.client.0.smithi131.stdout: create 109/38 file after the snapshot 2024-04-12T19:42:13.422 INFO:tasks.workunit.client.0.smithi131.stdout: create 109/39 file after the snapshot 2024-04-12T19:42:13.429 INFO:tasks.workunit.client.0.smithi131.stdout: create 110/.snap/snap-subdir-test 2024-04-12T19:42:13.468 INFO:tasks.workunit.client.0.smithi131.stdout: create 110/30 file after the snapshot 2024-04-12T19:42:13.473 INFO:tasks.workunit.client.0.smithi131.stdout: create 110/31 file after the snapshot 2024-04-12T19:42:13.481 INFO:tasks.workunit.client.0.smithi131.stdout: create 110/32 file after the snapshot 2024-04-12T19:42:13.489 INFO:tasks.workunit.client.0.smithi131.stdout: create 110/33 file after the snapshot 2024-04-12T19:42:13.496 INFO:tasks.workunit.client.0.smithi131.stdout: create 110/34 file after the snapshot 2024-04-12T19:42:13.504 INFO:tasks.workunit.client.0.smithi131.stdout: create 110/35 file after the snapshot 2024-04-12T19:42:13.512 INFO:tasks.workunit.client.0.smithi131.stdout: create 110/36 file after the snapshot 2024-04-12T19:42:13.520 INFO:tasks.workunit.client.0.smithi131.stdout: create 110/37 file after the snapshot 2024-04-12T19:42:13.527 INFO:tasks.workunit.client.0.smithi131.stdout: create 110/38 file after the snapshot 2024-04-12T19:42:13.534 INFO:tasks.workunit.client.0.smithi131.stdout: create 110/39 file after the snapshot 2024-04-12T19:42:13.542 INFO:tasks.workunit.client.0.smithi131.stdout: create 111/.snap/snap-subdir-test 2024-04-12T19:42:13.580 INFO:tasks.workunit.client.0.smithi131.stdout: create 111/30 file after the snapshot 2024-04-12T19:42:13.586 INFO:tasks.workunit.client.0.smithi131.stdout: create 111/31 file after the snapshot 2024-04-12T19:42:13.593 INFO:tasks.workunit.client.0.smithi131.stdout: create 111/32 file after the snapshot 2024-04-12T19:42:13.601 INFO:tasks.workunit.client.0.smithi131.stdout: create 111/33 file after the snapshot 2024-04-12T19:42:13.609 INFO:tasks.workunit.client.0.smithi131.stdout: create 111/34 file after the snapshot 2024-04-12T19:42:13.616 INFO:tasks.workunit.client.0.smithi131.stdout: create 111/35 file after the snapshot 2024-04-12T19:42:13.624 INFO:tasks.workunit.client.0.smithi131.stdout: create 111/36 file after the snapshot 2024-04-12T19:42:13.632 INFO:tasks.workunit.client.0.smithi131.stdout: create 111/37 file after the snapshot 2024-04-12T19:42:13.639 INFO:tasks.workunit.client.0.smithi131.stdout: create 111/38 file after the snapshot 2024-04-12T19:42:13.647 INFO:tasks.workunit.client.0.smithi131.stdout: create 111/39 file after the snapshot 2024-04-12T19:42:13.654 INFO:tasks.workunit.client.0.smithi131.stdout: create 112/.snap/snap-subdir-test 2024-04-12T19:42:13.695 INFO:tasks.workunit.client.0.smithi131.stdout: create 112/30 file after the snapshot 2024-04-12T19:42:13.701 INFO:tasks.workunit.client.0.smithi131.stdout: create 112/31 file after the snapshot 2024-04-12T19:42:13.709 INFO:tasks.workunit.client.0.smithi131.stdout: create 112/32 file after the snapshot 2024-04-12T19:42:13.716 INFO:tasks.workunit.client.0.smithi131.stdout: create 112/33 file after the snapshot 2024-04-12T19:42:13.724 INFO:tasks.workunit.client.0.smithi131.stdout: create 112/34 file after the snapshot 2024-04-12T19:42:13.733 INFO:tasks.workunit.client.0.smithi131.stdout: create 112/35 file after the snapshot 2024-04-12T19:42:13.741 INFO:tasks.workunit.client.0.smithi131.stdout: create 112/36 file after the snapshot 2024-04-12T19:42:13.749 INFO:tasks.workunit.client.0.smithi131.stdout: create 112/37 file after the snapshot 2024-04-12T19:42:13.756 INFO:tasks.workunit.client.0.smithi131.stdout: create 112/38 file after the snapshot 2024-04-12T19:42:13.764 INFO:tasks.workunit.client.0.smithi131.stdout: create 112/39 file after the snapshot 2024-04-12T19:42:13.771 INFO:tasks.workunit.client.0.smithi131.stdout: create 113/.snap/snap-subdir-test 2024-04-12T19:42:13.811 INFO:tasks.workunit.client.0.smithi131.stdout: create 113/30 file after the snapshot 2024-04-12T19:42:13.816 INFO:tasks.workunit.client.0.smithi131.stdout: create 113/31 file after the snapshot 2024-04-12T19:42:13.823 INFO:tasks.workunit.client.0.smithi131.stdout: create 113/32 file after the snapshot 2024-04-12T19:42:13.830 INFO:tasks.workunit.client.0.smithi131.stdout: create 113/33 file after the snapshot 2024-04-12T19:42:13.838 INFO:tasks.workunit.client.0.smithi131.stdout: create 113/34 file after the snapshot 2024-04-12T19:42:13.846 INFO:tasks.workunit.client.0.smithi131.stdout: create 113/35 file after the snapshot 2024-04-12T19:42:13.854 INFO:tasks.workunit.client.0.smithi131.stdout: create 113/36 file after the snapshot 2024-04-12T19:42:13.861 INFO:tasks.workunit.client.0.smithi131.stdout: create 113/37 file after the snapshot 2024-04-12T19:42:13.870 INFO:tasks.workunit.client.0.smithi131.stdout: create 113/38 file after the snapshot 2024-04-12T19:42:13.878 INFO:tasks.workunit.client.0.smithi131.stdout: create 113/39 file after the snapshot 2024-04-12T19:42:13.886 INFO:tasks.workunit.client.0.smithi131.stdout: create 114/.snap/snap-subdir-test 2024-04-12T19:42:13.926 INFO:tasks.workunit.client.0.smithi131.stdout: create 114/30 file after the snapshot 2024-04-12T19:42:13.931 INFO:tasks.workunit.client.0.smithi131.stdout: create 114/31 file after the snapshot 2024-04-12T19:42:13.937 INFO:tasks.workunit.client.0.smithi131.stdout: create 114/32 file after the snapshot 2024-04-12T19:42:13.947 INFO:tasks.workunit.client.0.smithi131.stdout: create 114/33 file after the snapshot 2024-04-12T19:42:13.955 INFO:tasks.workunit.client.0.smithi131.stdout: create 114/34 file after the snapshot 2024-04-12T19:42:13.963 INFO:tasks.workunit.client.0.smithi131.stdout: create 114/35 file after the snapshot 2024-04-12T19:42:13.969 INFO:tasks.workunit.client.0.smithi131.stdout: create 114/36 file after the snapshot 2024-04-12T19:42:13.977 INFO:tasks.workunit.client.0.smithi131.stdout: create 114/37 file after the snapshot 2024-04-12T19:42:13.985 INFO:tasks.workunit.client.0.smithi131.stdout: create 114/38 file after the snapshot 2024-04-12T19:42:13.992 INFO:tasks.workunit.client.0.smithi131.stdout: create 114/39 file after the snapshot 2024-04-12T19:42:14.000 INFO:tasks.workunit.client.0.smithi131.stdout: create 115/.snap/snap-subdir-test 2024-04-12T19:42:14.041 INFO:tasks.workunit.client.0.smithi131.stdout: create 115/30 file after the snapshot 2024-04-12T19:42:14.046 INFO:tasks.workunit.client.0.smithi131.stdout: create 115/31 file after the snapshot 2024-04-12T19:42:14.053 INFO:tasks.workunit.client.0.smithi131.stdout: create 115/32 file after the snapshot 2024-04-12T19:42:14.061 INFO:tasks.workunit.client.0.smithi131.stdout: create 115/33 file after the snapshot 2024-04-12T19:42:14.068 INFO:tasks.workunit.client.0.smithi131.stdout: create 115/34 file after the snapshot 2024-04-12T19:42:14.092 INFO:tasks.workunit.client.0.smithi131.stdout: create 115/35 file after the snapshot 2024-04-12T19:42:14.187 INFO:tasks.workunit.client.0.smithi131.stdout: create 115/36 file after the snapshot 2024-04-12T19:42:14.193 INFO:tasks.workunit.client.0.smithi131.stdout: create 115/37 file after the snapshot 2024-04-12T19:42:14.200 INFO:tasks.workunit.client.0.smithi131.stdout: create 115/38 file after the snapshot 2024-04-12T19:42:14.209 INFO:tasks.workunit.client.0.smithi131.stdout: create 115/39 file after the snapshot 2024-04-12T19:42:14.215 INFO:tasks.workunit.client.0.smithi131.stdout: create 116/.snap/snap-subdir-test 2024-04-12T19:42:14.323 INFO:tasks.workunit.client.0.smithi131.stdout: create 116/30 file after the snapshot 2024-04-12T19:42:14.329 INFO:tasks.workunit.client.0.smithi131.stdout: create 116/31 file after the snapshot 2024-04-12T19:42:14.336 INFO:tasks.workunit.client.0.smithi131.stdout: create 116/32 file after the snapshot 2024-04-12T19:42:14.344 INFO:tasks.workunit.client.0.smithi131.stdout: create 116/33 file after the snapshot 2024-04-12T19:42:14.351 INFO:tasks.workunit.client.0.smithi131.stdout: create 116/34 file after the snapshot 2024-04-12T19:42:14.360 INFO:tasks.workunit.client.0.smithi131.stdout: create 116/35 file after the snapshot 2024-04-12T19:42:14.368 INFO:tasks.workunit.client.0.smithi131.stdout: create 116/36 file after the snapshot 2024-04-12T19:42:14.376 INFO:tasks.workunit.client.0.smithi131.stdout: create 116/37 file after the snapshot 2024-04-12T19:42:14.383 INFO:tasks.workunit.client.0.smithi131.stdout: create 116/38 file after the snapshot 2024-04-12T19:42:14.392 INFO:tasks.workunit.client.0.smithi131.stdout: create 116/39 file after the snapshot 2024-04-12T19:42:14.400 INFO:tasks.workunit.client.0.smithi131.stdout: create 117/.snap/snap-subdir-test 2024-04-12T19:42:14.438 INFO:tasks.workunit.client.0.smithi131.stdout: create 117/30 file after the snapshot 2024-04-12T19:42:14.443 INFO:tasks.workunit.client.0.smithi131.stdout: create 117/31 file after the snapshot 2024-04-12T19:42:14.451 INFO:tasks.workunit.client.0.smithi131.stdout: create 117/32 file after the snapshot 2024-04-12T19:42:14.461 INFO:tasks.workunit.client.0.smithi131.stdout: create 117/33 file after the snapshot 2024-04-12T19:42:14.469 INFO:tasks.workunit.client.0.smithi131.stdout: create 117/34 file after the snapshot 2024-04-12T19:42:14.475 INFO:tasks.workunit.client.0.smithi131.stdout: create 117/35 file after the snapshot 2024-04-12T19:42:14.484 INFO:tasks.workunit.client.0.smithi131.stdout: create 117/36 file after the snapshot 2024-04-12T19:42:14.491 INFO:tasks.workunit.client.0.smithi131.stdout: create 117/37 file after the snapshot 2024-04-12T19:42:14.498 INFO:tasks.workunit.client.0.smithi131.stdout: create 117/38 file after the snapshot 2024-04-12T19:42:14.505 INFO:tasks.workunit.client.0.smithi131.stdout: create 117/39 file after the snapshot 2024-04-12T19:42:14.512 INFO:tasks.workunit.client.0.smithi131.stdout: create 118/.snap/snap-subdir-test 2024-04-12T19:42:14.556 INFO:tasks.workunit.client.0.smithi131.stdout: create 118/30 file after the snapshot 2024-04-12T19:42:14.562 INFO:tasks.workunit.client.0.smithi131.stdout: create 118/31 file after the snapshot 2024-04-12T19:42:14.569 INFO:tasks.workunit.client.0.smithi131.stdout: create 118/32 file after the snapshot 2024-04-12T19:42:14.576 INFO:tasks.workunit.client.0.smithi131.stdout: create 118/33 file after the snapshot 2024-04-12T19:42:14.584 INFO:tasks.workunit.client.0.smithi131.stdout: create 118/34 file after the snapshot 2024-04-12T19:42:14.592 INFO:tasks.workunit.client.0.smithi131.stdout: create 118/35 file after the snapshot 2024-04-12T19:42:14.600 INFO:tasks.workunit.client.0.smithi131.stdout: create 118/36 file after the snapshot 2024-04-12T19:42:14.608 INFO:tasks.workunit.client.0.smithi131.stdout: create 118/37 file after the snapshot 2024-04-12T19:42:14.615 INFO:tasks.workunit.client.0.smithi131.stdout: create 118/38 file after the snapshot 2024-04-12T19:42:14.623 INFO:tasks.workunit.client.0.smithi131.stdout: create 118/39 file after the snapshot 2024-04-12T19:42:14.631 INFO:tasks.workunit.client.0.smithi131.stdout: create 119/.snap/snap-subdir-test 2024-04-12T19:42:14.676 INFO:tasks.workunit.client.0.smithi131.stdout: create 119/30 file after the snapshot 2024-04-12T19:42:14.682 INFO:tasks.workunit.client.0.smithi131.stdout: create 119/31 file after the snapshot 2024-04-12T19:42:14.689 INFO:tasks.workunit.client.0.smithi131.stdout: create 119/32 file after the snapshot 2024-04-12T19:42:14.698 INFO:tasks.workunit.client.0.smithi131.stdout: create 119/33 file after the snapshot 2024-04-12T19:42:14.705 INFO:tasks.workunit.client.0.smithi131.stdout: create 119/34 file after the snapshot 2024-04-12T19:42:14.713 INFO:tasks.workunit.client.0.smithi131.stdout: create 119/35 file after the snapshot 2024-04-12T19:42:14.721 INFO:tasks.workunit.client.0.smithi131.stdout: create 119/36 file after the snapshot 2024-04-12T19:42:14.729 INFO:tasks.workunit.client.0.smithi131.stdout: create 119/37 file after the snapshot 2024-04-12T19:42:14.736 INFO:tasks.workunit.client.0.smithi131.stdout: create 119/38 file after the snapshot 2024-04-12T19:42:14.744 INFO:tasks.workunit.client.0.smithi131.stdout: create 119/39 file after the snapshot 2024-04-12T19:42:14.752 INFO:tasks.workunit.client.0.smithi131.stdout: create 120/.snap/snap-subdir-test 2024-04-12T19:42:14.800 INFO:tasks.workunit.client.0.smithi131.stdout: create 120/30 file after the snapshot 2024-04-12T19:42:14.806 INFO:tasks.workunit.client.0.smithi131.stdout: create 120/31 file after the snapshot 2024-04-12T19:42:14.815 INFO:tasks.workunit.client.0.smithi131.stdout: create 120/32 file after the snapshot 2024-04-12T19:42:14.824 INFO:tasks.workunit.client.0.smithi131.stdout: create 120/33 file after the snapshot 2024-04-12T19:42:14.832 INFO:tasks.workunit.client.0.smithi131.stdout: create 120/34 file after the snapshot 2024-04-12T19:42:14.840 INFO:tasks.workunit.client.0.smithi131.stdout: create 120/35 file after the snapshot 2024-04-12T19:42:14.849 INFO:tasks.workunit.client.0.smithi131.stdout: create 120/36 file after the snapshot 2024-04-12T19:42:14.857 INFO:tasks.workunit.client.0.smithi131.stdout: create 120/37 file after the snapshot 2024-04-12T19:42:14.864 INFO:tasks.workunit.client.0.smithi131.stdout: create 120/38 file after the snapshot 2024-04-12T19:42:14.872 INFO:tasks.workunit.client.0.smithi131.stdout: create 120/39 file after the snapshot 2024-04-12T19:42:14.879 INFO:tasks.workunit.client.0.smithi131.stdout: create 121/.snap/snap-subdir-test 2024-04-12T19:42:14.921 INFO:tasks.workunit.client.0.smithi131.stdout: create 121/30 file after the snapshot 2024-04-12T19:42:14.927 INFO:tasks.workunit.client.0.smithi131.stdout: create 121/31 file after the snapshot 2024-04-12T19:42:14.935 INFO:tasks.workunit.client.0.smithi131.stdout: create 121/32 file after the snapshot 2024-04-12T19:42:14.942 INFO:tasks.workunit.client.0.smithi131.stdout: create 121/33 file after the snapshot 2024-04-12T19:42:14.951 INFO:tasks.workunit.client.0.smithi131.stdout: create 121/34 file after the snapshot 2024-04-12T19:42:14.961 INFO:tasks.workunit.client.0.smithi131.stdout: create 121/35 file after the snapshot 2024-04-12T19:42:14.968 INFO:tasks.workunit.client.0.smithi131.stdout: create 121/36 file after the snapshot 2024-04-12T19:42:14.976 INFO:tasks.workunit.client.0.smithi131.stdout: create 121/37 file after the snapshot 2024-04-12T19:42:15.124 INFO:tasks.workunit.client.0.smithi131.stdout: create 121/38 file after the snapshot 2024-04-12T19:42:15.240 INFO:tasks.workunit.client.0.smithi131.stdout: create 121/39 file after the snapshot 2024-04-12T19:42:15.246 INFO:tasks.workunit.client.0.smithi131.stdout: create 122/.snap/snap-subdir-test 2024-04-12T19:42:15.338 INFO:tasks.workunit.client.0.smithi131.stdout: create 122/30 file after the snapshot 2024-04-12T19:42:15.343 INFO:tasks.workunit.client.0.smithi131.stdout: create 122/31 file after the snapshot 2024-04-12T19:42:15.350 INFO:tasks.workunit.client.0.smithi131.stdout: create 122/32 file after the snapshot 2024-04-12T19:42:15.357 INFO:tasks.workunit.client.0.smithi131.stdout: create 122/33 file after the snapshot 2024-04-12T19:42:15.364 INFO:tasks.workunit.client.0.smithi131.stdout: create 122/34 file after the snapshot 2024-04-12T19:42:15.373 INFO:tasks.workunit.client.0.smithi131.stdout: create 122/35 file after the snapshot 2024-04-12T19:42:15.380 INFO:tasks.workunit.client.0.smithi131.stdout: create 122/36 file after the snapshot 2024-04-12T19:42:15.388 INFO:tasks.workunit.client.0.smithi131.stdout: create 122/37 file after the snapshot 2024-04-12T19:42:15.395 INFO:tasks.workunit.client.0.smithi131.stdout: create 122/38 file after the snapshot 2024-04-12T19:42:15.403 INFO:tasks.workunit.client.0.smithi131.stdout: create 122/39 file after the snapshot 2024-04-12T19:42:15.412 INFO:tasks.workunit.client.0.smithi131.stdout: create 123/.snap/snap-subdir-test 2024-04-12T19:42:15.453 INFO:tasks.workunit.client.0.smithi131.stdout: create 123/30 file after the snapshot 2024-04-12T19:42:15.460 INFO:tasks.workunit.client.0.smithi131.stdout: create 123/31 file after the snapshot 2024-04-12T19:42:15.468 INFO:tasks.workunit.client.0.smithi131.stdout: create 123/32 file after the snapshot 2024-04-12T19:42:15.475 INFO:tasks.workunit.client.0.smithi131.stdout: create 123/33 file after the snapshot 2024-04-12T19:42:15.484 INFO:tasks.workunit.client.0.smithi131.stdout: create 123/34 file after the snapshot 2024-04-12T19:42:15.491 INFO:tasks.workunit.client.0.smithi131.stdout: create 123/35 file after the snapshot 2024-04-12T19:42:15.499 INFO:tasks.workunit.client.0.smithi131.stdout: create 123/36 file after the snapshot 2024-04-12T19:42:15.506 INFO:tasks.workunit.client.0.smithi131.stdout: create 123/37 file after the snapshot 2024-04-12T19:42:15.513 INFO:tasks.workunit.client.0.smithi131.stdout: create 123/38 file after the snapshot 2024-04-12T19:42:15.520 INFO:tasks.workunit.client.0.smithi131.stdout: create 123/39 file after the snapshot 2024-04-12T19:42:15.528 INFO:tasks.workunit.client.0.smithi131.stdout: create 124/.snap/snap-subdir-test 2024-04-12T19:42:15.569 INFO:tasks.workunit.client.0.smithi131.stdout: create 124/30 file after the snapshot 2024-04-12T19:42:15.576 INFO:tasks.workunit.client.0.smithi131.stdout: create 124/31 file after the snapshot 2024-04-12T19:42:15.584 INFO:tasks.workunit.client.0.smithi131.stdout: create 124/32 file after the snapshot 2024-04-12T19:42:15.591 INFO:tasks.workunit.client.0.smithi131.stdout: create 124/33 file after the snapshot 2024-04-12T19:42:15.600 INFO:tasks.workunit.client.0.smithi131.stdout: create 124/34 file after the snapshot 2024-04-12T19:42:15.609 INFO:tasks.workunit.client.0.smithi131.stdout: create 124/35 file after the snapshot 2024-04-12T19:42:15.616 INFO:tasks.workunit.client.0.smithi131.stdout: create 124/36 file after the snapshot 2024-04-12T19:42:15.623 INFO:tasks.workunit.client.0.smithi131.stdout: create 124/37 file after the snapshot 2024-04-12T19:42:15.631 INFO:tasks.workunit.client.0.smithi131.stdout: create 124/38 file after the snapshot 2024-04-12T19:42:15.641 INFO:tasks.workunit.client.0.smithi131.stdout: create 124/39 file after the snapshot 2024-04-12T19:42:15.648 INFO:tasks.workunit.client.0.smithi131.stdout: create 125/.snap/snap-subdir-test 2024-04-12T19:42:15.687 INFO:tasks.workunit.client.0.smithi131.stdout: create 125/30 file after the snapshot 2024-04-12T19:42:15.692 INFO:tasks.workunit.client.0.smithi131.stdout: create 125/31 file after the snapshot 2024-04-12T19:42:15.700 INFO:tasks.workunit.client.0.smithi131.stdout: create 125/32 file after the snapshot 2024-04-12T19:42:15.708 INFO:tasks.workunit.client.0.smithi131.stdout: create 125/33 file after the snapshot 2024-04-12T19:42:15.717 INFO:tasks.workunit.client.0.smithi131.stdout: create 125/34 file after the snapshot 2024-04-12T19:42:15.725 INFO:tasks.workunit.client.0.smithi131.stdout: create 125/35 file after the snapshot 2024-04-12T19:42:15.732 INFO:tasks.workunit.client.0.smithi131.stdout: create 125/36 file after the snapshot 2024-04-12T19:42:15.740 INFO:tasks.workunit.client.0.smithi131.stdout: create 125/37 file after the snapshot 2024-04-12T19:42:15.748 INFO:tasks.workunit.client.0.smithi131.stdout: create 125/38 file after the snapshot 2024-04-12T19:42:15.757 INFO:tasks.workunit.client.0.smithi131.stdout: create 125/39 file after the snapshot 2024-04-12T19:42:15.764 INFO:tasks.workunit.client.0.smithi131.stdout: create 126/.snap/snap-subdir-test 2024-04-12T19:42:15.799 INFO:tasks.workunit.client.0.smithi131.stdout: create 126/30 file after the snapshot 2024-04-12T19:42:15.806 INFO:tasks.workunit.client.0.smithi131.stdout: create 126/31 file after the snapshot 2024-04-12T19:42:15.812 INFO:tasks.workunit.client.0.smithi131.stdout: create 126/32 file after the snapshot 2024-04-12T19:42:15.819 INFO:tasks.workunit.client.0.smithi131.stdout: create 126/33 file after the snapshot 2024-04-12T19:42:15.827 INFO:tasks.workunit.client.0.smithi131.stdout: create 126/34 file after the snapshot 2024-04-12T19:42:15.834 INFO:tasks.workunit.client.0.smithi131.stdout: create 126/35 file after the snapshot 2024-04-12T19:42:15.842 INFO:tasks.workunit.client.0.smithi131.stdout: create 126/36 file after the snapshot 2024-04-12T19:42:15.850 INFO:tasks.workunit.client.0.smithi131.stdout: create 126/37 file after the snapshot 2024-04-12T19:42:15.858 INFO:tasks.workunit.client.0.smithi131.stdout: create 126/38 file after the snapshot 2024-04-12T19:42:15.866 INFO:tasks.workunit.client.0.smithi131.stdout: create 126/39 file after the snapshot 2024-04-12T19:42:15.873 INFO:tasks.workunit.client.0.smithi131.stdout: create 127/.snap/snap-subdir-test 2024-04-12T19:42:15.913 INFO:tasks.workunit.client.0.smithi131.stdout: create 127/30 file after the snapshot 2024-04-12T19:42:15.920 INFO:tasks.workunit.client.0.smithi131.stdout: create 127/31 file after the snapshot 2024-04-12T19:42:15.929 INFO:tasks.workunit.client.0.smithi131.stdout: create 127/32 file after the snapshot 2024-04-12T19:42:15.936 INFO:tasks.workunit.client.0.smithi131.stdout: create 127/33 file after the snapshot 2024-04-12T19:42:15.944 INFO:tasks.workunit.client.0.smithi131.stdout: create 127/34 file after the snapshot 2024-04-12T19:42:15.952 INFO:tasks.workunit.client.0.smithi131.stdout: create 127/35 file after the snapshot 2024-04-12T19:42:15.959 INFO:tasks.workunit.client.0.smithi131.stdout: create 127/36 file after the snapshot 2024-04-12T19:42:15.967 INFO:tasks.workunit.client.0.smithi131.stdout: create 127/37 file after the snapshot 2024-04-12T19:42:15.974 INFO:tasks.workunit.client.0.smithi131.stdout: create 127/38 file after the snapshot 2024-04-12T19:42:15.983 INFO:tasks.workunit.client.0.smithi131.stdout: create 127/39 file after the snapshot 2024-04-12T19:42:15.991 INFO:tasks.workunit.client.0.smithi131.stdout: create 128/.snap/snap-subdir-test 2024-04-12T19:42:16.030 INFO:tasks.workunit.client.0.smithi131.stdout: create 128/30 file after the snapshot 2024-04-12T19:42:16.036 INFO:tasks.workunit.client.0.smithi131.stdout: create 128/31 file after the snapshot 2024-04-12T19:42:16.043 INFO:tasks.workunit.client.0.smithi131.stdout: create 128/32 file after the snapshot 2024-04-12T19:42:16.051 INFO:tasks.workunit.client.0.smithi131.stdout: create 128/33 file after the snapshot 2024-04-12T19:42:16.057 INFO:tasks.workunit.client.0.smithi131.stdout: create 128/34 file after the snapshot 2024-04-12T19:42:16.066 INFO:tasks.workunit.client.0.smithi131.stdout: create 128/35 file after the snapshot 2024-04-12T19:42:16.073 INFO:tasks.workunit.client.0.smithi131.stdout: create 128/36 file after the snapshot 2024-04-12T19:42:16.081 INFO:tasks.workunit.client.0.smithi131.stdout: create 128/37 file after the snapshot 2024-04-12T19:42:16.089 INFO:tasks.workunit.client.0.smithi131.stdout: create 128/38 file after the snapshot 2024-04-12T19:42:16.097 INFO:tasks.workunit.client.0.smithi131.stdout: create 128/39 file after the snapshot 2024-04-12T19:42:16.104 INFO:tasks.workunit.client.0.smithi131.stdout: create 129/.snap/snap-subdir-test 2024-04-12T19:42:16.325 INFO:tasks.workunit.client.0.smithi131.stdout: create 129/30 file after the snapshot 2024-04-12T19:42:16.329 INFO:tasks.workunit.client.0.smithi131.stdout: create 129/31 file after the snapshot 2024-04-12T19:42:16.335 INFO:tasks.workunit.client.0.smithi131.stdout: create 129/32 file after the snapshot 2024-04-12T19:42:16.342 INFO:tasks.workunit.client.0.smithi131.stdout: create 129/33 file after the snapshot 2024-04-12T19:42:16.349 INFO:tasks.workunit.client.0.smithi131.stdout: create 129/34 file after the snapshot 2024-04-12T19:42:16.358 INFO:tasks.workunit.client.0.smithi131.stdout: create 129/35 file after the snapshot 2024-04-12T19:42:16.366 INFO:tasks.workunit.client.0.smithi131.stdout: create 129/36 file after the snapshot 2024-04-12T19:42:16.374 INFO:tasks.workunit.client.0.smithi131.stdout: create 129/37 file after the snapshot 2024-04-12T19:42:16.383 INFO:tasks.workunit.client.0.smithi131.stdout: create 129/38 file after the snapshot 2024-04-12T19:42:16.390 INFO:tasks.workunit.client.0.smithi131.stdout: create 129/39 file after the snapshot 2024-04-12T19:42:16.398 INFO:tasks.workunit.client.0.smithi131.stdout: create 130/.snap/snap-subdir-test 2024-04-12T19:42:16.437 INFO:tasks.workunit.client.0.smithi131.stdout: create 130/30 file after the snapshot 2024-04-12T19:42:16.443 INFO:tasks.workunit.client.0.smithi131.stdout: create 130/31 file after the snapshot 2024-04-12T19:42:16.449 INFO:tasks.workunit.client.0.smithi131.stdout: create 130/32 file after the snapshot 2024-04-12T19:42:16.458 INFO:tasks.workunit.client.0.smithi131.stdout: create 130/33 file after the snapshot 2024-04-12T19:42:16.466 INFO:tasks.workunit.client.0.smithi131.stdout: create 130/34 file after the snapshot 2024-04-12T19:42:16.473 INFO:tasks.workunit.client.0.smithi131.stdout: create 130/35 file after the snapshot 2024-04-12T19:42:16.480 INFO:tasks.workunit.client.0.smithi131.stdout: create 130/36 file after the snapshot 2024-04-12T19:42:16.489 INFO:tasks.workunit.client.0.smithi131.stdout: create 130/37 file after the snapshot 2024-04-12T19:42:16.496 INFO:tasks.workunit.client.0.smithi131.stdout: create 130/38 file after the snapshot 2024-04-12T19:42:16.503 INFO:tasks.workunit.client.0.smithi131.stdout: create 130/39 file after the snapshot 2024-04-12T19:42:16.512 INFO:tasks.workunit.client.0.smithi131.stdout: create 131/.snap/snap-subdir-test 2024-04-12T19:42:16.558 INFO:tasks.workunit.client.0.smithi131.stdout: create 131/30 file after the snapshot 2024-04-12T19:42:16.562 INFO:tasks.workunit.client.0.smithi131.stdout: create 131/31 file after the snapshot 2024-04-12T19:42:16.568 INFO:tasks.workunit.client.0.smithi131.stdout: create 131/32 file after the snapshot 2024-04-12T19:42:16.575 INFO:tasks.workunit.client.0.smithi131.stdout: create 131/33 file after the snapshot 2024-04-12T19:42:16.582 INFO:tasks.workunit.client.0.smithi131.stdout: create 131/34 file after the snapshot 2024-04-12T19:42:16.590 INFO:tasks.workunit.client.0.smithi131.stdout: create 131/35 file after the snapshot 2024-04-12T19:42:16.597 INFO:tasks.workunit.client.0.smithi131.stdout: create 131/36 file after the snapshot 2024-04-12T19:42:16.605 INFO:tasks.workunit.client.0.smithi131.stdout: create 131/37 file after the snapshot 2024-04-12T19:42:16.614 INFO:tasks.workunit.client.0.smithi131.stdout: create 131/38 file after the snapshot 2024-04-12T19:42:16.622 INFO:tasks.workunit.client.0.smithi131.stdout: create 131/39 file after the snapshot 2024-04-12T19:42:16.630 INFO:tasks.workunit.client.0.smithi131.stdout: create 132/.snap/snap-subdir-test 2024-04-12T19:42:16.674 INFO:tasks.workunit.client.0.smithi131.stdout: create 132/30 file after the snapshot 2024-04-12T19:42:16.681 INFO:tasks.workunit.client.0.smithi131.stdout: create 132/31 file after the snapshot 2024-04-12T19:42:16.688 INFO:tasks.workunit.client.0.smithi131.stdout: create 132/32 file after the snapshot 2024-04-12T19:42:16.697 INFO:tasks.workunit.client.0.smithi131.stdout: create 132/33 file after the snapshot 2024-04-12T19:42:16.705 INFO:tasks.workunit.client.0.smithi131.stdout: create 132/34 file after the snapshot 2024-04-12T19:42:16.713 INFO:tasks.workunit.client.0.smithi131.stdout: create 132/35 file after the snapshot 2024-04-12T19:42:16.721 INFO:tasks.workunit.client.0.smithi131.stdout: create 132/36 file after the snapshot 2024-04-12T19:42:16.728 INFO:tasks.workunit.client.0.smithi131.stdout: create 132/37 file after the snapshot 2024-04-12T19:42:16.735 INFO:tasks.workunit.client.0.smithi131.stdout: create 132/38 file after the snapshot 2024-04-12T19:42:16.742 INFO:tasks.workunit.client.0.smithi131.stdout: create 132/39 file after the snapshot 2024-04-12T19:42:16.749 INFO:tasks.workunit.client.0.smithi131.stdout: create 133/.snap/snap-subdir-test 2024-04-12T19:42:16.787 INFO:tasks.workunit.client.0.smithi131.stdout: create 133/30 file after the snapshot 2024-04-12T19:42:16.792 INFO:tasks.workunit.client.0.smithi131.stdout: create 133/31 file after the snapshot 2024-04-12T19:42:16.800 INFO:tasks.workunit.client.0.smithi131.stdout: create 133/32 file after the snapshot 2024-04-12T19:42:16.808 INFO:tasks.workunit.client.0.smithi131.stdout: create 133/33 file after the snapshot 2024-04-12T19:42:16.816 INFO:tasks.workunit.client.0.smithi131.stdout: create 133/34 file after the snapshot 2024-04-12T19:42:16.823 INFO:tasks.workunit.client.0.smithi131.stdout: create 133/35 file after the snapshot 2024-04-12T19:42:16.832 INFO:tasks.workunit.client.0.smithi131.stdout: create 133/36 file after the snapshot 2024-04-12T19:42:16.840 INFO:tasks.workunit.client.0.smithi131.stdout: create 133/37 file after the snapshot 2024-04-12T19:42:16.847 INFO:tasks.workunit.client.0.smithi131.stdout: create 133/38 file after the snapshot 2024-04-12T19:42:16.856 INFO:tasks.workunit.client.0.smithi131.stdout: create 133/39 file after the snapshot 2024-04-12T19:42:16.863 INFO:tasks.workunit.client.0.smithi131.stdout: create 134/.snap/snap-subdir-test 2024-04-12T19:42:16.903 INFO:tasks.workunit.client.0.smithi131.stdout: create 134/30 file after the snapshot 2024-04-12T19:42:16.910 INFO:tasks.workunit.client.0.smithi131.stdout: create 134/31 file after the snapshot 2024-04-12T19:42:16.918 INFO:tasks.workunit.client.0.smithi131.stdout: create 134/32 file after the snapshot 2024-04-12T19:42:16.926 INFO:tasks.workunit.client.0.smithi131.stdout: create 134/33 file after the snapshot 2024-04-12T19:42:16.935 INFO:tasks.workunit.client.0.smithi131.stdout: create 134/34 file after the snapshot 2024-04-12T19:42:16.943 INFO:tasks.workunit.client.0.smithi131.stdout: create 134/35 file after the snapshot 2024-04-12T19:42:16.951 INFO:tasks.workunit.client.0.smithi131.stdout: create 134/36 file after the snapshot 2024-04-12T19:42:16.959 INFO:tasks.workunit.client.0.smithi131.stdout: create 134/37 file after the snapshot 2024-04-12T19:42:16.966 INFO:tasks.workunit.client.0.smithi131.stdout: create 134/38 file after the snapshot 2024-04-12T19:42:16.973 INFO:tasks.workunit.client.0.smithi131.stdout: create 134/39 file after the snapshot 2024-04-12T19:42:16.980 INFO:tasks.workunit.client.0.smithi131.stdout: create 135/.snap/snap-subdir-test 2024-04-12T19:42:17.022 INFO:tasks.workunit.client.0.smithi131.stdout: create 135/30 file after the snapshot 2024-04-12T19:42:17.028 INFO:tasks.workunit.client.0.smithi131.stdout: create 135/31 file after the snapshot 2024-04-12T19:42:17.035 INFO:tasks.workunit.client.0.smithi131.stdout: create 135/32 file after the snapshot 2024-04-12T19:42:17.042 INFO:tasks.workunit.client.0.smithi131.stdout: create 135/33 file after the snapshot 2024-04-12T19:42:17.049 INFO:tasks.workunit.client.0.smithi131.stdout: create 135/34 file after the snapshot 2024-04-12T19:42:17.058 INFO:tasks.workunit.client.0.smithi131.stdout: create 135/35 file after the snapshot 2024-04-12T19:42:17.065 INFO:tasks.workunit.client.0.smithi131.stdout: create 135/36 file after the snapshot 2024-04-12T19:42:17.073 INFO:tasks.workunit.client.0.smithi131.stdout: create 135/37 file after the snapshot 2024-04-12T19:42:17.080 INFO:tasks.workunit.client.0.smithi131.stdout: create 135/38 file after the snapshot 2024-04-12T19:42:17.087 INFO:tasks.workunit.client.0.smithi131.stdout: create 135/39 file after the snapshot 2024-04-12T19:42:17.094 INFO:tasks.workunit.client.0.smithi131.stdout: create 136/.snap/snap-subdir-test 2024-04-12T19:42:17.135 INFO:tasks.workunit.client.0.smithi131.stdout: create 136/30 file after the snapshot 2024-04-12T19:42:17.142 INFO:tasks.workunit.client.0.smithi131.stdout: create 136/31 file after the snapshot 2024-04-12T19:42:17.198 INFO:tasks.workunit.client.0.smithi131.stdout: create 136/32 file after the snapshot 2024-04-12T19:42:17.206 INFO:tasks.workunit.client.0.smithi131.stdout: create 136/33 file after the snapshot 2024-04-12T19:42:17.213 INFO:tasks.workunit.client.0.smithi131.stdout: create 136/34 file after the snapshot 2024-04-12T19:42:17.221 INFO:tasks.workunit.client.0.smithi131.stdout: create 136/35 file after the snapshot 2024-04-12T19:42:17.229 INFO:tasks.workunit.client.0.smithi131.stdout: create 136/36 file after the snapshot 2024-04-12T19:42:17.237 INFO:tasks.workunit.client.0.smithi131.stdout: create 136/37 file after the snapshot 2024-04-12T19:42:17.245 INFO:tasks.workunit.client.0.smithi131.stdout: create 136/38 file after the snapshot 2024-04-12T19:42:17.251 INFO:tasks.workunit.client.0.smithi131.stdout: create 136/39 file after the snapshot 2024-04-12T19:42:17.259 INFO:tasks.workunit.client.0.smithi131.stdout: create 137/.snap/snap-subdir-test 2024-04-12T19:42:17.329 INFO:tasks.workunit.client.0.smithi131.stdout: create 137/30 file after the snapshot 2024-04-12T19:42:17.336 INFO:tasks.workunit.client.0.smithi131.stdout: create 137/31 file after the snapshot 2024-04-12T19:42:17.343 INFO:tasks.workunit.client.0.smithi131.stdout: create 137/32 file after the snapshot 2024-04-12T19:42:17.351 INFO:tasks.workunit.client.0.smithi131.stdout: create 137/33 file after the snapshot 2024-04-12T19:42:17.359 INFO:tasks.workunit.client.0.smithi131.stdout: create 137/34 file after the snapshot 2024-04-12T19:42:17.367 INFO:tasks.workunit.client.0.smithi131.stdout: create 137/35 file after the snapshot 2024-04-12T19:42:17.375 INFO:tasks.workunit.client.0.smithi131.stdout: create 137/36 file after the snapshot 2024-04-12T19:42:17.383 INFO:tasks.workunit.client.0.smithi131.stdout: create 137/37 file after the snapshot 2024-04-12T19:42:17.391 INFO:tasks.workunit.client.0.smithi131.stdout: create 137/38 file after the snapshot 2024-04-12T19:42:17.399 INFO:tasks.workunit.client.0.smithi131.stdout: create 137/39 file after the snapshot 2024-04-12T19:42:17.406 INFO:tasks.workunit.client.0.smithi131.stdout: create 138/.snap/snap-subdir-test 2024-04-12T19:42:17.449 INFO:tasks.workunit.client.0.smithi131.stdout: create 138/30 file after the snapshot 2024-04-12T19:42:17.454 INFO:tasks.workunit.client.0.smithi131.stdout: create 138/31 file after the snapshot 2024-04-12T19:42:17.462 INFO:tasks.workunit.client.0.smithi131.stdout: create 138/32 file after the snapshot 2024-04-12T19:42:17.471 INFO:tasks.workunit.client.0.smithi131.stdout: create 138/33 file after the snapshot 2024-04-12T19:42:17.478 INFO:tasks.workunit.client.0.smithi131.stdout: create 138/34 file after the snapshot 2024-04-12T19:42:17.487 INFO:tasks.workunit.client.0.smithi131.stdout: create 138/35 file after the snapshot 2024-04-12T19:42:17.495 INFO:tasks.workunit.client.0.smithi131.stdout: create 138/36 file after the snapshot 2024-04-12T19:42:17.503 INFO:tasks.workunit.client.0.smithi131.stdout: create 138/37 file after the snapshot 2024-04-12T19:42:17.511 INFO:tasks.workunit.client.0.smithi131.stdout: create 138/38 file after the snapshot 2024-04-12T19:42:17.519 INFO:tasks.workunit.client.0.smithi131.stdout: create 138/39 file after the snapshot 2024-04-12T19:42:17.525 INFO:tasks.workunit.client.0.smithi131.stdout: create 139/.snap/snap-subdir-test 2024-04-12T19:42:17.574 INFO:tasks.workunit.client.0.smithi131.stdout: create 139/30 file after the snapshot 2024-04-12T19:42:17.579 INFO:tasks.workunit.client.0.smithi131.stdout: create 139/31 file after the snapshot 2024-04-12T19:42:17.586 INFO:tasks.workunit.client.0.smithi131.stdout: create 139/32 file after the snapshot 2024-04-12T19:42:17.593 INFO:tasks.workunit.client.0.smithi131.stdout: create 139/33 file after the snapshot 2024-04-12T19:42:17.601 INFO:tasks.workunit.client.0.smithi131.stdout: create 139/34 file after the snapshot 2024-04-12T19:42:17.608 INFO:tasks.workunit.client.0.smithi131.stdout: create 139/35 file after the snapshot 2024-04-12T19:42:17.616 INFO:tasks.workunit.client.0.smithi131.stdout: create 139/36 file after the snapshot 2024-04-12T19:42:17.624 INFO:tasks.workunit.client.0.smithi131.stdout: create 139/37 file after the snapshot 2024-04-12T19:42:17.631 INFO:tasks.workunit.client.0.smithi131.stdout: create 139/38 file after the snapshot 2024-04-12T19:42:17.640 INFO:tasks.workunit.client.0.smithi131.stdout: create 139/39 file after the snapshot 2024-04-12T19:42:17.649 INFO:tasks.workunit.client.0.smithi131.stdout: create 140/.snap/snap-subdir-test 2024-04-12T19:42:17.692 INFO:tasks.workunit.client.0.smithi131.stdout: create 140/30 file after the snapshot 2024-04-12T19:42:17.698 INFO:tasks.workunit.client.0.smithi131.stdout: create 140/31 file after the snapshot 2024-04-12T19:42:17.704 INFO:tasks.workunit.client.0.smithi131.stdout: create 140/32 file after the snapshot 2024-04-12T19:42:17.713 INFO:tasks.workunit.client.0.smithi131.stdout: create 140/33 file after the snapshot 2024-04-12T19:42:17.721 INFO:tasks.workunit.client.0.smithi131.stdout: create 140/34 file after the snapshot 2024-04-12T19:42:17.730 INFO:tasks.workunit.client.0.smithi131.stdout: create 140/35 file after the snapshot 2024-04-12T19:42:17.738 INFO:tasks.workunit.client.0.smithi131.stdout: create 140/36 file after the snapshot 2024-04-12T19:42:17.745 INFO:tasks.workunit.client.0.smithi131.stdout: create 140/37 file after the snapshot 2024-04-12T19:42:17.753 INFO:tasks.workunit.client.0.smithi131.stdout: create 140/38 file after the snapshot 2024-04-12T19:42:17.762 INFO:tasks.workunit.client.0.smithi131.stdout: create 140/39 file after the snapshot 2024-04-12T19:42:17.769 INFO:tasks.workunit.client.0.smithi131.stdout: create 141/.snap/snap-subdir-test 2024-04-12T19:42:17.811 INFO:tasks.workunit.client.0.smithi131.stdout: create 141/30 file after the snapshot 2024-04-12T19:42:17.818 INFO:tasks.workunit.client.0.smithi131.stdout: create 141/31 file after the snapshot 2024-04-12T19:42:17.825 INFO:tasks.workunit.client.0.smithi131.stdout: create 141/32 file after the snapshot 2024-04-12T19:42:17.831 INFO:tasks.workunit.client.0.smithi131.stdout: create 141/33 file after the snapshot 2024-04-12T19:42:17.839 INFO:tasks.workunit.client.0.smithi131.stdout: create 141/34 file after the snapshot 2024-04-12T19:42:17.847 INFO:tasks.workunit.client.0.smithi131.stdout: create 141/35 file after the snapshot 2024-04-12T19:42:17.855 INFO:tasks.workunit.client.0.smithi131.stdout: create 141/36 file after the snapshot 2024-04-12T19:42:17.862 INFO:tasks.workunit.client.0.smithi131.stdout: create 141/37 file after the snapshot 2024-04-12T19:42:17.869 INFO:tasks.workunit.client.0.smithi131.stdout: create 141/38 file after the snapshot 2024-04-12T19:42:17.877 INFO:tasks.workunit.client.0.smithi131.stdout: create 141/39 file after the snapshot 2024-04-12T19:42:17.885 INFO:tasks.workunit.client.0.smithi131.stdout: create 142/.snap/snap-subdir-test 2024-04-12T19:42:17.929 INFO:tasks.workunit.client.0.smithi131.stdout: create 142/30 file after the snapshot 2024-04-12T19:42:17.935 INFO:tasks.workunit.client.0.smithi131.stdout: create 142/31 file after the snapshot 2024-04-12T19:42:17.941 INFO:tasks.workunit.client.0.smithi131.stdout: create 142/32 file after the snapshot 2024-04-12T19:42:17.947 INFO:tasks.workunit.client.0.smithi131.stdout: create 142/33 file after the snapshot 2024-04-12T19:42:17.956 INFO:tasks.workunit.client.0.smithi131.stdout: create 142/34 file after the snapshot 2024-04-12T19:42:17.963 INFO:tasks.workunit.client.0.smithi131.stdout: create 142/35 file after the snapshot 2024-04-12T19:42:17.970 INFO:tasks.workunit.client.0.smithi131.stdout: create 142/36 file after the snapshot 2024-04-12T19:42:17.978 INFO:tasks.workunit.client.0.smithi131.stdout: create 142/37 file after the snapshot 2024-04-12T19:42:17.985 INFO:tasks.workunit.client.0.smithi131.stdout: create 142/38 file after the snapshot 2024-04-12T19:42:17.994 INFO:tasks.workunit.client.0.smithi131.stdout: create 142/39 file after the snapshot 2024-04-12T19:42:18.001 INFO:tasks.workunit.client.0.smithi131.stdout: create 143/.snap/snap-subdir-test 2024-04-12T19:42:18.045 INFO:tasks.workunit.client.0.smithi131.stdout: create 143/30 file after the snapshot 2024-04-12T19:42:18.050 INFO:tasks.workunit.client.0.smithi131.stdout: create 143/31 file after the snapshot 2024-04-12T19:42:18.055 INFO:tasks.workunit.client.0.smithi131.stdout: create 143/32 file after the snapshot 2024-04-12T19:42:18.063 INFO:tasks.workunit.client.0.smithi131.stdout: create 143/33 file after the snapshot 2024-04-12T19:42:18.071 INFO:tasks.workunit.client.0.smithi131.stdout: create 143/34 file after the snapshot 2024-04-12T19:42:18.078 INFO:tasks.workunit.client.0.smithi131.stdout: create 143/35 file after the snapshot 2024-04-12T19:42:18.087 INFO:tasks.workunit.client.0.smithi131.stdout: create 143/36 file after the snapshot 2024-04-12T19:42:18.095 INFO:tasks.workunit.client.0.smithi131.stdout: create 143/37 file after the snapshot 2024-04-12T19:42:18.102 INFO:tasks.workunit.client.0.smithi131.stdout: create 143/38 file after the snapshot 2024-04-12T19:42:18.110 INFO:tasks.workunit.client.0.smithi131.stdout: create 143/39 file after the snapshot 2024-04-12T19:42:18.118 INFO:tasks.workunit.client.0.smithi131.stdout: create 144/.snap/snap-subdir-test 2024-04-12T19:42:18.182 INFO:tasks.workunit.client.0.smithi131.stdout: create 144/30 file after the snapshot 2024-04-12T19:42:18.219 INFO:tasks.workunit.client.0.smithi131.stdout: create 144/31 file after the snapshot 2024-04-12T19:42:18.226 INFO:tasks.workunit.client.0.smithi131.stdout: create 144/32 file after the snapshot 2024-04-12T19:42:18.233 INFO:tasks.workunit.client.0.smithi131.stdout: create 144/33 file after the snapshot 2024-04-12T19:42:18.240 INFO:tasks.workunit.client.0.smithi131.stdout: create 144/34 file after the snapshot 2024-04-12T19:42:18.247 INFO:tasks.workunit.client.0.smithi131.stdout: create 144/35 file after the snapshot 2024-04-12T19:42:18.255 INFO:tasks.workunit.client.0.smithi131.stdout: create 144/36 file after the snapshot 2024-04-12T19:42:18.263 INFO:tasks.workunit.client.0.smithi131.stdout: create 144/37 file after the snapshot 2024-04-12T19:42:18.271 INFO:tasks.workunit.client.0.smithi131.stdout: create 144/38 file after the snapshot 2024-04-12T19:42:18.280 INFO:tasks.workunit.client.0.smithi131.stdout: create 144/39 file after the snapshot 2024-04-12T19:42:18.288 INFO:tasks.workunit.client.0.smithi131.stdout: create 145/.snap/snap-subdir-test 2024-04-12T19:42:18.381 INFO:tasks.workunit.client.0.smithi131.stdout: create 145/30 file after the snapshot 2024-04-12T19:42:18.386 INFO:tasks.workunit.client.0.smithi131.stdout: create 145/31 file after the snapshot 2024-04-12T19:42:18.393 INFO:tasks.workunit.client.0.smithi131.stdout: create 145/32 file after the snapshot 2024-04-12T19:42:18.400 INFO:tasks.workunit.client.0.smithi131.stdout: create 145/33 file after the snapshot 2024-04-12T19:42:18.408 INFO:tasks.workunit.client.0.smithi131.stdout: create 145/34 file after the snapshot 2024-04-12T19:42:18.416 INFO:tasks.workunit.client.0.smithi131.stdout: create 145/35 file after the snapshot 2024-04-12T19:42:18.424 INFO:tasks.workunit.client.0.smithi131.stdout: create 145/36 file after the snapshot 2024-04-12T19:42:18.431 INFO:tasks.workunit.client.0.smithi131.stdout: create 145/37 file after the snapshot 2024-04-12T19:42:18.439 INFO:tasks.workunit.client.0.smithi131.stdout: create 145/38 file after the snapshot 2024-04-12T19:42:18.447 INFO:tasks.workunit.client.0.smithi131.stdout: create 145/39 file after the snapshot 2024-04-12T19:42:18.454 INFO:tasks.workunit.client.0.smithi131.stdout: create 146/.snap/snap-subdir-test 2024-04-12T19:42:18.491 INFO:tasks.workunit.client.0.smithi131.stdout: create 146/30 file after the snapshot 2024-04-12T19:42:18.497 INFO:tasks.workunit.client.0.smithi131.stdout: create 146/31 file after the snapshot 2024-04-12T19:42:18.504 INFO:tasks.workunit.client.0.smithi131.stdout: create 146/32 file after the snapshot 2024-04-12T19:42:18.513 INFO:tasks.workunit.client.0.smithi131.stdout: create 146/33 file after the snapshot 2024-04-12T19:42:18.521 INFO:tasks.workunit.client.0.smithi131.stdout: create 146/34 file after the snapshot 2024-04-12T19:42:18.529 INFO:tasks.workunit.client.0.smithi131.stdout: create 146/35 file after the snapshot 2024-04-12T19:42:18.536 INFO:tasks.workunit.client.0.smithi131.stdout: create 146/36 file after the snapshot 2024-04-12T19:42:18.544 INFO:tasks.workunit.client.0.smithi131.stdout: create 146/37 file after the snapshot 2024-04-12T19:42:18.552 INFO:tasks.workunit.client.0.smithi131.stdout: create 146/38 file after the snapshot 2024-04-12T19:42:18.560 INFO:tasks.workunit.client.0.smithi131.stdout: create 146/39 file after the snapshot 2024-04-12T19:42:18.567 INFO:tasks.workunit.client.0.smithi131.stdout: create 147/.snap/snap-subdir-test 2024-04-12T19:42:18.614 INFO:tasks.workunit.client.0.smithi131.stdout: create 147/30 file after the snapshot 2024-04-12T19:42:18.620 INFO:tasks.workunit.client.0.smithi131.stdout: create 147/31 file after the snapshot 2024-04-12T19:42:18.627 INFO:tasks.workunit.client.0.smithi131.stdout: create 147/32 file after the snapshot 2024-04-12T19:42:18.635 INFO:tasks.workunit.client.0.smithi131.stdout: create 147/33 file after the snapshot 2024-04-12T19:42:18.643 INFO:tasks.workunit.client.0.smithi131.stdout: create 147/34 file after the snapshot 2024-04-12T19:42:18.650 INFO:tasks.workunit.client.0.smithi131.stdout: create 147/35 file after the snapshot 2024-04-12T19:42:18.659 INFO:tasks.workunit.client.0.smithi131.stdout: create 147/36 file after the snapshot 2024-04-12T19:42:18.667 INFO:tasks.workunit.client.0.smithi131.stdout: create 147/37 file after the snapshot 2024-04-12T19:42:18.675 INFO:tasks.workunit.client.0.smithi131.stdout: create 147/38 file after the snapshot 2024-04-12T19:42:18.683 INFO:tasks.workunit.client.0.smithi131.stdout: create 147/39 file after the snapshot 2024-04-12T19:42:18.690 INFO:tasks.workunit.client.0.smithi131.stdout: create 148/.snap/snap-subdir-test 2024-04-12T19:42:18.729 INFO:tasks.workunit.client.0.smithi131.stdout: create 148/30 file after the snapshot 2024-04-12T19:42:18.735 INFO:tasks.workunit.client.0.smithi131.stdout: create 148/31 file after the snapshot 2024-04-12T19:42:18.742 INFO:tasks.workunit.client.0.smithi131.stdout: create 148/32 file after the snapshot 2024-04-12T19:42:18.749 INFO:tasks.workunit.client.0.smithi131.stdout: create 148/33 file after the snapshot 2024-04-12T19:42:18.757 INFO:tasks.workunit.client.0.smithi131.stdout: create 148/34 file after the snapshot 2024-04-12T19:42:18.765 INFO:tasks.workunit.client.0.smithi131.stdout: create 148/35 file after the snapshot 2024-04-12T19:42:18.773 INFO:tasks.workunit.client.0.smithi131.stdout: create 148/36 file after the snapshot 2024-04-12T19:42:18.780 INFO:tasks.workunit.client.0.smithi131.stdout: create 148/37 file after the snapshot 2024-04-12T19:42:18.787 INFO:tasks.workunit.client.0.smithi131.stdout: create 148/38 file after the snapshot 2024-04-12T19:42:18.794 INFO:tasks.workunit.client.0.smithi131.stdout: create 148/39 file after the snapshot 2024-04-12T19:42:18.802 INFO:tasks.workunit.client.0.smithi131.stdout: create 149/.snap/snap-subdir-test 2024-04-12T19:42:18.845 INFO:tasks.workunit.client.0.smithi131.stdout: create 149/30 file after the snapshot 2024-04-12T19:42:18.850 INFO:tasks.workunit.client.0.smithi131.stdout: create 149/31 file after the snapshot 2024-04-12T19:42:18.857 INFO:tasks.workunit.client.0.smithi131.stdout: create 149/32 file after the snapshot 2024-04-12T19:42:18.864 INFO:tasks.workunit.client.0.smithi131.stdout: create 149/33 file after the snapshot 2024-04-12T19:42:18.871 INFO:tasks.workunit.client.0.smithi131.stdout: create 149/34 file after the snapshot 2024-04-12T19:42:18.880 INFO:tasks.workunit.client.0.smithi131.stdout: create 149/35 file after the snapshot 2024-04-12T19:42:18.887 INFO:tasks.workunit.client.0.smithi131.stdout: create 149/36 file after the snapshot 2024-04-12T19:42:18.895 INFO:tasks.workunit.client.0.smithi131.stdout: create 149/37 file after the snapshot 2024-04-12T19:42:18.903 INFO:tasks.workunit.client.0.smithi131.stdout: create 149/38 file after the snapshot 2024-04-12T19:42:18.911 INFO:tasks.workunit.client.0.smithi131.stdout: create 149/39 file after the snapshot 2024-04-12T19:42:18.919 INFO:tasks.workunit.client.0.smithi131.stdout: create 150/.snap/snap-subdir-test 2024-04-12T19:42:18.958 INFO:tasks.workunit.client.0.smithi131.stdout: create 150/30 file after the snapshot 2024-04-12T19:42:18.964 INFO:tasks.workunit.client.0.smithi131.stdout: create 150/31 file after the snapshot 2024-04-12T19:42:18.971 INFO:tasks.workunit.client.0.smithi131.stdout: create 150/32 file after the snapshot 2024-04-12T19:42:18.978 INFO:tasks.workunit.client.0.smithi131.stdout: create 150/33 file after the snapshot 2024-04-12T19:42:18.985 INFO:tasks.workunit.client.0.smithi131.stdout: create 150/34 file after the snapshot 2024-04-12T19:42:18.993 INFO:tasks.workunit.client.0.smithi131.stdout: create 150/35 file after the snapshot 2024-04-12T19:42:19.000 INFO:tasks.workunit.client.0.smithi131.stdout: create 150/36 file after the snapshot 2024-04-12T19:42:19.008 INFO:tasks.workunit.client.0.smithi131.stdout: create 150/37 file after the snapshot 2024-04-12T19:42:19.016 INFO:tasks.workunit.client.0.smithi131.stdout: create 150/38 file after the snapshot 2024-04-12T19:42:19.022 INFO:tasks.workunit.client.0.smithi131.stdout: create 150/39 file after the snapshot 2024-04-12T19:42:19.029 INFO:tasks.workunit.client.0.smithi131.stdout: create 151/.snap/snap-subdir-test 2024-04-12T19:42:19.069 INFO:tasks.workunit.client.0.smithi131.stdout: create 151/30 file after the snapshot 2024-04-12T19:42:19.075 INFO:tasks.workunit.client.0.smithi131.stdout: create 151/31 file after the snapshot 2024-04-12T19:42:19.083 INFO:tasks.workunit.client.0.smithi131.stdout: create 151/32 file after the snapshot 2024-04-12T19:42:19.092 INFO:tasks.workunit.client.0.smithi131.stdout: create 151/33 file after the snapshot 2024-04-12T19:42:19.100 INFO:tasks.workunit.client.0.smithi131.stdout: create 151/34 file after the snapshot 2024-04-12T19:42:19.108 INFO:tasks.workunit.client.0.smithi131.stdout: create 151/35 file after the snapshot 2024-04-12T19:42:19.116 INFO:tasks.workunit.client.0.smithi131.stdout: create 151/36 file after the snapshot 2024-04-12T19:42:19.124 INFO:tasks.workunit.client.0.smithi131.stdout: create 151/37 file after the snapshot 2024-04-12T19:42:19.131 INFO:tasks.workunit.client.0.smithi131.stdout: create 151/38 file after the snapshot 2024-04-12T19:42:19.139 INFO:tasks.workunit.client.0.smithi131.stdout: create 151/39 file after the snapshot 2024-04-12T19:42:19.147 INFO:tasks.workunit.client.0.smithi131.stdout: create 152/.snap/snap-subdir-test 2024-04-12T19:42:19.303 INFO:tasks.workunit.client.0.smithi131.stdout: create 152/30 file after the snapshot 2024-04-12T19:42:19.308 INFO:tasks.workunit.client.0.smithi131.stdout: create 152/31 file after the snapshot 2024-04-12T19:42:19.315 INFO:tasks.workunit.client.0.smithi131.stdout: create 152/32 file after the snapshot 2024-04-12T19:42:19.323 INFO:tasks.workunit.client.0.smithi131.stdout: create 152/33 file after the snapshot 2024-04-12T19:42:19.331 INFO:tasks.workunit.client.0.smithi131.stdout: create 152/34 file after the snapshot 2024-04-12T19:42:19.339 INFO:tasks.workunit.client.0.smithi131.stdout: create 152/35 file after the snapshot 2024-04-12T19:42:19.347 INFO:tasks.workunit.client.0.smithi131.stdout: create 152/36 file after the snapshot 2024-04-12T19:42:19.354 INFO:tasks.workunit.client.0.smithi131.stdout: create 152/37 file after the snapshot 2024-04-12T19:42:19.362 INFO:tasks.workunit.client.0.smithi131.stdout: create 152/38 file after the snapshot 2024-04-12T19:42:19.370 INFO:tasks.workunit.client.0.smithi131.stdout: create 152/39 file after the snapshot 2024-04-12T19:42:19.377 INFO:tasks.workunit.client.0.smithi131.stdout: create 153/.snap/snap-subdir-test 2024-04-12T19:42:19.419 INFO:tasks.workunit.client.0.smithi131.stdout: create 153/30 file after the snapshot 2024-04-12T19:42:19.426 INFO:tasks.workunit.client.0.smithi131.stdout: create 153/31 file after the snapshot 2024-04-12T19:42:19.434 INFO:tasks.workunit.client.0.smithi131.stdout: create 153/32 file after the snapshot 2024-04-12T19:42:19.441 INFO:tasks.workunit.client.0.smithi131.stdout: create 153/33 file after the snapshot 2024-04-12T19:42:19.449 INFO:tasks.workunit.client.0.smithi131.stdout: create 153/34 file after the snapshot 2024-04-12T19:42:19.455 INFO:tasks.workunit.client.0.smithi131.stdout: create 153/35 file after the snapshot 2024-04-12T19:42:19.462 INFO:tasks.workunit.client.0.smithi131.stdout: create 153/36 file after the snapshot 2024-04-12T19:42:19.469 INFO:tasks.workunit.client.0.smithi131.stdout: create 153/37 file after the snapshot 2024-04-12T19:42:19.476 INFO:tasks.workunit.client.0.smithi131.stdout: create 153/38 file after the snapshot 2024-04-12T19:42:19.483 INFO:tasks.workunit.client.0.smithi131.stdout: create 153/39 file after the snapshot 2024-04-12T19:42:19.492 INFO:tasks.workunit.client.0.smithi131.stdout: create 154/.snap/snap-subdir-test 2024-04-12T19:42:19.534 INFO:tasks.workunit.client.0.smithi131.stdout: create 154/30 file after the snapshot 2024-04-12T19:42:19.540 INFO:tasks.workunit.client.0.smithi131.stdout: create 154/31 file after the snapshot 2024-04-12T19:42:19.548 INFO:tasks.workunit.client.0.smithi131.stdout: create 154/32 file after the snapshot 2024-04-12T19:42:19.555 INFO:tasks.workunit.client.0.smithi131.stdout: create 154/33 file after the snapshot 2024-04-12T19:42:19.563 INFO:tasks.workunit.client.0.smithi131.stdout: create 154/34 file after the snapshot 2024-04-12T19:42:19.570 INFO:tasks.workunit.client.0.smithi131.stdout: create 154/35 file after the snapshot 2024-04-12T19:42:19.578 INFO:tasks.workunit.client.0.smithi131.stdout: create 154/36 file after the snapshot 2024-04-12T19:42:19.585 INFO:tasks.workunit.client.0.smithi131.stdout: create 154/37 file after the snapshot 2024-04-12T19:42:19.592 INFO:tasks.workunit.client.0.smithi131.stdout: create 154/38 file after the snapshot 2024-04-12T19:42:19.599 INFO:tasks.workunit.client.0.smithi131.stdout: create 154/39 file after the snapshot 2024-04-12T19:42:19.607 INFO:tasks.workunit.client.0.smithi131.stdout: create 155/.snap/snap-subdir-test 2024-04-12T19:42:19.647 INFO:tasks.workunit.client.0.smithi131.stdout: create 155/30 file after the snapshot 2024-04-12T19:42:19.652 INFO:tasks.workunit.client.0.smithi131.stdout: create 155/31 file after the snapshot 2024-04-12T19:42:19.660 INFO:tasks.workunit.client.0.smithi131.stdout: create 155/32 file after the snapshot 2024-04-12T19:42:19.669 INFO:tasks.workunit.client.0.smithi131.stdout: create 155/33 file after the snapshot 2024-04-12T19:42:19.677 INFO:tasks.workunit.client.0.smithi131.stdout: create 155/34 file after the snapshot 2024-04-12T19:42:19.684 INFO:tasks.workunit.client.0.smithi131.stdout: create 155/35 file after the snapshot 2024-04-12T19:42:19.693 INFO:tasks.workunit.client.0.smithi131.stdout: create 155/36 file after the snapshot 2024-04-12T19:42:19.701 INFO:tasks.workunit.client.0.smithi131.stdout: create 155/37 file after the snapshot 2024-04-12T19:42:19.708 INFO:tasks.workunit.client.0.smithi131.stdout: create 155/38 file after the snapshot 2024-04-12T19:42:19.715 INFO:tasks.workunit.client.0.smithi131.stdout: create 155/39 file after the snapshot 2024-04-12T19:42:19.722 INFO:tasks.workunit.client.0.smithi131.stdout: create 156/.snap/snap-subdir-test 2024-04-12T19:42:19.765 INFO:tasks.workunit.client.0.smithi131.stdout: create 156/30 file after the snapshot 2024-04-12T19:42:19.771 INFO:tasks.workunit.client.0.smithi131.stdout: create 156/31 file after the snapshot 2024-04-12T19:42:19.778 INFO:tasks.workunit.client.0.smithi131.stdout: create 156/32 file after the snapshot 2024-04-12T19:42:19.785 INFO:tasks.workunit.client.0.smithi131.stdout: create 156/33 file after the snapshot 2024-04-12T19:42:19.793 INFO:tasks.workunit.client.0.smithi131.stdout: create 156/34 file after the snapshot 2024-04-12T19:42:19.801 INFO:tasks.workunit.client.0.smithi131.stdout: create 156/35 file after the snapshot 2024-04-12T19:42:19.809 INFO:tasks.workunit.client.0.smithi131.stdout: create 156/36 file after the snapshot 2024-04-12T19:42:19.816 INFO:tasks.workunit.client.0.smithi131.stdout: create 156/37 file after the snapshot 2024-04-12T19:42:19.825 INFO:tasks.workunit.client.0.smithi131.stdout: create 156/38 file after the snapshot 2024-04-12T19:42:19.833 INFO:tasks.workunit.client.0.smithi131.stdout: create 156/39 file after the snapshot 2024-04-12T19:42:19.842 INFO:tasks.workunit.client.0.smithi131.stdout: create 157/.snap/snap-subdir-test 2024-04-12T19:42:19.882 INFO:tasks.workunit.client.0.smithi131.stdout: create 157/30 file after the snapshot 2024-04-12T19:42:19.888 INFO:tasks.workunit.client.0.smithi131.stdout: create 157/31 file after the snapshot 2024-04-12T19:42:19.895 INFO:tasks.workunit.client.0.smithi131.stdout: create 157/32 file after the snapshot 2024-04-12T19:42:19.903 INFO:tasks.workunit.client.0.smithi131.stdout: create 157/33 file after the snapshot 2024-04-12T19:42:19.911 INFO:tasks.workunit.client.0.smithi131.stdout: create 157/34 file after the snapshot 2024-04-12T19:42:19.919 INFO:tasks.workunit.client.0.smithi131.stdout: create 157/35 file after the snapshot 2024-04-12T19:42:19.927 INFO:tasks.workunit.client.0.smithi131.stdout: create 157/36 file after the snapshot 2024-04-12T19:42:19.935 INFO:tasks.workunit.client.0.smithi131.stdout: create 157/37 file after the snapshot 2024-04-12T19:42:19.944 INFO:tasks.workunit.client.0.smithi131.stdout: create 157/38 file after the snapshot 2024-04-12T19:42:19.952 INFO:tasks.workunit.client.0.smithi131.stdout: create 157/39 file after the snapshot 2024-04-12T19:42:19.960 INFO:tasks.workunit.client.0.smithi131.stdout: create 158/.snap/snap-subdir-test 2024-04-12T19:42:20.009 INFO:tasks.workunit.client.0.smithi131.stdout: create 158/30 file after the snapshot 2024-04-12T19:42:20.015 INFO:tasks.workunit.client.0.smithi131.stdout: create 158/31 file after the snapshot 2024-04-12T19:42:20.023 INFO:tasks.workunit.client.0.smithi131.stdout: create 158/32 file after the snapshot 2024-04-12T19:42:20.029 INFO:tasks.workunit.client.0.smithi131.stdout: create 158/33 file after the snapshot 2024-04-12T19:42:20.034 INFO:tasks.workunit.client.0.smithi131.stdout: create 158/34 file after the snapshot 2024-04-12T19:42:20.042 INFO:tasks.workunit.client.0.smithi131.stdout: create 158/35 file after the snapshot 2024-04-12T19:42:20.050 INFO:tasks.workunit.client.0.smithi131.stdout: create 158/36 file after the snapshot 2024-04-12T19:42:20.057 INFO:tasks.workunit.client.0.smithi131.stdout: create 158/37 file after the snapshot 2024-04-12T19:42:20.066 INFO:tasks.workunit.client.0.smithi131.stdout: create 158/38 file after the snapshot 2024-04-12T19:42:20.073 INFO:tasks.workunit.client.0.smithi131.stdout: create 158/39 file after the snapshot 2024-04-12T19:42:20.079 INFO:tasks.workunit.client.0.smithi131.stdout: create 159/.snap/snap-subdir-test 2024-04-12T19:42:20.120 INFO:tasks.workunit.client.0.smithi131.stdout: create 159/30 file after the snapshot 2024-04-12T19:42:20.125 INFO:tasks.workunit.client.0.smithi131.stdout: create 159/31 file after the snapshot 2024-04-12T19:42:20.133 INFO:tasks.workunit.client.0.smithi131.stdout: create 159/32 file after the snapshot 2024-04-12T19:42:20.143 INFO:tasks.workunit.client.0.smithi131.stdout: create 159/33 file after the snapshot 2024-04-12T19:42:20.152 INFO:tasks.workunit.client.0.smithi131.stdout: create 159/34 file after the snapshot 2024-04-12T19:42:20.159 INFO:tasks.workunit.client.0.smithi131.stdout: create 159/35 file after the snapshot 2024-04-12T19:42:20.179 INFO:tasks.workunit.client.0.smithi131.stdout: create 159/36 file after the snapshot 2024-04-12T19:42:20.213 INFO:tasks.workunit.client.0.smithi131.stdout: create 159/37 file after the snapshot 2024-04-12T19:42:20.220 INFO:tasks.workunit.client.0.smithi131.stdout: create 159/38 file after the snapshot 2024-04-12T19:42:20.227 INFO:tasks.workunit.client.0.smithi131.stdout: create 159/39 file after the snapshot 2024-04-12T19:42:20.234 INFO:tasks.workunit.client.0.smithi131.stdout: create 160/.snap/snap-subdir-test 2024-04-12T19:42:20.310 INFO:tasks.workunit.client.0.smithi131.stdout: create 160/30 file after the snapshot 2024-04-12T19:42:20.316 INFO:tasks.workunit.client.0.smithi131.stdout: create 160/31 file after the snapshot 2024-04-12T19:42:20.324 INFO:tasks.workunit.client.0.smithi131.stdout: create 160/32 file after the snapshot 2024-04-12T19:42:20.333 INFO:tasks.workunit.client.0.smithi131.stdout: create 160/33 file after the snapshot 2024-04-12T19:42:20.340 INFO:tasks.workunit.client.0.smithi131.stdout: create 160/34 file after the snapshot 2024-04-12T19:42:20.348 INFO:tasks.workunit.client.0.smithi131.stdout: create 160/35 file after the snapshot 2024-04-12T19:42:20.355 INFO:tasks.workunit.client.0.smithi131.stdout: create 160/36 file after the snapshot 2024-04-12T19:42:20.363 INFO:tasks.workunit.client.0.smithi131.stdout: create 160/37 file after the snapshot 2024-04-12T19:42:20.372 INFO:tasks.workunit.client.0.smithi131.stdout: create 160/38 file after the snapshot 2024-04-12T19:42:20.380 INFO:tasks.workunit.client.0.smithi131.stdout: create 160/39 file after the snapshot 2024-04-12T19:42:20.388 INFO:tasks.workunit.client.0.smithi131.stdout: create 161/.snap/snap-subdir-test 2024-04-12T19:42:20.436 INFO:tasks.workunit.client.0.smithi131.stdout: create 161/30 file after the snapshot 2024-04-12T19:42:20.442 INFO:tasks.workunit.client.0.smithi131.stdout: create 161/31 file after the snapshot 2024-04-12T19:42:20.449 INFO:tasks.workunit.client.0.smithi131.stdout: create 161/32 file after the snapshot 2024-04-12T19:42:20.457 INFO:tasks.workunit.client.0.smithi131.stdout: create 161/33 file after the snapshot 2024-04-12T19:42:20.464 INFO:tasks.workunit.client.0.smithi131.stdout: create 161/34 file after the snapshot 2024-04-12T19:42:20.472 INFO:tasks.workunit.client.0.smithi131.stdout: create 161/35 file after the snapshot 2024-04-12T19:42:20.481 INFO:tasks.workunit.client.0.smithi131.stdout: create 161/36 file after the snapshot 2024-04-12T19:42:20.489 INFO:tasks.workunit.client.0.smithi131.stdout: create 161/37 file after the snapshot 2024-04-12T19:42:20.496 INFO:tasks.workunit.client.0.smithi131.stdout: create 161/38 file after the snapshot 2024-04-12T19:42:20.503 INFO:tasks.workunit.client.0.smithi131.stdout: create 161/39 file after the snapshot 2024-04-12T19:42:20.511 INFO:tasks.workunit.client.0.smithi131.stdout: create 162/.snap/snap-subdir-test 2024-04-12T19:42:20.555 INFO:tasks.workunit.client.0.smithi131.stdout: create 162/30 file after the snapshot 2024-04-12T19:42:20.561 INFO:tasks.workunit.client.0.smithi131.stdout: create 162/31 file after the snapshot 2024-04-12T19:42:20.568 INFO:tasks.workunit.client.0.smithi131.stdout: create 162/32 file after the snapshot 2024-04-12T19:42:20.575 INFO:tasks.workunit.client.0.smithi131.stdout: create 162/33 file after the snapshot 2024-04-12T19:42:20.584 INFO:tasks.workunit.client.0.smithi131.stdout: create 162/34 file after the snapshot 2024-04-12T19:42:20.592 INFO:tasks.workunit.client.0.smithi131.stdout: create 162/35 file after the snapshot 2024-04-12T19:42:20.600 INFO:tasks.workunit.client.0.smithi131.stdout: create 162/36 file after the snapshot 2024-04-12T19:42:20.607 INFO:tasks.workunit.client.0.smithi131.stdout: create 162/37 file after the snapshot 2024-04-12T19:42:20.615 INFO:tasks.workunit.client.0.smithi131.stdout: create 162/38 file after the snapshot 2024-04-12T19:42:20.622 INFO:tasks.workunit.client.0.smithi131.stdout: create 162/39 file after the snapshot 2024-04-12T19:42:20.630 INFO:tasks.workunit.client.0.smithi131.stdout: create 163/.snap/snap-subdir-test 2024-04-12T19:42:20.674 INFO:tasks.workunit.client.0.smithi131.stdout: create 163/30 file after the snapshot 2024-04-12T19:42:20.679 INFO:tasks.workunit.client.0.smithi131.stdout: create 163/31 file after the snapshot 2024-04-12T19:42:20.687 INFO:tasks.workunit.client.0.smithi131.stdout: create 163/32 file after the snapshot 2024-04-12T19:42:20.695 INFO:tasks.workunit.client.0.smithi131.stdout: create 163/33 file after the snapshot 2024-04-12T19:42:20.703 INFO:tasks.workunit.client.0.smithi131.stdout: create 163/34 file after the snapshot 2024-04-12T19:42:20.710 INFO:tasks.workunit.client.0.smithi131.stdout: create 163/35 file after the snapshot 2024-04-12T19:42:20.718 INFO:tasks.workunit.client.0.smithi131.stdout: create 163/36 file after the snapshot 2024-04-12T19:42:20.725 INFO:tasks.workunit.client.0.smithi131.stdout: create 163/37 file after the snapshot 2024-04-12T19:42:20.733 INFO:tasks.workunit.client.0.smithi131.stdout: create 163/38 file after the snapshot 2024-04-12T19:42:20.740 INFO:tasks.workunit.client.0.smithi131.stdout: create 163/39 file after the snapshot 2024-04-12T19:42:20.747 INFO:tasks.workunit.client.0.smithi131.stdout: create 164/.snap/snap-subdir-test 2024-04-12T19:42:20.789 INFO:tasks.workunit.client.0.smithi131.stdout: create 164/30 file after the snapshot 2024-04-12T19:42:20.794 INFO:tasks.workunit.client.0.smithi131.stdout: create 164/31 file after the snapshot 2024-04-12T19:42:20.801 INFO:tasks.workunit.client.0.smithi131.stdout: create 164/32 file after the snapshot 2024-04-12T19:42:20.810 INFO:tasks.workunit.client.0.smithi131.stdout: create 164/33 file after the snapshot 2024-04-12T19:42:20.818 INFO:tasks.workunit.client.0.smithi131.stdout: create 164/34 file after the snapshot 2024-04-12T19:42:20.825 INFO:tasks.workunit.client.0.smithi131.stdout: create 164/35 file after the snapshot 2024-04-12T19:42:20.832 INFO:tasks.workunit.client.0.smithi131.stdout: create 164/36 file after the snapshot 2024-04-12T19:42:20.839 INFO:tasks.workunit.client.0.smithi131.stdout: create 164/37 file after the snapshot 2024-04-12T19:42:20.847 INFO:tasks.workunit.client.0.smithi131.stdout: create 164/38 file after the snapshot 2024-04-12T19:42:20.855 INFO:tasks.workunit.client.0.smithi131.stdout: create 164/39 file after the snapshot 2024-04-12T19:42:20.863 INFO:tasks.workunit.client.0.smithi131.stdout: create 165/.snap/snap-subdir-test 2024-04-12T19:42:20.907 INFO:tasks.workunit.client.0.smithi131.stdout: create 165/30 file after the snapshot 2024-04-12T19:42:20.913 INFO:tasks.workunit.client.0.smithi131.stdout: create 165/31 file after the snapshot 2024-04-12T19:42:20.921 INFO:tasks.workunit.client.0.smithi131.stdout: create 165/32 file after the snapshot 2024-04-12T19:42:20.929 INFO:tasks.workunit.client.0.smithi131.stdout: create 165/33 file after the snapshot 2024-04-12T19:42:20.937 INFO:tasks.workunit.client.0.smithi131.stdout: create 165/34 file after the snapshot 2024-04-12T19:42:20.944 INFO:tasks.workunit.client.0.smithi131.stdout: create 165/35 file after the snapshot 2024-04-12T19:42:20.952 INFO:tasks.workunit.client.0.smithi131.stdout: create 165/36 file after the snapshot 2024-04-12T19:42:20.960 INFO:tasks.workunit.client.0.smithi131.stdout: create 165/37 file after the snapshot 2024-04-12T19:42:20.967 INFO:tasks.workunit.client.0.smithi131.stdout: create 165/38 file after the snapshot 2024-04-12T19:42:20.975 INFO:tasks.workunit.client.0.smithi131.stdout: create 165/39 file after the snapshot 2024-04-12T19:42:20.983 INFO:tasks.workunit.client.0.smithi131.stdout: create 166/.snap/snap-subdir-test 2024-04-12T19:42:21.026 INFO:tasks.workunit.client.0.smithi131.stdout: create 166/30 file after the snapshot 2024-04-12T19:42:21.030 INFO:tasks.workunit.client.0.smithi131.stdout: create 166/31 file after the snapshot 2024-04-12T19:42:21.037 INFO:tasks.workunit.client.0.smithi131.stdout: create 166/32 file after the snapshot 2024-04-12T19:42:21.045 INFO:tasks.workunit.client.0.smithi131.stdout: create 166/33 file after the snapshot 2024-04-12T19:42:21.053 INFO:tasks.workunit.client.0.smithi131.stdout: create 166/34 file after the snapshot 2024-04-12T19:42:21.061 INFO:tasks.workunit.client.0.smithi131.stdout: create 166/35 file after the snapshot 2024-04-12T19:42:21.067 INFO:tasks.workunit.client.0.smithi131.stdout: create 166/36 file after the snapshot 2024-04-12T19:42:21.075 INFO:tasks.workunit.client.0.smithi131.stdout: create 166/37 file after the snapshot 2024-04-12T19:42:21.083 INFO:tasks.workunit.client.0.smithi131.stdout: create 166/38 file after the snapshot 2024-04-12T19:42:21.090 INFO:tasks.workunit.client.0.smithi131.stdout: create 166/39 file after the snapshot 2024-04-12T19:42:21.097 INFO:tasks.workunit.client.0.smithi131.stdout: create 167/.snap/snap-subdir-test 2024-04-12T19:42:21.138 INFO:tasks.workunit.client.0.smithi131.stdout: create 167/30 file after the snapshot 2024-04-12T19:42:21.144 INFO:tasks.workunit.client.0.smithi131.stdout: create 167/31 file after the snapshot 2024-04-12T19:42:21.151 INFO:tasks.workunit.client.0.smithi131.stdout: create 167/32 file after the snapshot 2024-04-12T19:42:21.158 INFO:tasks.workunit.client.0.smithi131.stdout: create 167/33 file after the snapshot 2024-04-12T19:42:21.167 INFO:tasks.workunit.client.0.smithi131.stdout: create 167/34 file after the snapshot 2024-04-12T19:42:21.175 INFO:tasks.workunit.client.0.smithi131.stdout: create 167/35 file after the snapshot 2024-04-12T19:42:21.189 INFO:tasks.workunit.client.0.smithi131.stdout: create 167/36 file after the snapshot 2024-04-12T19:42:21.246 INFO:tasks.workunit.client.0.smithi131.stdout: create 167/37 file after the snapshot 2024-04-12T19:42:21.253 INFO:tasks.workunit.client.0.smithi131.stdout: create 167/38 file after the snapshot 2024-04-12T19:42:21.260 INFO:tasks.workunit.client.0.smithi131.stdout: create 167/39 file after the snapshot 2024-04-12T19:42:21.267 INFO:tasks.workunit.client.0.smithi131.stdout: create 168/.snap/snap-subdir-test 2024-04-12T19:42:21.350 INFO:tasks.workunit.client.0.smithi131.stdout: create 168/30 file after the snapshot 2024-04-12T19:42:21.355 INFO:tasks.workunit.client.0.smithi131.stdout: create 168/31 file after the snapshot 2024-04-12T19:42:21.361 INFO:tasks.workunit.client.0.smithi131.stdout: create 168/32 file after the snapshot 2024-04-12T19:42:21.369 INFO:tasks.workunit.client.0.smithi131.stdout: create 168/33 file after the snapshot 2024-04-12T19:42:21.376 INFO:tasks.workunit.client.0.smithi131.stdout: create 168/34 file after the snapshot 2024-04-12T19:42:21.384 INFO:tasks.workunit.client.0.smithi131.stdout: create 168/35 file after the snapshot 2024-04-12T19:42:21.392 INFO:tasks.workunit.client.0.smithi131.stdout: create 168/36 file after the snapshot 2024-04-12T19:42:21.399 INFO:tasks.workunit.client.0.smithi131.stdout: create 168/37 file after the snapshot 2024-04-12T19:42:21.407 INFO:tasks.workunit.client.0.smithi131.stdout: create 168/38 file after the snapshot 2024-04-12T19:42:21.414 INFO:tasks.workunit.client.0.smithi131.stdout: create 168/39 file after the snapshot 2024-04-12T19:42:21.422 INFO:tasks.workunit.client.0.smithi131.stdout: create 169/.snap/snap-subdir-test 2024-04-12T19:42:21.466 INFO:tasks.workunit.client.0.smithi131.stdout: create 169/30 file after the snapshot 2024-04-12T19:42:21.473 INFO:tasks.workunit.client.0.smithi131.stdout: create 169/31 file after the snapshot 2024-04-12T19:42:21.481 INFO:tasks.workunit.client.0.smithi131.stdout: create 169/32 file after the snapshot 2024-04-12T19:42:21.489 INFO:tasks.workunit.client.0.smithi131.stdout: create 169/33 file after the snapshot 2024-04-12T19:42:21.497 INFO:tasks.workunit.client.0.smithi131.stdout: create 169/34 file after the snapshot 2024-04-12T19:42:21.506 INFO:tasks.workunit.client.0.smithi131.stdout: create 169/35 file after the snapshot 2024-04-12T19:42:21.513 INFO:tasks.workunit.client.0.smithi131.stdout: create 169/36 file after the snapshot 2024-04-12T19:42:21.521 INFO:tasks.workunit.client.0.smithi131.stdout: create 169/37 file after the snapshot 2024-04-12T19:42:21.529 INFO:tasks.workunit.client.0.smithi131.stdout: create 169/38 file after the snapshot 2024-04-12T19:42:21.537 INFO:tasks.workunit.client.0.smithi131.stdout: create 169/39 file after the snapshot 2024-04-12T19:42:21.545 INFO:tasks.workunit.client.0.smithi131.stdout: create 170/.snap/snap-subdir-test 2024-04-12T19:42:21.586 INFO:tasks.workunit.client.0.smithi131.stdout: create 170/30 file after the snapshot 2024-04-12T19:42:21.592 INFO:tasks.workunit.client.0.smithi131.stdout: create 170/31 file after the snapshot 2024-04-12T19:42:21.599 INFO:tasks.workunit.client.0.smithi131.stdout: create 170/32 file after the snapshot 2024-04-12T19:42:21.607 INFO:tasks.workunit.client.0.smithi131.stdout: create 170/33 file after the snapshot 2024-04-12T19:42:21.614 INFO:tasks.workunit.client.0.smithi131.stdout: create 170/34 file after the snapshot 2024-04-12T19:42:21.622 INFO:tasks.workunit.client.0.smithi131.stdout: create 170/35 file after the snapshot 2024-04-12T19:42:21.631 INFO:tasks.workunit.client.0.smithi131.stdout: create 170/36 file after the snapshot 2024-04-12T19:42:21.639 INFO:tasks.workunit.client.0.smithi131.stdout: create 170/37 file after the snapshot 2024-04-12T19:42:21.646 INFO:tasks.workunit.client.0.smithi131.stdout: create 170/38 file after the snapshot 2024-04-12T19:42:21.653 INFO:tasks.workunit.client.0.smithi131.stdout: create 170/39 file after the snapshot 2024-04-12T19:42:21.660 INFO:tasks.workunit.client.0.smithi131.stdout: create 171/.snap/snap-subdir-test 2024-04-12T19:42:21.705 INFO:tasks.workunit.client.0.smithi131.stdout: create 171/30 file after the snapshot 2024-04-12T19:42:21.712 INFO:tasks.workunit.client.0.smithi131.stdout: create 171/31 file after the snapshot 2024-04-12T19:42:21.720 INFO:tasks.workunit.client.0.smithi131.stdout: create 171/32 file after the snapshot 2024-04-12T19:42:21.729 INFO:tasks.workunit.client.0.smithi131.stdout: create 171/33 file after the snapshot 2024-04-12T19:42:21.736 INFO:tasks.workunit.client.0.smithi131.stdout: create 171/34 file after the snapshot 2024-04-12T19:42:21.744 INFO:tasks.workunit.client.0.smithi131.stdout: create 171/35 file after the snapshot 2024-04-12T19:42:21.751 INFO:tasks.workunit.client.0.smithi131.stdout: create 171/36 file after the snapshot 2024-04-12T19:42:21.759 INFO:tasks.workunit.client.0.smithi131.stdout: create 171/37 file after the snapshot 2024-04-12T19:42:21.767 INFO:tasks.workunit.client.0.smithi131.stdout: create 171/38 file after the snapshot 2024-04-12T19:42:21.775 INFO:tasks.workunit.client.0.smithi131.stdout: create 171/39 file after the snapshot 2024-04-12T19:42:21.782 INFO:tasks.workunit.client.0.smithi131.stdout: create 172/.snap/snap-subdir-test 2024-04-12T19:42:21.828 INFO:tasks.workunit.client.0.smithi131.stdout: create 172/30 file after the snapshot 2024-04-12T19:42:21.834 INFO:tasks.workunit.client.0.smithi131.stdout: create 172/31 file after the snapshot 2024-04-12T19:42:21.842 INFO:tasks.workunit.client.0.smithi131.stdout: create 172/32 file after the snapshot 2024-04-12T19:42:21.850 INFO:tasks.workunit.client.0.smithi131.stdout: create 172/33 file after the snapshot 2024-04-12T19:42:21.858 INFO:tasks.workunit.client.0.smithi131.stdout: create 172/34 file after the snapshot 2024-04-12T19:42:21.866 INFO:tasks.workunit.client.0.smithi131.stdout: create 172/35 file after the snapshot 2024-04-12T19:42:21.873 INFO:tasks.workunit.client.0.smithi131.stdout: create 172/36 file after the snapshot 2024-04-12T19:42:21.882 INFO:tasks.workunit.client.0.smithi131.stdout: create 172/37 file after the snapshot 2024-04-12T19:42:21.889 INFO:tasks.workunit.client.0.smithi131.stdout: create 172/38 file after the snapshot 2024-04-12T19:42:21.896 INFO:tasks.workunit.client.0.smithi131.stdout: create 172/39 file after the snapshot 2024-04-12T19:42:21.904 INFO:tasks.workunit.client.0.smithi131.stdout: create 173/.snap/snap-subdir-test 2024-04-12T19:42:21.941 INFO:tasks.workunit.client.0.smithi131.stdout: create 173/30 file after the snapshot 2024-04-12T19:42:21.946 INFO:tasks.workunit.client.0.smithi131.stdout: create 173/31 file after the snapshot 2024-04-12T19:42:21.953 INFO:tasks.workunit.client.0.smithi131.stdout: create 173/32 file after the snapshot 2024-04-12T19:42:21.960 INFO:tasks.workunit.client.0.smithi131.stdout: create 173/33 file after the snapshot 2024-04-12T19:42:21.969 INFO:tasks.workunit.client.0.smithi131.stdout: create 173/34 file after the snapshot 2024-04-12T19:42:21.977 INFO:tasks.workunit.client.0.smithi131.stdout: create 173/35 file after the snapshot 2024-04-12T19:42:21.986 INFO:tasks.workunit.client.0.smithi131.stdout: create 173/36 file after the snapshot 2024-04-12T19:42:21.994 INFO:tasks.workunit.client.0.smithi131.stdout: create 173/37 file after the snapshot 2024-04-12T19:42:22.002 INFO:tasks.workunit.client.0.smithi131.stdout: create 173/38 file after the snapshot 2024-04-12T19:42:22.009 INFO:tasks.workunit.client.0.smithi131.stdout: create 173/39 file after the snapshot 2024-04-12T19:42:22.017 INFO:tasks.workunit.client.0.smithi131.stdout: create 174/.snap/snap-subdir-test 2024-04-12T19:42:22.057 INFO:tasks.workunit.client.0.smithi131.stdout: create 174/30 file after the snapshot 2024-04-12T19:42:22.062 INFO:tasks.workunit.client.0.smithi131.stdout: create 174/31 file after the snapshot 2024-04-12T19:42:22.070 INFO:tasks.workunit.client.0.smithi131.stdout: create 174/32 file after the snapshot 2024-04-12T19:42:22.078 INFO:tasks.workunit.client.0.smithi131.stdout: create 174/33 file after the snapshot 2024-04-12T19:42:22.086 INFO:tasks.workunit.client.0.smithi131.stdout: create 174/34 file after the snapshot 2024-04-12T19:42:22.094 INFO:tasks.workunit.client.0.smithi131.stdout: create 174/35 file after the snapshot 2024-04-12T19:42:22.103 INFO:tasks.workunit.client.0.smithi131.stdout: create 174/36 file after the snapshot 2024-04-12T19:42:22.111 INFO:tasks.workunit.client.0.smithi131.stdout: create 174/37 file after the snapshot 2024-04-12T19:42:22.120 INFO:tasks.workunit.client.0.smithi131.stdout: create 174/38 file after the snapshot 2024-04-12T19:42:22.128 INFO:tasks.workunit.client.0.smithi131.stdout: create 174/39 file after the snapshot 2024-04-12T19:42:22.136 INFO:tasks.workunit.client.0.smithi131.stdout: create 175/.snap/snap-subdir-test 2024-04-12T19:42:22.178 INFO:tasks.workunit.client.0.smithi131.stdout: create 175/30 file after the snapshot 2024-04-12T19:42:22.184 INFO:tasks.workunit.client.0.smithi131.stdout: create 175/31 file after the snapshot 2024-04-12T19:42:22.199 INFO:tasks.workunit.client.0.smithi131.stdout: create 175/32 file after the snapshot 2024-04-12T19:42:22.250 INFO:tasks.workunit.client.0.smithi131.stdout: create 175/33 file after the snapshot 2024-04-12T19:42:22.256 INFO:tasks.workunit.client.0.smithi131.stdout: create 175/34 file after the snapshot 2024-04-12T19:42:22.264 INFO:tasks.workunit.client.0.smithi131.stdout: create 175/35 file after the snapshot 2024-04-12T19:42:22.274 INFO:tasks.workunit.client.0.smithi131.stdout: create 175/36 file after the snapshot 2024-04-12T19:42:22.279 INFO:tasks.workunit.client.0.smithi131.stdout: create 175/37 file after the snapshot 2024-04-12T19:42:22.286 INFO:tasks.workunit.client.0.smithi131.stdout: create 175/38 file after the snapshot 2024-04-12T19:42:22.295 INFO:tasks.workunit.client.0.smithi131.stdout: create 175/39 file after the snapshot 2024-04-12T19:42:22.302 INFO:tasks.workunit.client.0.smithi131.stdout: create 176/.snap/snap-subdir-test 2024-04-12T19:42:22.384 INFO:tasks.workunit.client.0.smithi131.stdout: create 176/30 file after the snapshot 2024-04-12T19:42:22.390 INFO:tasks.workunit.client.0.smithi131.stdout: create 176/31 file after the snapshot 2024-04-12T19:42:22.396 INFO:tasks.workunit.client.0.smithi131.stdout: create 176/32 file after the snapshot 2024-04-12T19:42:22.405 INFO:tasks.workunit.client.0.smithi131.stdout: create 176/33 file after the snapshot 2024-04-12T19:42:22.412 INFO:tasks.workunit.client.0.smithi131.stdout: create 176/34 file after the snapshot 2024-04-12T19:42:22.420 INFO:tasks.workunit.client.0.smithi131.stdout: create 176/35 file after the snapshot 2024-04-12T19:42:22.429 INFO:tasks.workunit.client.0.smithi131.stdout: create 176/36 file after the snapshot 2024-04-12T19:42:22.436 INFO:tasks.workunit.client.0.smithi131.stdout: create 176/37 file after the snapshot 2024-04-12T19:42:22.446 INFO:tasks.workunit.client.0.smithi131.stdout: create 176/38 file after the snapshot 2024-04-12T19:42:22.454 INFO:tasks.workunit.client.0.smithi131.stdout: create 176/39 file after the snapshot 2024-04-12T19:42:22.461 INFO:tasks.workunit.client.0.smithi131.stdout: create 177/.snap/snap-subdir-test 2024-04-12T19:42:22.501 INFO:tasks.workunit.client.0.smithi131.stdout: create 177/30 file after the snapshot 2024-04-12T19:42:22.507 INFO:tasks.workunit.client.0.smithi131.stdout: create 177/31 file after the snapshot 2024-04-12T19:42:22.514 INFO:tasks.workunit.client.0.smithi131.stdout: create 177/32 file after the snapshot 2024-04-12T19:42:22.521 INFO:tasks.workunit.client.0.smithi131.stdout: create 177/33 file after the snapshot 2024-04-12T19:42:22.529 INFO:tasks.workunit.client.0.smithi131.stdout: create 177/34 file after the snapshot 2024-04-12T19:42:22.536 INFO:tasks.workunit.client.0.smithi131.stdout: create 177/35 file after the snapshot 2024-04-12T19:42:22.543 INFO:tasks.workunit.client.0.smithi131.stdout: create 177/36 file after the snapshot 2024-04-12T19:42:22.551 INFO:tasks.workunit.client.0.smithi131.stdout: create 177/37 file after the snapshot 2024-04-12T19:42:22.560 INFO:tasks.workunit.client.0.smithi131.stdout: create 177/38 file after the snapshot 2024-04-12T19:42:22.567 INFO:tasks.workunit.client.0.smithi131.stdout: create 177/39 file after the snapshot 2024-04-12T19:42:22.574 INFO:tasks.workunit.client.0.smithi131.stdout: create 178/.snap/snap-subdir-test 2024-04-12T19:42:22.613 INFO:tasks.workunit.client.0.smithi131.stdout: create 178/30 file after the snapshot 2024-04-12T19:42:22.618 INFO:tasks.workunit.client.0.smithi131.stdout: create 178/31 file after the snapshot 2024-04-12T19:42:22.624 INFO:tasks.workunit.client.0.smithi131.stdout: create 178/32 file after the snapshot 2024-04-12T19:42:22.631 INFO:tasks.workunit.client.0.smithi131.stdout: create 178/33 file after the snapshot 2024-04-12T19:42:22.639 INFO:tasks.workunit.client.0.smithi131.stdout: create 178/34 file after the snapshot 2024-04-12T19:42:22.647 INFO:tasks.workunit.client.0.smithi131.stdout: create 178/35 file after the snapshot 2024-04-12T19:42:22.654 INFO:tasks.workunit.client.0.smithi131.stdout: create 178/36 file after the snapshot 2024-04-12T19:42:22.662 INFO:tasks.workunit.client.0.smithi131.stdout: create 178/37 file after the snapshot 2024-04-12T19:42:22.671 INFO:tasks.workunit.client.0.smithi131.stdout: create 178/38 file after the snapshot 2024-04-12T19:42:22.679 INFO:tasks.workunit.client.0.smithi131.stdout: create 178/39 file after the snapshot 2024-04-12T19:42:22.687 INFO:tasks.workunit.client.0.smithi131.stdout: create 179/.snap/snap-subdir-test 2024-04-12T19:42:22.731 INFO:tasks.workunit.client.0.smithi131.stdout: create 179/30 file after the snapshot 2024-04-12T19:42:22.738 INFO:tasks.workunit.client.0.smithi131.stdout: create 179/31 file after the snapshot 2024-04-12T19:42:22.746 INFO:tasks.workunit.client.0.smithi131.stdout: create 179/32 file after the snapshot 2024-04-12T19:42:22.754 INFO:tasks.workunit.client.0.smithi131.stdout: create 179/33 file after the snapshot 2024-04-12T19:42:22.762 INFO:tasks.workunit.client.0.smithi131.stdout: create 179/34 file after the snapshot 2024-04-12T19:42:22.770 INFO:tasks.workunit.client.0.smithi131.stdout: create 179/35 file after the snapshot 2024-04-12T19:42:22.778 INFO:tasks.workunit.client.0.smithi131.stdout: create 179/36 file after the snapshot 2024-04-12T19:42:22.785 INFO:tasks.workunit.client.0.smithi131.stdout: create 179/37 file after the snapshot 2024-04-12T19:42:22.792 INFO:tasks.workunit.client.0.smithi131.stdout: create 179/38 file after the snapshot 2024-04-12T19:42:22.800 INFO:tasks.workunit.client.0.smithi131.stdout: create 179/39 file after the snapshot 2024-04-12T19:42:22.808 INFO:tasks.workunit.client.0.smithi131.stdout: create 180/.snap/snap-subdir-test 2024-04-12T19:42:22.852 INFO:tasks.workunit.client.0.smithi131.stdout: create 180/30 file after the snapshot 2024-04-12T19:42:22.858 INFO:tasks.workunit.client.0.smithi131.stdout: create 180/31 file after the snapshot 2024-04-12T19:42:22.865 INFO:tasks.workunit.client.0.smithi131.stdout: create 180/32 file after the snapshot 2024-04-12T19:42:22.873 INFO:tasks.workunit.client.0.smithi131.stdout: create 180/33 file after the snapshot 2024-04-12T19:42:22.881 INFO:tasks.workunit.client.0.smithi131.stdout: create 180/34 file after the snapshot 2024-04-12T19:42:22.888 INFO:tasks.workunit.client.0.smithi131.stdout: create 180/35 file after the snapshot 2024-04-12T19:42:22.896 INFO:tasks.workunit.client.0.smithi131.stdout: create 180/36 file after the snapshot 2024-04-12T19:42:22.904 INFO:tasks.workunit.client.0.smithi131.stdout: create 180/37 file after the snapshot 2024-04-12T19:42:22.912 INFO:tasks.workunit.client.0.smithi131.stdout: create 180/38 file after the snapshot 2024-04-12T19:42:22.921 INFO:tasks.workunit.client.0.smithi131.stdout: create 180/39 file after the snapshot 2024-04-12T19:42:22.929 INFO:tasks.workunit.client.0.smithi131.stdout: create 181/.snap/snap-subdir-test 2024-04-12T19:42:22.970 INFO:tasks.workunit.client.0.smithi131.stdout: create 181/30 file after the snapshot 2024-04-12T19:42:22.977 INFO:tasks.workunit.client.0.smithi131.stdout: create 181/31 file after the snapshot 2024-04-12T19:42:22.985 INFO:tasks.workunit.client.0.smithi131.stdout: create 181/32 file after the snapshot 2024-04-12T19:42:22.993 INFO:tasks.workunit.client.0.smithi131.stdout: create 181/33 file after the snapshot 2024-04-12T19:42:23.000 INFO:tasks.workunit.client.0.smithi131.stdout: create 181/34 file after the snapshot 2024-04-12T19:42:23.007 INFO:tasks.workunit.client.0.smithi131.stdout: create 181/35 file after the snapshot 2024-04-12T19:42:23.015 INFO:tasks.workunit.client.0.smithi131.stdout: create 181/36 file after the snapshot 2024-04-12T19:42:23.023 INFO:tasks.workunit.client.0.smithi131.stdout: create 181/37 file after the snapshot 2024-04-12T19:42:23.032 INFO:tasks.workunit.client.0.smithi131.stdout: create 181/38 file after the snapshot 2024-04-12T19:42:23.039 INFO:tasks.workunit.client.0.smithi131.stdout: create 181/39 file after the snapshot 2024-04-12T19:42:23.047 INFO:tasks.workunit.client.0.smithi131.stdout: create 182/.snap/snap-subdir-test 2024-04-12T19:42:23.088 INFO:tasks.workunit.client.0.smithi131.stdout: create 182/30 file after the snapshot 2024-04-12T19:42:23.093 INFO:tasks.workunit.client.0.smithi131.stdout: create 182/31 file after the snapshot 2024-04-12T19:42:23.101 INFO:tasks.workunit.client.0.smithi131.stdout: create 182/32 file after the snapshot 2024-04-12T19:42:23.109 INFO:tasks.workunit.client.0.smithi131.stdout: create 182/33 file after the snapshot 2024-04-12T19:42:23.117 INFO:tasks.workunit.client.0.smithi131.stdout: create 182/34 file after the snapshot 2024-04-12T19:42:23.126 INFO:tasks.workunit.client.0.smithi131.stdout: create 182/35 file after the snapshot 2024-04-12T19:42:23.133 INFO:tasks.workunit.client.0.smithi131.stdout: create 182/36 file after the snapshot 2024-04-12T19:42:23.141 INFO:tasks.workunit.client.0.smithi131.stdout: create 182/37 file after the snapshot 2024-04-12T19:42:23.150 INFO:tasks.workunit.client.0.smithi131.stdout: create 182/38 file after the snapshot 2024-04-12T19:42:23.158 INFO:tasks.workunit.client.0.smithi131.stdout: create 182/39 file after the snapshot 2024-04-12T19:42:23.166 INFO:tasks.workunit.client.0.smithi131.stdout: create 183/.snap/snap-subdir-test 2024-04-12T19:42:23.220 INFO:tasks.workunit.client.0.smithi131.stdout: create 183/30 file after the snapshot 2024-04-12T19:42:23.275 INFO:tasks.workunit.client.0.smithi131.stdout: create 183/31 file after the snapshot 2024-04-12T19:42:23.281 INFO:tasks.workunit.client.0.smithi131.stdout: create 183/32 file after the snapshot 2024-04-12T19:42:23.288 INFO:tasks.workunit.client.0.smithi131.stdout: create 183/33 file after the snapshot 2024-04-12T19:42:23.296 INFO:tasks.workunit.client.0.smithi131.stdout: create 183/34 file after the snapshot 2024-04-12T19:42:23.304 INFO:tasks.workunit.client.0.smithi131.stdout: create 183/35 file after the snapshot 2024-04-12T19:42:23.311 INFO:tasks.workunit.client.0.smithi131.stdout: create 183/36 file after the snapshot 2024-04-12T19:42:23.320 INFO:tasks.workunit.client.0.smithi131.stdout: create 183/37 file after the snapshot 2024-04-12T19:42:23.327 INFO:tasks.workunit.client.0.smithi131.stdout: create 183/38 file after the snapshot 2024-04-12T19:42:23.334 INFO:tasks.workunit.client.0.smithi131.stdout: create 183/39 file after the snapshot 2024-04-12T19:42:23.343 INFO:tasks.workunit.client.0.smithi131.stdout: create 184/.snap/snap-subdir-test 2024-04-12T19:42:23.421 INFO:tasks.workunit.client.0.smithi131.stdout: create 184/30 file after the snapshot 2024-04-12T19:42:23.427 INFO:tasks.workunit.client.0.smithi131.stdout: create 184/31 file after the snapshot 2024-04-12T19:42:23.435 INFO:tasks.workunit.client.0.smithi131.stdout: create 184/32 file after the snapshot 2024-04-12T19:42:23.441 INFO:tasks.workunit.client.0.smithi131.stdout: create 184/33 file after the snapshot 2024-04-12T19:42:23.450 INFO:tasks.workunit.client.0.smithi131.stdout: create 184/34 file after the snapshot 2024-04-12T19:42:23.458 INFO:tasks.workunit.client.0.smithi131.stdout: create 184/35 file after the snapshot 2024-04-12T19:42:23.467 INFO:tasks.workunit.client.0.smithi131.stdout: create 184/36 file after the snapshot 2024-04-12T19:42:23.477 INFO:tasks.workunit.client.0.smithi131.stdout: create 184/37 file after the snapshot 2024-04-12T19:42:23.487 INFO:tasks.workunit.client.0.smithi131.stdout: create 184/38 file after the snapshot 2024-04-12T19:42:23.493 INFO:tasks.workunit.client.0.smithi131.stdout: create 184/39 file after the snapshot 2024-04-12T19:42:23.501 INFO:tasks.workunit.client.0.smithi131.stdout: create 185/.snap/snap-subdir-test 2024-04-12T19:42:23.542 INFO:tasks.workunit.client.0.smithi131.stdout: create 185/30 file after the snapshot 2024-04-12T19:42:23.547 INFO:tasks.workunit.client.0.smithi131.stdout: create 185/31 file after the snapshot 2024-04-12T19:42:23.555 INFO:tasks.workunit.client.0.smithi131.stdout: create 185/32 file after the snapshot 2024-04-12T19:42:23.563 INFO:tasks.workunit.client.0.smithi131.stdout: create 185/33 file after the snapshot 2024-04-12T19:42:23.571 INFO:tasks.workunit.client.0.smithi131.stdout: create 185/34 file after the snapshot 2024-04-12T19:42:23.580 INFO:tasks.workunit.client.0.smithi131.stdout: create 185/35 file after the snapshot 2024-04-12T19:42:23.587 INFO:tasks.workunit.client.0.smithi131.stdout: create 185/36 file after the snapshot 2024-04-12T19:42:23.595 INFO:tasks.workunit.client.0.smithi131.stdout: create 185/37 file after the snapshot 2024-04-12T19:42:23.602 INFO:tasks.workunit.client.0.smithi131.stdout: create 185/38 file after the snapshot 2024-04-12T19:42:23.609 INFO:tasks.workunit.client.0.smithi131.stdout: create 185/39 file after the snapshot 2024-04-12T19:42:23.617 INFO:tasks.workunit.client.0.smithi131.stdout: create 186/.snap/snap-subdir-test 2024-04-12T19:42:23.659 INFO:tasks.workunit.client.0.smithi131.stdout: create 186/30 file after the snapshot 2024-04-12T19:42:23.665 INFO:tasks.workunit.client.0.smithi131.stdout: create 186/31 file after the snapshot 2024-04-12T19:42:23.673 INFO:tasks.workunit.client.0.smithi131.stdout: create 186/32 file after the snapshot 2024-04-12T19:42:23.682 INFO:tasks.workunit.client.0.smithi131.stdout: create 186/33 file after the snapshot 2024-04-12T19:42:23.689 INFO:tasks.workunit.client.0.smithi131.stdout: create 186/34 file after the snapshot 2024-04-12T19:42:23.697 INFO:tasks.workunit.client.0.smithi131.stdout: create 186/35 file after the snapshot 2024-04-12T19:42:23.704 INFO:tasks.workunit.client.0.smithi131.stdout: create 186/36 file after the snapshot 2024-04-12T19:42:23.712 INFO:tasks.workunit.client.0.smithi131.stdout: create 186/37 file after the snapshot 2024-04-12T19:42:23.718 INFO:tasks.workunit.client.0.smithi131.stdout: create 186/38 file after the snapshot 2024-04-12T19:42:23.726 INFO:tasks.workunit.client.0.smithi131.stdout: create 186/39 file after the snapshot 2024-04-12T19:42:23.734 INFO:tasks.workunit.client.0.smithi131.stdout: create 187/.snap/snap-subdir-test 2024-04-12T19:42:23.776 INFO:tasks.workunit.client.0.smithi131.stdout: create 187/30 file after the snapshot 2024-04-12T19:42:23.782 INFO:tasks.workunit.client.0.smithi131.stdout: create 187/31 file after the snapshot 2024-04-12T19:42:23.789 INFO:tasks.workunit.client.0.smithi131.stdout: create 187/32 file after the snapshot 2024-04-12T19:42:23.797 INFO:tasks.workunit.client.0.smithi131.stdout: create 187/33 file after the snapshot 2024-04-12T19:42:23.805 INFO:tasks.workunit.client.0.smithi131.stdout: create 187/34 file after the snapshot 2024-04-12T19:42:23.813 INFO:tasks.workunit.client.0.smithi131.stdout: create 187/35 file after the snapshot 2024-04-12T19:42:23.821 INFO:tasks.workunit.client.0.smithi131.stdout: create 187/36 file after the snapshot 2024-04-12T19:42:23.829 INFO:tasks.workunit.client.0.smithi131.stdout: create 187/37 file after the snapshot 2024-04-12T19:42:23.837 INFO:tasks.workunit.client.0.smithi131.stdout: create 187/38 file after the snapshot 2024-04-12T19:42:23.844 INFO:tasks.workunit.client.0.smithi131.stdout: create 187/39 file after the snapshot 2024-04-12T19:42:23.852 INFO:tasks.workunit.client.0.smithi131.stdout: create 188/.snap/snap-subdir-test 2024-04-12T19:42:23.893 INFO:tasks.workunit.client.0.smithi131.stdout: create 188/30 file after the snapshot 2024-04-12T19:42:23.899 INFO:tasks.workunit.client.0.smithi131.stdout: create 188/31 file after the snapshot 2024-04-12T19:42:23.906 INFO:tasks.workunit.client.0.smithi131.stdout: create 188/32 file after the snapshot 2024-04-12T19:42:23.915 INFO:tasks.workunit.client.0.smithi131.stdout: create 188/33 file after the snapshot 2024-04-12T19:42:23.923 INFO:tasks.workunit.client.0.smithi131.stdout: create 188/34 file after the snapshot 2024-04-12T19:42:23.931 INFO:tasks.workunit.client.0.smithi131.stdout: create 188/35 file after the snapshot 2024-04-12T19:42:23.939 INFO:tasks.workunit.client.0.smithi131.stdout: create 188/36 file after the snapshot 2024-04-12T19:42:23.947 INFO:tasks.workunit.client.0.smithi131.stdout: create 188/37 file after the snapshot 2024-04-12T19:42:23.955 INFO:tasks.workunit.client.0.smithi131.stdout: create 188/38 file after the snapshot 2024-04-12T19:42:23.962 INFO:tasks.workunit.client.0.smithi131.stdout: create 188/39 file after the snapshot 2024-04-12T19:42:23.971 INFO:tasks.workunit.client.0.smithi131.stdout: create 189/.snap/snap-subdir-test 2024-04-12T19:42:24.016 INFO:tasks.workunit.client.0.smithi131.stdout: create 189/30 file after the snapshot 2024-04-12T19:42:24.021 INFO:tasks.workunit.client.0.smithi131.stdout: create 189/31 file after the snapshot 2024-04-12T19:42:24.028 INFO:tasks.workunit.client.0.smithi131.stdout: create 189/32 file after the snapshot 2024-04-12T19:42:24.037 INFO:tasks.workunit.client.0.smithi131.stdout: create 189/33 file after the snapshot 2024-04-12T19:42:24.044 INFO:tasks.workunit.client.0.smithi131.stdout: create 189/34 file after the snapshot 2024-04-12T19:42:24.053 INFO:tasks.workunit.client.0.smithi131.stdout: create 189/35 file after the snapshot 2024-04-12T19:42:24.061 INFO:tasks.workunit.client.0.smithi131.stdout: create 189/36 file after the snapshot 2024-04-12T19:42:24.070 INFO:tasks.workunit.client.0.smithi131.stdout: create 189/37 file after the snapshot 2024-04-12T19:42:24.078 INFO:tasks.workunit.client.0.smithi131.stdout: create 189/38 file after the snapshot 2024-04-12T19:42:24.086 INFO:tasks.workunit.client.0.smithi131.stdout: create 189/39 file after the snapshot 2024-04-12T19:42:24.093 INFO:tasks.workunit.client.0.smithi131.stdout: create 190/.snap/snap-subdir-test 2024-04-12T19:42:24.137 INFO:tasks.workunit.client.0.smithi131.stdout: create 190/30 file after the snapshot 2024-04-12T19:42:24.143 INFO:tasks.workunit.client.0.smithi131.stdout: create 190/31 file after the snapshot 2024-04-12T19:42:24.150 INFO:tasks.workunit.client.0.smithi131.stdout: create 190/32 file after the snapshot 2024-04-12T19:42:24.158 INFO:tasks.workunit.client.0.smithi131.stdout: create 190/33 file after the snapshot 2024-04-12T19:42:24.165 INFO:tasks.workunit.client.0.smithi131.stdout: create 190/34 file after the snapshot 2024-04-12T19:42:24.173 INFO:tasks.workunit.client.0.smithi131.stdout: create 190/35 file after the snapshot 2024-04-12T19:42:24.181 INFO:tasks.workunit.client.0.smithi131.stdout: create 190/36 file after the snapshot 2024-04-12T19:42:24.189 INFO:tasks.workunit.client.0.smithi131.stdout: create 190/37 file after the snapshot 2024-04-12T19:42:24.197 INFO:tasks.workunit.client.0.smithi131.stdout: create 190/38 file after the snapshot 2024-04-12T19:42:24.204 INFO:tasks.workunit.client.0.smithi131.stdout: create 190/39 file after the snapshot 2024-04-12T19:42:24.211 INFO:tasks.workunit.client.0.smithi131.stdout: create 191/.snap/snap-subdir-test 2024-04-12T19:42:24.372 INFO:tasks.workunit.client.0.smithi131.stdout: create 191/30 file after the snapshot 2024-04-12T19:42:24.378 INFO:tasks.workunit.client.0.smithi131.stdout: create 191/31 file after the snapshot 2024-04-12T19:42:24.387 INFO:tasks.workunit.client.0.smithi131.stdout: create 191/32 file after the snapshot 2024-04-12T19:42:24.394 INFO:tasks.workunit.client.0.smithi131.stdout: create 191/33 file after the snapshot 2024-04-12T19:42:24.401 INFO:tasks.workunit.client.0.smithi131.stdout: create 191/34 file after the snapshot 2024-04-12T19:42:24.408 INFO:tasks.workunit.client.0.smithi131.stdout: create 191/35 file after the snapshot 2024-04-12T19:42:24.417 INFO:tasks.workunit.client.0.smithi131.stdout: create 191/36 file after the snapshot 2024-04-12T19:42:24.424 INFO:tasks.workunit.client.0.smithi131.stdout: create 191/37 file after the snapshot 2024-04-12T19:42:24.432 INFO:tasks.workunit.client.0.smithi131.stdout: create 191/38 file after the snapshot 2024-04-12T19:42:24.439 INFO:tasks.workunit.client.0.smithi131.stdout: create 191/39 file after the snapshot 2024-04-12T19:42:24.447 INFO:tasks.workunit.client.0.smithi131.stdout: create 192/.snap/snap-subdir-test 2024-04-12T19:42:24.487 INFO:tasks.workunit.client.0.smithi131.stdout: create 192/30 file after the snapshot 2024-04-12T19:42:24.493 INFO:tasks.workunit.client.0.smithi131.stdout: create 192/31 file after the snapshot 2024-04-12T19:42:24.500 INFO:tasks.workunit.client.0.smithi131.stdout: create 192/32 file after the snapshot 2024-04-12T19:42:24.508 INFO:tasks.workunit.client.0.smithi131.stdout: create 192/33 file after the snapshot 2024-04-12T19:42:24.515 INFO:tasks.workunit.client.0.smithi131.stdout: create 192/34 file after the snapshot 2024-04-12T19:42:24.522 INFO:tasks.workunit.client.0.smithi131.stdout: create 192/35 file after the snapshot 2024-04-12T19:42:24.530 INFO:tasks.workunit.client.0.smithi131.stdout: create 192/36 file after the snapshot 2024-04-12T19:42:24.538 INFO:tasks.workunit.client.0.smithi131.stdout: create 192/37 file after the snapshot 2024-04-12T19:42:24.546 INFO:tasks.workunit.client.0.smithi131.stdout: create 192/38 file after the snapshot 2024-04-12T19:42:24.554 INFO:tasks.workunit.client.0.smithi131.stdout: create 192/39 file after the snapshot 2024-04-12T19:42:24.562 INFO:tasks.workunit.client.0.smithi131.stdout: create 193/.snap/snap-subdir-test 2024-04-12T19:42:24.607 INFO:tasks.workunit.client.0.smithi131.stdout: create 193/30 file after the snapshot 2024-04-12T19:42:24.613 INFO:tasks.workunit.client.0.smithi131.stdout: create 193/31 file after the snapshot 2024-04-12T19:42:24.620 INFO:tasks.workunit.client.0.smithi131.stdout: create 193/32 file after the snapshot 2024-04-12T19:42:24.628 INFO:tasks.workunit.client.0.smithi131.stdout: create 193/33 file after the snapshot 2024-04-12T19:42:24.636 INFO:tasks.workunit.client.0.smithi131.stdout: create 193/34 file after the snapshot 2024-04-12T19:42:24.644 INFO:tasks.workunit.client.0.smithi131.stdout: create 193/35 file after the snapshot 2024-04-12T19:42:24.652 INFO:tasks.workunit.client.0.smithi131.stdout: create 193/36 file after the snapshot 2024-04-12T19:42:24.660 INFO:tasks.workunit.client.0.smithi131.stdout: create 193/37 file after the snapshot 2024-04-12T19:42:24.668 INFO:tasks.workunit.client.0.smithi131.stdout: create 193/38 file after the snapshot 2024-04-12T19:42:24.677 INFO:tasks.workunit.client.0.smithi131.stdout: create 193/39 file after the snapshot 2024-04-12T19:42:24.684 INFO:tasks.workunit.client.0.smithi131.stdout: create 194/.snap/snap-subdir-test 2024-04-12T19:42:24.728 INFO:tasks.workunit.client.0.smithi131.stdout: create 194/30 file after the snapshot 2024-04-12T19:42:24.733 INFO:tasks.workunit.client.0.smithi131.stdout: create 194/31 file after the snapshot 2024-04-12T19:42:24.740 INFO:tasks.workunit.client.0.smithi131.stdout: create 194/32 file after the snapshot 2024-04-12T19:42:24.748 INFO:tasks.workunit.client.0.smithi131.stdout: create 194/33 file after the snapshot 2024-04-12T19:42:24.755 INFO:tasks.workunit.client.0.smithi131.stdout: create 194/34 file after the snapshot 2024-04-12T19:42:24.763 INFO:tasks.workunit.client.0.smithi131.stdout: create 194/35 file after the snapshot 2024-04-12T19:42:24.771 INFO:tasks.workunit.client.0.smithi131.stdout: create 194/36 file after the snapshot 2024-04-12T19:42:24.777 INFO:tasks.workunit.client.0.smithi131.stdout: create 194/37 file after the snapshot 2024-04-12T19:42:24.786 INFO:tasks.workunit.client.0.smithi131.stdout: create 194/38 file after the snapshot 2024-04-12T19:42:24.793 INFO:tasks.workunit.client.0.smithi131.stdout: create 194/39 file after the snapshot 2024-04-12T19:42:24.802 INFO:tasks.workunit.client.0.smithi131.stdout: create 195/.snap/snap-subdir-test 2024-04-12T19:42:24.843 INFO:tasks.workunit.client.0.smithi131.stdout: create 195/30 file after the snapshot 2024-04-12T19:42:24.849 INFO:tasks.workunit.client.0.smithi131.stdout: create 195/31 file after the snapshot 2024-04-12T19:42:24.856 INFO:tasks.workunit.client.0.smithi131.stdout: create 195/32 file after the snapshot 2024-04-12T19:42:24.864 INFO:tasks.workunit.client.0.smithi131.stdout: create 195/33 file after the snapshot 2024-04-12T19:42:24.872 INFO:tasks.workunit.client.0.smithi131.stdout: create 195/34 file after the snapshot 2024-04-12T19:42:24.880 INFO:tasks.workunit.client.0.smithi131.stdout: create 195/35 file after the snapshot 2024-04-12T19:42:24.888 INFO:tasks.workunit.client.0.smithi131.stdout: create 195/36 file after the snapshot 2024-04-12T19:42:24.896 INFO:tasks.workunit.client.0.smithi131.stdout: create 195/37 file after the snapshot 2024-04-12T19:42:24.904 INFO:tasks.workunit.client.0.smithi131.stdout: create 195/38 file after the snapshot 2024-04-12T19:42:24.911 INFO:tasks.workunit.client.0.smithi131.stdout: create 195/39 file after the snapshot 2024-04-12T19:42:24.919 INFO:tasks.workunit.client.0.smithi131.stdout: create 196/.snap/snap-subdir-test 2024-04-12T19:42:24.966 INFO:tasks.workunit.client.0.smithi131.stdout: create 196/30 file after the snapshot 2024-04-12T19:42:24.972 INFO:tasks.workunit.client.0.smithi131.stdout: create 196/31 file after the snapshot 2024-04-12T19:42:24.979 INFO:tasks.workunit.client.0.smithi131.stdout: create 196/32 file after the snapshot 2024-04-12T19:42:24.986 INFO:tasks.workunit.client.0.smithi131.stdout: create 196/33 file after the snapshot 2024-04-12T19:42:24.995 INFO:tasks.workunit.client.0.smithi131.stdout: create 196/34 file after the snapshot 2024-04-12T19:42:25.002 INFO:tasks.workunit.client.0.smithi131.stdout: create 196/35 file after the snapshot 2024-04-12T19:42:25.010 INFO:tasks.workunit.client.0.smithi131.stdout: create 196/36 file after the snapshot 2024-04-12T19:42:25.018 INFO:tasks.workunit.client.0.smithi131.stdout: create 196/37 file after the snapshot 2024-04-12T19:42:25.026 INFO:tasks.workunit.client.0.smithi131.stdout: create 196/38 file after the snapshot 2024-04-12T19:42:25.033 INFO:tasks.workunit.client.0.smithi131.stdout: create 196/39 file after the snapshot 2024-04-12T19:42:25.042 INFO:tasks.workunit.client.0.smithi131.stdout: create 197/.snap/snap-subdir-test 2024-04-12T19:42:25.082 INFO:tasks.workunit.client.0.smithi131.stdout: create 197/30 file after the snapshot 2024-04-12T19:42:25.088 INFO:tasks.workunit.client.0.smithi131.stdout: create 197/31 file after the snapshot 2024-04-12T19:42:25.095 INFO:tasks.workunit.client.0.smithi131.stdout: create 197/32 file after the snapshot 2024-04-12T19:42:25.101 INFO:tasks.workunit.client.0.smithi131.stdout: create 197/33 file after the snapshot 2024-04-12T19:42:25.109 INFO:tasks.workunit.client.0.smithi131.stdout: create 197/34 file after the snapshot 2024-04-12T19:42:25.117 INFO:tasks.workunit.client.0.smithi131.stdout: create 197/35 file after the snapshot 2024-04-12T19:42:25.125 INFO:tasks.workunit.client.0.smithi131.stdout: create 197/36 file after the snapshot 2024-04-12T19:42:25.133 INFO:tasks.workunit.client.0.smithi131.stdout: create 197/37 file after the snapshot 2024-04-12T19:42:25.141 INFO:tasks.workunit.client.0.smithi131.stdout: create 197/38 file after the snapshot 2024-04-12T19:42:25.149 INFO:tasks.workunit.client.0.smithi131.stdout: create 197/39 file after the snapshot 2024-04-12T19:42:25.157 INFO:tasks.workunit.client.0.smithi131.stdout: create 198/.snap/snap-subdir-test 2024-04-12T19:42:25.200 INFO:tasks.workunit.client.0.smithi131.stdout: create 198/30 file after the snapshot 2024-04-12T19:42:25.206 INFO:tasks.workunit.client.0.smithi131.stdout: create 198/31 file after the snapshot 2024-04-12T19:42:25.212 INFO:tasks.workunit.client.0.smithi131.stdout: create 198/32 file after the snapshot 2024-04-12T19:42:25.220 INFO:tasks.workunit.client.0.smithi131.stdout: create 198/33 file after the snapshot 2024-04-12T19:42:25.227 INFO:tasks.workunit.client.0.smithi131.stdout: create 198/34 file after the snapshot 2024-04-12T19:42:25.244 INFO:tasks.workunit.client.0.smithi131.stdout: create 198/35 file after the snapshot 2024-04-12T19:42:25.292 INFO:tasks.workunit.client.0.smithi131.stdout: create 198/36 file after the snapshot 2024-04-12T19:42:25.299 INFO:tasks.workunit.client.0.smithi131.stdout: create 198/37 file after the snapshot 2024-04-12T19:42:25.305 INFO:tasks.workunit.client.0.smithi131.stdout: create 198/38 file after the snapshot 2024-04-12T19:42:25.313 INFO:tasks.workunit.client.0.smithi131.stdout: create 198/39 file after the snapshot 2024-04-12T19:42:25.319 INFO:tasks.workunit.client.0.smithi131.stdout: create 199/.snap/snap-subdir-test 2024-04-12T19:42:25.400 INFO:tasks.workunit.client.0.smithi131.stdout: create 199/30 file after the snapshot 2024-04-12T19:42:25.405 INFO:tasks.workunit.client.0.smithi131.stdout: create 199/31 file after the snapshot 2024-04-12T19:42:25.413 INFO:tasks.workunit.client.0.smithi131.stdout: create 199/32 file after the snapshot 2024-04-12T19:42:25.419 INFO:tasks.workunit.client.0.smithi131.stdout: create 199/33 file after the snapshot 2024-04-12T19:42:25.428 INFO:tasks.workunit.client.0.smithi131.stdout: create 199/34 file after the snapshot 2024-04-12T19:42:25.436 INFO:tasks.workunit.client.0.smithi131.stdout: create 199/35 file after the snapshot 2024-04-12T19:42:25.445 INFO:tasks.workunit.client.0.smithi131.stdout: create 199/36 file after the snapshot 2024-04-12T19:42:25.452 INFO:tasks.workunit.client.0.smithi131.stdout: create 199/37 file after the snapshot 2024-04-12T19:42:25.459 INFO:tasks.workunit.client.0.smithi131.stdout: create 199/38 file after the snapshot 2024-04-12T19:42:25.468 INFO:tasks.workunit.client.0.smithi131.stdout: create 199/39 file after the snapshot 2024-04-12T19:42:25.476 INFO:tasks.workunit.client.0.smithi131.stdout: create 200/.snap/snap-subdir-test 2024-04-12T19:42:25.521 INFO:tasks.workunit.client.0.smithi131.stdout: create 200/30 file after the snapshot 2024-04-12T19:42:25.526 INFO:tasks.workunit.client.0.smithi131.stdout: create 200/31 file after the snapshot 2024-04-12T19:42:25.533 INFO:tasks.workunit.client.0.smithi131.stdout: create 200/32 file after the snapshot 2024-04-12T19:42:25.541 INFO:tasks.workunit.client.0.smithi131.stdout: create 200/33 file after the snapshot 2024-04-12T19:42:25.549 INFO:tasks.workunit.client.0.smithi131.stdout: create 200/34 file after the snapshot 2024-04-12T19:42:25.557 INFO:tasks.workunit.client.0.smithi131.stdout: create 200/35 file after the snapshot 2024-04-12T19:42:25.565 INFO:tasks.workunit.client.0.smithi131.stdout: create 200/36 file after the snapshot 2024-04-12T19:42:25.573 INFO:tasks.workunit.client.0.smithi131.stdout: create 200/37 file after the snapshot 2024-04-12T19:42:25.581 INFO:tasks.workunit.client.0.smithi131.stdout: create 200/38 file after the snapshot 2024-04-12T19:42:25.587 INFO:tasks.workunit.client.0.smithi131.stdout: create 200/39 file after the snapshot 2024-04-12T19:42:25.595 INFO:tasks.workunit.client.0.smithi131.stdout: create 201/.snap/snap-subdir-test 2024-04-12T19:42:25.641 INFO:tasks.workunit.client.0.smithi131.stdout: create 201/30 file after the snapshot 2024-04-12T19:42:25.647 INFO:tasks.workunit.client.0.smithi131.stdout: create 201/31 file after the snapshot 2024-04-12T19:42:25.654 INFO:tasks.workunit.client.0.smithi131.stdout: create 201/32 file after the snapshot 2024-04-12T19:42:25.662 INFO:tasks.workunit.client.0.smithi131.stdout: create 201/33 file after the snapshot 2024-04-12T19:42:25.669 INFO:tasks.workunit.client.0.smithi131.stdout: create 201/34 file after the snapshot 2024-04-12T19:42:25.679 INFO:tasks.workunit.client.0.smithi131.stdout: create 201/35 file after the snapshot 2024-04-12T19:42:25.687 INFO:tasks.workunit.client.0.smithi131.stdout: create 201/36 file after the snapshot 2024-04-12T19:42:25.695 INFO:tasks.workunit.client.0.smithi131.stdout: create 201/37 file after the snapshot 2024-04-12T19:42:25.703 INFO:tasks.workunit.client.0.smithi131.stdout: create 201/38 file after the snapshot 2024-04-12T19:42:25.710 INFO:tasks.workunit.client.0.smithi131.stdout: create 201/39 file after the snapshot 2024-04-12T19:42:25.718 INFO:tasks.workunit.client.0.smithi131.stdout: create 202/.snap/snap-subdir-test 2024-04-12T19:42:25.759 INFO:tasks.workunit.client.0.smithi131.stdout: create 202/30 file after the snapshot 2024-04-12T19:42:25.764 INFO:tasks.workunit.client.0.smithi131.stdout: create 202/31 file after the snapshot 2024-04-12T19:42:25.772 INFO:tasks.workunit.client.0.smithi131.stdout: create 202/32 file after the snapshot 2024-04-12T19:42:25.779 INFO:tasks.workunit.client.0.smithi131.stdout: create 202/33 file after the snapshot 2024-04-12T19:42:25.787 INFO:tasks.workunit.client.0.smithi131.stdout: create 202/34 file after the snapshot 2024-04-12T19:42:25.794 INFO:tasks.workunit.client.0.smithi131.stdout: create 202/35 file after the snapshot 2024-04-12T19:42:25.802 INFO:tasks.workunit.client.0.smithi131.stdout: create 202/36 file after the snapshot 2024-04-12T19:42:25.810 INFO:tasks.workunit.client.0.smithi131.stdout: create 202/37 file after the snapshot 2024-04-12T19:42:25.819 INFO:tasks.workunit.client.0.smithi131.stdout: create 202/38 file after the snapshot 2024-04-12T19:42:25.827 INFO:tasks.workunit.client.0.smithi131.stdout: create 202/39 file after the snapshot 2024-04-12T19:42:25.834 INFO:tasks.workunit.client.0.smithi131.stdout: create 203/.snap/snap-subdir-test 2024-04-12T19:42:25.875 INFO:tasks.workunit.client.0.smithi131.stdout: create 203/30 file after the snapshot 2024-04-12T19:42:25.881 INFO:tasks.workunit.client.0.smithi131.stdout: create 203/31 file after the snapshot 2024-04-12T19:42:25.887 INFO:tasks.workunit.client.0.smithi131.stdout: create 203/32 file after the snapshot 2024-04-12T19:42:25.895 INFO:tasks.workunit.client.0.smithi131.stdout: create 203/33 file after the snapshot 2024-04-12T19:42:25.903 INFO:tasks.workunit.client.0.smithi131.stdout: create 203/34 file after the snapshot 2024-04-12T19:42:25.910 INFO:tasks.workunit.client.0.smithi131.stdout: create 203/35 file after the snapshot 2024-04-12T19:42:25.918 INFO:tasks.workunit.client.0.smithi131.stdout: create 203/36 file after the snapshot 2024-04-12T19:42:25.925 INFO:tasks.workunit.client.0.smithi131.stdout: create 203/37 file after the snapshot 2024-04-12T19:42:25.934 INFO:tasks.workunit.client.0.smithi131.stdout: create 203/38 file after the snapshot 2024-04-12T19:42:25.942 INFO:tasks.workunit.client.0.smithi131.stdout: create 203/39 file after the snapshot 2024-04-12T19:42:25.949 INFO:tasks.workunit.client.0.smithi131.stdout: create 204/.snap/snap-subdir-test 2024-04-12T19:42:25.988 INFO:tasks.workunit.client.0.smithi131.stdout: create 204/30 file after the snapshot 2024-04-12T19:42:25.993 INFO:tasks.workunit.client.0.smithi131.stdout: create 204/31 file after the snapshot 2024-04-12T19:42:25.999 INFO:tasks.workunit.client.0.smithi131.stdout: create 204/32 file after the snapshot 2024-04-12T19:42:26.007 INFO:tasks.workunit.client.0.smithi131.stdout: create 204/33 file after the snapshot 2024-04-12T19:42:26.015 INFO:tasks.workunit.client.0.smithi131.stdout: create 204/34 file after the snapshot 2024-04-12T19:42:26.023 INFO:tasks.workunit.client.0.smithi131.stdout: create 204/35 file after the snapshot 2024-04-12T19:42:26.030 INFO:tasks.workunit.client.0.smithi131.stdout: create 204/36 file after the snapshot 2024-04-12T19:42:26.038 INFO:tasks.workunit.client.0.smithi131.stdout: create 204/37 file after the snapshot 2024-04-12T19:42:26.045 INFO:tasks.workunit.client.0.smithi131.stdout: create 204/38 file after the snapshot 2024-04-12T19:42:26.053 INFO:tasks.workunit.client.0.smithi131.stdout: create 204/39 file after the snapshot 2024-04-12T19:42:26.060 INFO:tasks.workunit.client.0.smithi131.stdout: create 205/.snap/snap-subdir-test 2024-04-12T19:42:26.106 INFO:tasks.workunit.client.0.smithi131.stdout: create 205/30 file after the snapshot 2024-04-12T19:42:26.111 INFO:tasks.workunit.client.0.smithi131.stdout: create 205/31 file after the snapshot 2024-04-12T19:42:26.118 INFO:tasks.workunit.client.0.smithi131.stdout: create 205/32 file after the snapshot 2024-04-12T19:42:26.126 INFO:tasks.workunit.client.0.smithi131.stdout: create 205/33 file after the snapshot 2024-04-12T19:42:26.134 INFO:tasks.workunit.client.0.smithi131.stdout: create 205/34 file after the snapshot 2024-04-12T19:42:26.141 INFO:tasks.workunit.client.0.smithi131.stdout: create 205/35 file after the snapshot 2024-04-12T19:42:26.149 INFO:tasks.workunit.client.0.smithi131.stdout: create 205/36 file after the snapshot 2024-04-12T19:42:26.157 INFO:tasks.workunit.client.0.smithi131.stdout: create 205/37 file after the snapshot 2024-04-12T19:42:26.165 INFO:tasks.workunit.client.0.smithi131.stdout: create 205/38 file after the snapshot 2024-04-12T19:42:26.173 INFO:tasks.workunit.client.0.smithi131.stdout: create 205/39 file after the snapshot 2024-04-12T19:42:26.181 INFO:tasks.workunit.client.0.smithi131.stdout: create 206/.snap/snap-subdir-test 2024-04-12T19:42:26.224 INFO:tasks.workunit.client.0.smithi131.stdout: create 206/30 file after the snapshot 2024-04-12T19:42:26.229 INFO:tasks.workunit.client.0.smithi131.stdout: create 206/31 file after the snapshot 2024-04-12T19:42:26.237 INFO:tasks.workunit.client.0.smithi131.stdout: create 206/32 file after the snapshot 2024-04-12T19:42:26.261 INFO:tasks.workunit.client.0.smithi131.stdout: create 206/33 file after the snapshot 2024-04-12T19:42:26.311 INFO:tasks.workunit.client.0.smithi131.stdout: create 206/34 file after the snapshot 2024-04-12T19:42:26.319 INFO:tasks.workunit.client.0.smithi131.stdout: create 206/35 file after the snapshot 2024-04-12T19:42:26.326 INFO:tasks.workunit.client.0.smithi131.stdout: create 206/36 file after the snapshot 2024-04-12T19:42:26.333 INFO:tasks.workunit.client.0.smithi131.stdout: create 206/37 file after the snapshot 2024-04-12T19:42:26.341 INFO:tasks.workunit.client.0.smithi131.stdout: create 206/38 file after the snapshot 2024-04-12T19:42:26.348 INFO:tasks.workunit.client.0.smithi131.stdout: create 206/39 file after the snapshot 2024-04-12T19:42:26.356 INFO:tasks.workunit.client.0.smithi131.stdout: create 207/.snap/snap-subdir-test 2024-04-12T19:42:26.436 INFO:tasks.workunit.client.0.smithi131.stdout: create 207/30 file after the snapshot 2024-04-12T19:42:26.442 INFO:tasks.workunit.client.0.smithi131.stdout: create 207/31 file after the snapshot 2024-04-12T19:42:26.450 INFO:tasks.workunit.client.0.smithi131.stdout: create 207/32 file after the snapshot 2024-04-12T19:42:26.458 INFO:tasks.workunit.client.0.smithi131.stdout: create 207/33 file after the snapshot 2024-04-12T19:42:26.465 INFO:tasks.workunit.client.0.smithi131.stdout: create 207/34 file after the snapshot 2024-04-12T19:42:26.472 INFO:tasks.workunit.client.0.smithi131.stdout: create 207/35 file after the snapshot 2024-04-12T19:42:26.481 INFO:tasks.workunit.client.0.smithi131.stdout: create 207/36 file after the snapshot 2024-04-12T19:42:26.488 INFO:tasks.workunit.client.0.smithi131.stdout: create 207/37 file after the snapshot 2024-04-12T19:42:26.497 INFO:tasks.workunit.client.0.smithi131.stdout: create 207/38 file after the snapshot 2024-04-12T19:42:26.505 INFO:tasks.workunit.client.0.smithi131.stdout: create 207/39 file after the snapshot 2024-04-12T19:42:26.512 INFO:tasks.workunit.client.0.smithi131.stdout: create 208/.snap/snap-subdir-test 2024-04-12T19:42:26.559 INFO:tasks.workunit.client.0.smithi131.stdout: create 208/30 file after the snapshot 2024-04-12T19:42:26.565 INFO:tasks.workunit.client.0.smithi131.stdout: create 208/31 file after the snapshot 2024-04-12T19:42:26.571 INFO:tasks.workunit.client.0.smithi131.stdout: create 208/32 file after the snapshot 2024-04-12T19:42:26.579 INFO:tasks.workunit.client.0.smithi131.stdout: create 208/33 file after the snapshot 2024-04-12T19:42:26.588 INFO:tasks.workunit.client.0.smithi131.stdout: create 208/34 file after the snapshot 2024-04-12T19:42:26.597 INFO:tasks.workunit.client.0.smithi131.stdout: create 208/35 file after the snapshot 2024-04-12T19:42:26.605 INFO:tasks.workunit.client.0.smithi131.stdout: create 208/36 file after the snapshot 2024-04-12T19:42:26.613 INFO:tasks.workunit.client.0.smithi131.stdout: create 208/37 file after the snapshot 2024-04-12T19:42:26.621 INFO:tasks.workunit.client.0.smithi131.stdout: create 208/38 file after the snapshot 2024-04-12T19:42:26.628 INFO:tasks.workunit.client.0.smithi131.stdout: create 208/39 file after the snapshot 2024-04-12T19:42:26.636 INFO:tasks.workunit.client.0.smithi131.stdout: create 209/.snap/snap-subdir-test 2024-04-12T19:42:26.682 INFO:tasks.workunit.client.0.smithi131.stdout: create 209/30 file after the snapshot 2024-04-12T19:42:26.688 INFO:tasks.workunit.client.0.smithi131.stdout: create 209/31 file after the snapshot 2024-04-12T19:42:26.694 INFO:tasks.workunit.client.0.smithi131.stdout: create 209/32 file after the snapshot 2024-04-12T19:42:26.702 INFO:tasks.workunit.client.0.smithi131.stdout: create 209/33 file after the snapshot 2024-04-12T19:42:26.709 INFO:tasks.workunit.client.0.smithi131.stdout: create 209/34 file after the snapshot 2024-04-12T19:42:26.717 INFO:tasks.workunit.client.0.smithi131.stdout: create 209/35 file after the snapshot 2024-04-12T19:42:26.725 INFO:tasks.workunit.client.0.smithi131.stdout: create 209/36 file after the snapshot 2024-04-12T19:42:26.734 INFO:tasks.workunit.client.0.smithi131.stdout: create 209/37 file after the snapshot 2024-04-12T19:42:26.741 INFO:tasks.workunit.client.0.smithi131.stdout: create 209/38 file after the snapshot 2024-04-12T19:42:26.748 INFO:tasks.workunit.client.0.smithi131.stdout: create 209/39 file after the snapshot 2024-04-12T19:42:26.755 INFO:tasks.workunit.client.0.smithi131.stdout: create 210/.snap/snap-subdir-test 2024-04-12T19:42:26.800 INFO:tasks.workunit.client.0.smithi131.stdout: create 210/30 file after the snapshot 2024-04-12T19:42:26.806 INFO:tasks.workunit.client.0.smithi131.stdout: create 210/31 file after the snapshot 2024-04-12T19:42:26.813 INFO:tasks.workunit.client.0.smithi131.stdout: create 210/32 file after the snapshot 2024-04-12T19:42:26.820 INFO:tasks.workunit.client.0.smithi131.stdout: create 210/33 file after the snapshot 2024-04-12T19:42:26.829 INFO:tasks.workunit.client.0.smithi131.stdout: create 210/34 file after the snapshot 2024-04-12T19:42:26.837 INFO:tasks.workunit.client.0.smithi131.stdout: create 210/35 file after the snapshot 2024-04-12T19:42:26.844 INFO:tasks.workunit.client.0.smithi131.stdout: create 210/36 file after the snapshot 2024-04-12T19:42:26.852 INFO:tasks.workunit.client.0.smithi131.stdout: create 210/37 file after the snapshot 2024-04-12T19:42:26.859 INFO:tasks.workunit.client.0.smithi131.stdout: create 210/38 file after the snapshot 2024-04-12T19:42:26.867 INFO:tasks.workunit.client.0.smithi131.stdout: create 210/39 file after the snapshot 2024-04-12T19:42:26.875 INFO:tasks.workunit.client.0.smithi131.stdout: create 211/.snap/snap-subdir-test 2024-04-12T19:42:26.916 INFO:tasks.workunit.client.0.smithi131.stdout: create 211/30 file after the snapshot 2024-04-12T19:42:26.923 INFO:tasks.workunit.client.0.smithi131.stdout: create 211/31 file after the snapshot 2024-04-12T19:42:26.931 INFO:tasks.workunit.client.0.smithi131.stdout: create 211/32 file after the snapshot 2024-04-12T19:42:26.939 INFO:tasks.workunit.client.0.smithi131.stdout: create 211/33 file after the snapshot 2024-04-12T19:42:26.948 INFO:tasks.workunit.client.0.smithi131.stdout: create 211/34 file after the snapshot 2024-04-12T19:42:26.957 INFO:tasks.workunit.client.0.smithi131.stdout: create 211/35 file after the snapshot 2024-04-12T19:42:26.963 INFO:tasks.workunit.client.0.smithi131.stdout: create 211/36 file after the snapshot 2024-04-12T19:42:26.970 INFO:tasks.workunit.client.0.smithi131.stdout: create 211/37 file after the snapshot 2024-04-12T19:42:26.977 INFO:tasks.workunit.client.0.smithi131.stdout: create 211/38 file after the snapshot 2024-04-12T19:42:26.985 INFO:tasks.workunit.client.0.smithi131.stdout: create 211/39 file after the snapshot 2024-04-12T19:42:26.991 INFO:tasks.workunit.client.0.smithi131.stdout: create 212/.snap/snap-subdir-test 2024-04-12T19:42:27.032 INFO:tasks.workunit.client.0.smithi131.stdout: create 212/30 file after the snapshot 2024-04-12T19:42:27.037 INFO:tasks.workunit.client.0.smithi131.stdout: create 212/31 file after the snapshot 2024-04-12T19:42:27.044 INFO:tasks.workunit.client.0.smithi131.stdout: create 212/32 file after the snapshot 2024-04-12T19:42:27.052 INFO:tasks.workunit.client.0.smithi131.stdout: create 212/33 file after the snapshot 2024-04-12T19:42:27.060 INFO:tasks.workunit.client.0.smithi131.stdout: create 212/34 file after the snapshot 2024-04-12T19:42:27.068 INFO:tasks.workunit.client.0.smithi131.stdout: create 212/35 file after the snapshot 2024-04-12T19:42:27.075 INFO:tasks.workunit.client.0.smithi131.stdout: create 212/36 file after the snapshot 2024-04-12T19:42:27.082 INFO:tasks.workunit.client.0.smithi131.stdout: create 212/37 file after the snapshot 2024-04-12T19:42:27.090 INFO:tasks.workunit.client.0.smithi131.stdout: create 212/38 file after the snapshot 2024-04-12T19:42:27.098 INFO:tasks.workunit.client.0.smithi131.stdout: create 212/39 file after the snapshot 2024-04-12T19:42:27.106 INFO:tasks.workunit.client.0.smithi131.stdout: create 213/.snap/snap-subdir-test 2024-04-12T19:42:27.147 INFO:tasks.workunit.client.0.smithi131.stdout: create 213/30 file after the snapshot 2024-04-12T19:42:27.152 INFO:tasks.workunit.client.0.smithi131.stdout: create 213/31 file after the snapshot 2024-04-12T19:42:27.159 INFO:tasks.workunit.client.0.smithi131.stdout: create 213/32 file after the snapshot 2024-04-12T19:42:27.166 INFO:tasks.workunit.client.0.smithi131.stdout: create 213/33 file after the snapshot 2024-04-12T19:42:27.173 INFO:tasks.workunit.client.0.smithi131.stdout: create 213/34 file after the snapshot 2024-04-12T19:42:27.180 INFO:tasks.workunit.client.0.smithi131.stdout: create 213/35 file after the snapshot 2024-04-12T19:42:27.186 INFO:tasks.workunit.client.0.smithi131.stdout: create 213/36 file after the snapshot 2024-04-12T19:42:27.194 INFO:tasks.workunit.client.0.smithi131.stdout: create 213/37 file after the snapshot 2024-04-12T19:42:27.202 INFO:tasks.workunit.client.0.smithi131.stdout: create 213/38 file after the snapshot 2024-04-12T19:42:27.209 INFO:tasks.workunit.client.0.smithi131.stdout: create 213/39 file after the snapshot 2024-04-12T19:42:27.217 INFO:tasks.workunit.client.0.smithi131.stdout: create 214/.snap/snap-subdir-test 2024-04-12T19:42:27.266 INFO:tasks.workunit.client.0.smithi131.stdout: create 214/30 file after the snapshot 2024-04-12T19:42:27.323 INFO:tasks.workunit.client.0.smithi131.stdout: create 214/31 file after the snapshot 2024-04-12T19:42:27.330 INFO:tasks.workunit.client.0.smithi131.stdout: create 214/32 file after the snapshot 2024-04-12T19:42:27.338 INFO:tasks.workunit.client.0.smithi131.stdout: create 214/33 file after the snapshot 2024-04-12T19:42:27.347 INFO:tasks.workunit.client.0.smithi131.stdout: create 214/34 file after the snapshot 2024-04-12T19:42:27.355 INFO:tasks.workunit.client.0.smithi131.stdout: create 214/35 file after the snapshot 2024-04-12T19:42:27.363 INFO:tasks.workunit.client.0.smithi131.stdout: create 214/36 file after the snapshot 2024-04-12T19:42:27.370 INFO:tasks.workunit.client.0.smithi131.stdout: create 214/37 file after the snapshot 2024-04-12T19:42:27.378 INFO:tasks.workunit.client.0.smithi131.stdout: create 214/38 file after the snapshot 2024-04-12T19:42:27.387 INFO:tasks.workunit.client.0.smithi131.stdout: create 214/39 file after the snapshot 2024-04-12T19:42:27.394 INFO:tasks.workunit.client.0.smithi131.stdout: create 215/.snap/snap-subdir-test 2024-04-12T19:42:27.480 INFO:tasks.workunit.client.0.smithi131.stdout: create 215/30 file after the snapshot 2024-04-12T19:42:27.485 INFO:tasks.workunit.client.0.smithi131.stdout: create 215/31 file after the snapshot 2024-04-12T19:42:27.493 INFO:tasks.workunit.client.0.smithi131.stdout: create 215/32 file after the snapshot 2024-04-12T19:42:27.501 INFO:tasks.workunit.client.0.smithi131.stdout: create 215/33 file after the snapshot 2024-04-12T19:42:27.510 INFO:tasks.workunit.client.0.smithi131.stdout: create 215/34 file after the snapshot 2024-04-12T19:42:27.519 INFO:tasks.workunit.client.0.smithi131.stdout: create 215/35 file after the snapshot 2024-04-12T19:42:27.531 INFO:tasks.workunit.client.0.smithi131.stdout: create 215/36 file after the snapshot 2024-04-12T19:42:27.539 INFO:tasks.workunit.client.0.smithi131.stdout: create 215/37 file after the snapshot 2024-04-12T19:42:27.547 INFO:tasks.workunit.client.0.smithi131.stdout: create 215/38 file after the snapshot 2024-04-12T19:42:27.554 INFO:tasks.workunit.client.0.smithi131.stdout: create 215/39 file after the snapshot 2024-04-12T19:42:27.562 INFO:tasks.workunit.client.0.smithi131.stdout: create 216/.snap/snap-subdir-test 2024-04-12T19:42:27.606 INFO:tasks.workunit.client.0.smithi131.stdout: create 216/30 file after the snapshot 2024-04-12T19:42:27.611 INFO:tasks.workunit.client.0.smithi131.stdout: create 216/31 file after the snapshot 2024-04-12T19:42:27.619 INFO:tasks.workunit.client.0.smithi131.stdout: create 216/32 file after the snapshot 2024-04-12T19:42:27.626 INFO:tasks.workunit.client.0.smithi131.stdout: create 216/33 file after the snapshot 2024-04-12T19:42:27.633 INFO:tasks.workunit.client.0.smithi131.stdout: create 216/34 file after the snapshot 2024-04-12T19:42:27.646 INFO:tasks.workunit.client.0.smithi131.stdout: create 216/35 file after the snapshot 2024-04-12T19:42:27.651 INFO:tasks.workunit.client.0.smithi131.stdout: create 216/36 file after the snapshot 2024-04-12T19:42:27.656 INFO:tasks.workunit.client.0.smithi131.stdout: create 216/37 file after the snapshot 2024-04-12T19:42:27.663 INFO:tasks.workunit.client.0.smithi131.stdout: create 216/38 file after the snapshot 2024-04-12T19:42:27.671 INFO:tasks.workunit.client.0.smithi131.stdout: create 216/39 file after the snapshot 2024-04-12T19:42:27.677 INFO:tasks.workunit.client.0.smithi131.stdout: create 217/.snap/snap-subdir-test 2024-04-12T19:42:27.717 INFO:tasks.workunit.client.0.smithi131.stdout: create 217/30 file after the snapshot 2024-04-12T19:42:27.722 INFO:tasks.workunit.client.0.smithi131.stdout: create 217/31 file after the snapshot 2024-04-12T19:42:27.729 INFO:tasks.workunit.client.0.smithi131.stdout: create 217/32 file after the snapshot 2024-04-12T19:42:27.736 INFO:tasks.workunit.client.0.smithi131.stdout: create 217/33 file after the snapshot 2024-04-12T19:42:27.742 INFO:tasks.workunit.client.0.smithi131.stdout: create 217/34 file after the snapshot 2024-04-12T19:42:27.749 INFO:tasks.workunit.client.0.smithi131.stdout: create 217/35 file after the snapshot 2024-04-12T19:42:27.757 INFO:tasks.workunit.client.0.smithi131.stdout: create 217/36 file after the snapshot 2024-04-12T19:42:27.765 INFO:tasks.workunit.client.0.smithi131.stdout: create 217/37 file after the snapshot 2024-04-12T19:42:27.773 INFO:tasks.workunit.client.0.smithi131.stdout: create 217/38 file after the snapshot 2024-04-12T19:42:27.781 INFO:tasks.workunit.client.0.smithi131.stdout: create 217/39 file after the snapshot 2024-04-12T19:42:27.788 INFO:tasks.workunit.client.0.smithi131.stdout: create 218/.snap/snap-subdir-test 2024-04-12T19:42:27.830 INFO:tasks.workunit.client.0.smithi131.stdout: create 218/30 file after the snapshot 2024-04-12T19:42:27.836 INFO:tasks.workunit.client.0.smithi131.stdout: create 218/31 file after the snapshot 2024-04-12T19:42:27.844 INFO:tasks.workunit.client.0.smithi131.stdout: create 218/32 file after the snapshot 2024-04-12T19:42:27.852 INFO:tasks.workunit.client.0.smithi131.stdout: create 218/33 file after the snapshot 2024-04-12T19:42:27.859 INFO:tasks.workunit.client.0.smithi131.stdout: create 218/34 file after the snapshot 2024-04-12T19:42:27.867 INFO:tasks.workunit.client.0.smithi131.stdout: create 218/35 file after the snapshot 2024-04-12T19:42:27.874 INFO:tasks.workunit.client.0.smithi131.stdout: create 218/36 file after the snapshot 2024-04-12T19:42:27.882 INFO:tasks.workunit.client.0.smithi131.stdout: create 218/37 file after the snapshot 2024-04-12T19:42:27.891 INFO:tasks.workunit.client.0.smithi131.stdout: create 218/38 file after the snapshot 2024-04-12T19:42:27.899 INFO:tasks.workunit.client.0.smithi131.stdout: create 218/39 file after the snapshot 2024-04-12T19:42:27.906 INFO:tasks.workunit.client.0.smithi131.stdout: create 219/.snap/snap-subdir-test 2024-04-12T19:42:27.949 INFO:tasks.workunit.client.0.smithi131.stdout: create 219/30 file after the snapshot 2024-04-12T19:42:27.954 INFO:tasks.workunit.client.0.smithi131.stdout: create 219/31 file after the snapshot 2024-04-12T19:42:27.961 INFO:tasks.workunit.client.0.smithi131.stdout: create 219/32 file after the snapshot 2024-04-12T19:42:27.970 INFO:tasks.workunit.client.0.smithi131.stdout: create 219/33 file after the snapshot 2024-04-12T19:42:27.981 INFO:tasks.workunit.client.0.smithi131.stdout: create 219/34 file after the snapshot 2024-04-12T19:42:27.986 INFO:tasks.workunit.client.0.smithi131.stdout: create 219/35 file after the snapshot 2024-04-12T19:42:27.993 INFO:tasks.workunit.client.0.smithi131.stdout: create 219/36 file after the snapshot 2024-04-12T19:42:28.002 INFO:tasks.workunit.client.0.smithi131.stdout: create 219/37 file after the snapshot 2024-04-12T19:42:28.009 INFO:tasks.workunit.client.0.smithi131.stdout: create 219/38 file after the snapshot 2024-04-12T19:42:28.017 INFO:tasks.workunit.client.0.smithi131.stdout: create 219/39 file after the snapshot 2024-04-12T19:42:28.024 INFO:tasks.workunit.client.0.smithi131.stdout: create 220/.snap/snap-subdir-test 2024-04-12T19:42:28.062 INFO:tasks.workunit.client.0.smithi131.stdout: create 220/30 file after the snapshot 2024-04-12T19:42:28.068 INFO:tasks.workunit.client.0.smithi131.stdout: create 220/31 file after the snapshot 2024-04-12T19:42:28.075 INFO:tasks.workunit.client.0.smithi131.stdout: create 220/32 file after the snapshot 2024-04-12T19:42:28.081 INFO:tasks.workunit.client.0.smithi131.stdout: create 220/33 file after the snapshot 2024-04-12T19:42:28.088 INFO:tasks.workunit.client.0.smithi131.stdout: create 220/34 file after the snapshot 2024-04-12T19:42:28.096 INFO:tasks.workunit.client.0.smithi131.stdout: create 220/35 file after the snapshot 2024-04-12T19:42:28.104 INFO:tasks.workunit.client.0.smithi131.stdout: create 220/36 file after the snapshot 2024-04-12T19:42:28.112 INFO:tasks.workunit.client.0.smithi131.stdout: create 220/37 file after the snapshot 2024-04-12T19:42:28.120 INFO:tasks.workunit.client.0.smithi131.stdout: create 220/38 file after the snapshot 2024-04-12T19:42:28.128 INFO:tasks.workunit.client.0.smithi131.stdout: create 220/39 file after the snapshot 2024-04-12T19:42:28.137 INFO:tasks.workunit.client.0.smithi131.stdout: create 221/.snap/snap-subdir-test 2024-04-12T19:42:28.180 INFO:tasks.workunit.client.0.smithi131.stdout: create 221/30 file after the snapshot 2024-04-12T19:42:28.185 INFO:tasks.workunit.client.0.smithi131.stdout: create 221/31 file after the snapshot 2024-04-12T19:42:28.191 INFO:tasks.workunit.client.0.smithi131.stdout: create 221/32 file after the snapshot 2024-04-12T19:42:28.198 INFO:tasks.workunit.client.0.smithi131.stdout: create 221/33 file after the snapshot 2024-04-12T19:42:28.206 INFO:tasks.workunit.client.0.smithi131.stdout: create 221/34 file after the snapshot 2024-04-12T19:42:28.214 INFO:tasks.workunit.client.0.smithi131.stdout: create 221/35 file after the snapshot 2024-04-12T19:42:28.221 INFO:tasks.workunit.client.0.smithi131.stdout: create 221/36 file after the snapshot 2024-04-12T19:42:28.229 INFO:tasks.workunit.client.0.smithi131.stdout: create 221/37 file after the snapshot 2024-04-12T19:42:28.236 INFO:tasks.workunit.client.0.smithi131.stdout: create 221/38 file after the snapshot 2024-04-12T19:42:28.243 INFO:tasks.workunit.client.0.smithi131.stdout: create 221/39 file after the snapshot 2024-04-12T19:42:28.250 INFO:tasks.workunit.client.0.smithi131.stdout: create 222/.snap/snap-subdir-test 2024-04-12T19:42:28.352 INFO:tasks.workunit.client.0.smithi131.stdout: create 222/30 file after the snapshot 2024-04-12T19:42:28.377 INFO:tasks.workunit.client.0.smithi131.stdout: create 222/31 file after the snapshot 2024-04-12T19:42:28.384 INFO:tasks.workunit.client.0.smithi131.stdout: create 222/32 file after the snapshot 2024-04-12T19:42:28.390 INFO:tasks.workunit.client.0.smithi131.stdout: create 222/33 file after the snapshot 2024-04-12T19:42:28.399 INFO:tasks.workunit.client.0.smithi131.stdout: create 222/34 file after the snapshot 2024-04-12T19:42:28.406 INFO:tasks.workunit.client.0.smithi131.stdout: create 222/35 file after the snapshot 2024-04-12T19:42:28.413 INFO:tasks.workunit.client.0.smithi131.stdout: create 222/36 file after the snapshot 2024-04-12T19:42:28.420 INFO:tasks.workunit.client.0.smithi131.stdout: create 222/37 file after the snapshot 2024-04-12T19:42:28.428 INFO:tasks.workunit.client.0.smithi131.stdout: create 222/38 file after the snapshot 2024-04-12T19:42:28.438 INFO:tasks.workunit.client.0.smithi131.stdout: create 222/39 file after the snapshot 2024-04-12T19:42:28.446 INFO:tasks.workunit.client.0.smithi131.stdout: create 223/.snap/snap-subdir-test 2024-04-12T19:42:28.527 INFO:tasks.workunit.client.0.smithi131.stdout: create 223/30 file after the snapshot 2024-04-12T19:42:28.534 INFO:tasks.workunit.client.0.smithi131.stdout: create 223/31 file after the snapshot 2024-04-12T19:42:28.542 INFO:tasks.workunit.client.0.smithi131.stdout: create 223/32 file after the snapshot 2024-04-12T19:42:28.549 INFO:tasks.workunit.client.0.smithi131.stdout: create 223/33 file after the snapshot 2024-04-12T19:42:28.558 INFO:tasks.workunit.client.0.smithi131.stdout: create 223/34 file after the snapshot 2024-04-12T19:42:28.567 INFO:tasks.workunit.client.0.smithi131.stdout: create 223/35 file after the snapshot 2024-04-12T19:42:28.574 INFO:tasks.workunit.client.0.smithi131.stdout: create 223/36 file after the snapshot 2024-04-12T19:42:28.582 INFO:tasks.workunit.client.0.smithi131.stdout: create 223/37 file after the snapshot 2024-04-12T19:42:28.590 INFO:tasks.workunit.client.0.smithi131.stdout: create 223/38 file after the snapshot 2024-04-12T19:42:28.597 INFO:tasks.workunit.client.0.smithi131.stdout: create 223/39 file after the snapshot 2024-04-12T19:42:28.606 INFO:tasks.workunit.client.0.smithi131.stdout: create 224/.snap/snap-subdir-test 2024-04-12T19:42:28.653 INFO:tasks.workunit.client.0.smithi131.stdout: create 224/30 file after the snapshot 2024-04-12T19:42:28.659 INFO:tasks.workunit.client.0.smithi131.stdout: create 224/31 file after the snapshot 2024-04-12T19:42:28.667 INFO:tasks.workunit.client.0.smithi131.stdout: create 224/32 file after the snapshot 2024-04-12T19:42:28.676 INFO:tasks.workunit.client.0.smithi131.stdout: create 224/33 file after the snapshot 2024-04-12T19:42:28.684 INFO:tasks.workunit.client.0.smithi131.stdout: create 224/34 file after the snapshot 2024-04-12T19:42:28.693 INFO:tasks.workunit.client.0.smithi131.stdout: create 224/35 file after the snapshot 2024-04-12T19:42:28.701 INFO:tasks.workunit.client.0.smithi131.stdout: create 224/36 file after the snapshot 2024-04-12T19:42:28.709 INFO:tasks.workunit.client.0.smithi131.stdout: create 224/37 file after the snapshot 2024-04-12T19:42:28.717 INFO:tasks.workunit.client.0.smithi131.stdout: create 224/38 file after the snapshot 2024-04-12T19:42:28.725 INFO:tasks.workunit.client.0.smithi131.stdout: create 224/39 file after the snapshot 2024-04-12T19:42:28.733 INFO:tasks.workunit.client.0.smithi131.stdout: create 225/.snap/snap-subdir-test 2024-04-12T19:42:28.774 INFO:tasks.workunit.client.0.smithi131.stdout: create 225/30 file after the snapshot 2024-04-12T19:42:28.779 INFO:tasks.workunit.client.0.smithi131.stdout: create 225/31 file after the snapshot 2024-04-12T19:42:28.786 INFO:tasks.workunit.client.0.smithi131.stdout: create 225/32 file after the snapshot 2024-04-12T19:42:28.794 INFO:tasks.workunit.client.0.smithi131.stdout: create 225/33 file after the snapshot 2024-04-12T19:42:28.802 INFO:tasks.workunit.client.0.smithi131.stdout: create 225/34 file after the snapshot 2024-04-12T19:42:28.808 INFO:tasks.workunit.client.0.smithi131.stdout: create 225/35 file after the snapshot 2024-04-12T19:42:28.816 INFO:tasks.workunit.client.0.smithi131.stdout: create 225/36 file after the snapshot 2024-04-12T19:42:28.823 INFO:tasks.workunit.client.0.smithi131.stdout: create 225/37 file after the snapshot 2024-04-12T19:42:28.831 INFO:tasks.workunit.client.0.smithi131.stdout: create 225/38 file after the snapshot 2024-04-12T19:42:28.838 INFO:tasks.workunit.client.0.smithi131.stdout: create 225/39 file after the snapshot 2024-04-12T19:42:28.846 INFO:tasks.workunit.client.0.smithi131.stdout: create 226/.snap/snap-subdir-test 2024-04-12T19:42:28.892 INFO:tasks.workunit.client.0.smithi131.stdout: create 226/30 file after the snapshot 2024-04-12T19:42:28.899 INFO:tasks.workunit.client.0.smithi131.stdout: create 226/31 file after the snapshot 2024-04-12T19:42:28.907 INFO:tasks.workunit.client.0.smithi131.stdout: create 226/32 file after the snapshot 2024-04-12T19:42:28.916 INFO:tasks.workunit.client.0.smithi131.stdout: create 226/33 file after the snapshot 2024-04-12T19:42:28.924 INFO:tasks.workunit.client.0.smithi131.stdout: create 226/34 file after the snapshot 2024-04-12T19:42:28.932 INFO:tasks.workunit.client.0.smithi131.stdout: create 226/35 file after the snapshot 2024-04-12T19:42:28.940 INFO:tasks.workunit.client.0.smithi131.stdout: create 226/36 file after the snapshot 2024-04-12T19:42:28.948 INFO:tasks.workunit.client.0.smithi131.stdout: create 226/37 file after the snapshot 2024-04-12T19:42:28.956 INFO:tasks.workunit.client.0.smithi131.stdout: create 226/38 file after the snapshot 2024-04-12T19:42:28.964 INFO:tasks.workunit.client.0.smithi131.stdout: create 226/39 file after the snapshot 2024-04-12T19:42:28.972 INFO:tasks.workunit.client.0.smithi131.stdout: create 227/.snap/snap-subdir-test 2024-04-12T19:42:29.013 INFO:tasks.workunit.client.0.smithi131.stdout: create 227/30 file after the snapshot 2024-04-12T19:42:29.019 INFO:tasks.workunit.client.0.smithi131.stdout: create 227/31 file after the snapshot 2024-04-12T19:42:29.027 INFO:tasks.workunit.client.0.smithi131.stdout: create 227/32 file after the snapshot 2024-04-12T19:42:29.036 INFO:tasks.workunit.client.0.smithi131.stdout: create 227/33 file after the snapshot 2024-04-12T19:42:29.044 INFO:tasks.workunit.client.0.smithi131.stdout: create 227/34 file after the snapshot 2024-04-12T19:42:29.053 INFO:tasks.workunit.client.0.smithi131.stdout: create 227/35 file after the snapshot 2024-04-12T19:42:29.060 INFO:tasks.workunit.client.0.smithi131.stdout: create 227/36 file after the snapshot 2024-04-12T19:42:29.068 INFO:tasks.workunit.client.0.smithi131.stdout: create 227/37 file after the snapshot 2024-04-12T19:42:29.077 INFO:tasks.workunit.client.0.smithi131.stdout: create 227/38 file after the snapshot 2024-04-12T19:42:29.084 INFO:tasks.workunit.client.0.smithi131.stdout: create 227/39 file after the snapshot 2024-04-12T19:42:29.092 INFO:tasks.workunit.client.0.smithi131.stdout: create 228/.snap/snap-subdir-test 2024-04-12T19:42:29.138 INFO:tasks.workunit.client.0.smithi131.stdout: create 228/30 file after the snapshot 2024-04-12T19:42:29.143 INFO:tasks.workunit.client.0.smithi131.stdout: create 228/31 file after the snapshot 2024-04-12T19:42:29.150 INFO:tasks.workunit.client.0.smithi131.stdout: create 228/32 file after the snapshot 2024-04-12T19:42:29.158 INFO:tasks.workunit.client.0.smithi131.stdout: create 228/33 file after the snapshot 2024-04-12T19:42:29.167 INFO:tasks.workunit.client.0.smithi131.stdout: create 228/34 file after the snapshot 2024-04-12T19:42:29.174 INFO:tasks.workunit.client.0.smithi131.stdout: create 228/35 file after the snapshot 2024-04-12T19:42:29.182 INFO:tasks.workunit.client.0.smithi131.stdout: create 228/36 file after the snapshot 2024-04-12T19:42:29.190 INFO:tasks.workunit.client.0.smithi131.stdout: create 228/37 file after the snapshot 2024-04-12T19:42:29.197 INFO:tasks.workunit.client.0.smithi131.stdout: create 228/38 file after the snapshot 2024-04-12T19:42:29.205 INFO:tasks.workunit.client.0.smithi131.stdout: create 228/39 file after the snapshot 2024-04-12T19:42:29.212 INFO:tasks.workunit.client.0.smithi131.stdout: create 229/.snap/snap-subdir-test 2024-04-12T19:42:29.254 INFO:tasks.workunit.client.0.smithi131.stdout: create 229/30 file after the snapshot 2024-04-12T19:42:29.258 INFO:tasks.workunit.client.0.smithi131.stdout: create 229/31 file after the snapshot 2024-04-12T19:42:29.265 INFO:tasks.workunit.client.0.smithi131.stdout: create 229/32 file after the snapshot 2024-04-12T19:42:29.271 INFO:tasks.workunit.client.0.smithi131.stdout: create 229/33 file after the snapshot 2024-04-12T19:42:29.347 INFO:tasks.workunit.client.0.smithi131.stdout: create 229/34 file after the snapshot 2024-04-12T19:42:29.354 INFO:tasks.workunit.client.0.smithi131.stdout: create 229/35 file after the snapshot 2024-04-12T19:42:29.362 INFO:tasks.workunit.client.0.smithi131.stdout: create 229/36 file after the snapshot 2024-04-12T19:42:29.369 INFO:tasks.workunit.client.0.smithi131.stdout: create 229/37 file after the snapshot 2024-04-12T19:42:29.378 INFO:tasks.workunit.client.0.smithi131.stdout: create 229/38 file after the snapshot 2024-04-12T19:42:29.386 INFO:tasks.workunit.client.0.smithi131.stdout: create 229/39 file after the snapshot 2024-04-12T19:42:29.393 INFO:tasks.workunit.client.0.smithi131.stdout: create 230/.snap/snap-subdir-test 2024-04-12T19:42:29.473 INFO:tasks.workunit.client.0.smithi131.stdout: create 230/30 file after the snapshot 2024-04-12T19:42:29.478 INFO:tasks.workunit.client.0.smithi131.stdout: create 230/31 file after the snapshot 2024-04-12T19:42:29.485 INFO:tasks.workunit.client.0.smithi131.stdout: create 230/32 file after the snapshot 2024-04-12T19:42:29.493 INFO:tasks.workunit.client.0.smithi131.stdout: create 230/33 file after the snapshot 2024-04-12T19:42:29.501 INFO:tasks.workunit.client.0.smithi131.stdout: create 230/34 file after the snapshot 2024-04-12T19:42:29.510 INFO:tasks.workunit.client.0.smithi131.stdout: create 230/35 file after the snapshot 2024-04-12T19:42:29.518 INFO:tasks.workunit.client.0.smithi131.stdout: create 230/36 file after the snapshot 2024-04-12T19:42:29.524 INFO:tasks.workunit.client.0.smithi131.stdout: create 230/37 file after the snapshot 2024-04-12T19:42:29.533 INFO:tasks.workunit.client.0.smithi131.stdout: create 230/38 file after the snapshot 2024-04-12T19:42:29.540 INFO:tasks.workunit.client.0.smithi131.stdout: create 230/39 file after the snapshot 2024-04-12T19:42:29.548 INFO:tasks.workunit.client.0.smithi131.stdout: create 231/.snap/snap-subdir-test 2024-04-12T19:42:29.586 INFO:tasks.workunit.client.0.smithi131.stdout: create 231/30 file after the snapshot 2024-04-12T19:42:29.592 INFO:tasks.workunit.client.0.smithi131.stdout: create 231/31 file after the snapshot 2024-04-12T19:42:29.599 INFO:tasks.workunit.client.0.smithi131.stdout: create 231/32 file after the snapshot 2024-04-12T19:42:29.607 INFO:tasks.workunit.client.0.smithi131.stdout: create 231/33 file after the snapshot 2024-04-12T19:42:29.614 INFO:tasks.workunit.client.0.smithi131.stdout: create 231/34 file after the snapshot 2024-04-12T19:42:29.621 INFO:tasks.workunit.client.0.smithi131.stdout: create 231/35 file after the snapshot 2024-04-12T19:42:29.630 INFO:tasks.workunit.client.0.smithi131.stdout: create 231/36 file after the snapshot 2024-04-12T19:42:29.638 INFO:tasks.workunit.client.0.smithi131.stdout: create 231/37 file after the snapshot 2024-04-12T19:42:29.647 INFO:tasks.workunit.client.0.smithi131.stdout: create 231/38 file after the snapshot 2024-04-12T19:42:29.655 INFO:tasks.workunit.client.0.smithi131.stdout: create 231/39 file after the snapshot 2024-04-12T19:42:29.663 INFO:tasks.workunit.client.0.smithi131.stdout: create 232/.snap/snap-subdir-test 2024-04-12T19:42:29.710 INFO:tasks.workunit.client.0.smithi131.stdout: create 232/30 file after the snapshot 2024-04-12T19:42:29.715 INFO:tasks.workunit.client.0.smithi131.stdout: create 232/31 file after the snapshot 2024-04-12T19:42:29.722 INFO:tasks.workunit.client.0.smithi131.stdout: create 232/32 file after the snapshot 2024-04-12T19:42:29.730 INFO:tasks.workunit.client.0.smithi131.stdout: create 232/33 file after the snapshot 2024-04-12T19:42:29.738 INFO:tasks.workunit.client.0.smithi131.stdout: create 232/34 file after the snapshot 2024-04-12T19:42:29.746 INFO:tasks.workunit.client.0.smithi131.stdout: create 232/35 file after the snapshot 2024-04-12T19:42:29.754 INFO:tasks.workunit.client.0.smithi131.stdout: create 232/36 file after the snapshot 2024-04-12T19:42:29.762 INFO:tasks.workunit.client.0.smithi131.stdout: create 232/37 file after the snapshot 2024-04-12T19:42:29.770 INFO:tasks.workunit.client.0.smithi131.stdout: create 232/38 file after the snapshot 2024-04-12T19:42:29.777 INFO:tasks.workunit.client.0.smithi131.stdout: create 232/39 file after the snapshot 2024-04-12T19:42:29.786 INFO:tasks.workunit.client.0.smithi131.stdout: create 233/.snap/snap-subdir-test 2024-04-12T19:42:29.832 INFO:tasks.workunit.client.0.smithi131.stdout: create 233/30 file after the snapshot 2024-04-12T19:42:29.838 INFO:tasks.workunit.client.0.smithi131.stdout: create 233/31 file after the snapshot 2024-04-12T19:42:29.845 INFO:tasks.workunit.client.0.smithi131.stdout: create 233/32 file after the snapshot 2024-04-12T19:42:29.853 INFO:tasks.workunit.client.0.smithi131.stdout: create 233/33 file after the snapshot 2024-04-12T19:42:29.860 INFO:tasks.workunit.client.0.smithi131.stdout: create 233/34 file after the snapshot 2024-04-12T19:42:29.867 INFO:tasks.workunit.client.0.smithi131.stdout: create 233/35 file after the snapshot 2024-04-12T19:42:29.874 INFO:tasks.workunit.client.0.smithi131.stdout: create 233/36 file after the snapshot 2024-04-12T19:42:29.882 INFO:tasks.workunit.client.0.smithi131.stdout: create 233/37 file after the snapshot 2024-04-12T19:42:29.889 INFO:tasks.workunit.client.0.smithi131.stdout: create 233/38 file after the snapshot 2024-04-12T19:42:29.897 INFO:tasks.workunit.client.0.smithi131.stdout: create 233/39 file after the snapshot 2024-04-12T19:42:29.904 INFO:tasks.workunit.client.0.smithi131.stdout: create 234/.snap/snap-subdir-test 2024-04-12T19:42:29.956 INFO:tasks.workunit.client.0.smithi131.stdout: create 234/30 file after the snapshot 2024-04-12T19:42:29.962 INFO:tasks.workunit.client.0.smithi131.stdout: create 234/31 file after the snapshot 2024-04-12T19:42:29.969 INFO:tasks.workunit.client.0.smithi131.stdout: create 234/32 file after the snapshot 2024-04-12T19:42:29.977 INFO:tasks.workunit.client.0.smithi131.stdout: create 234/33 file after the snapshot 2024-04-12T19:42:29.985 INFO:tasks.workunit.client.0.smithi131.stdout: create 234/34 file after the snapshot 2024-04-12T19:42:29.993 INFO:tasks.workunit.client.0.smithi131.stdout: create 234/35 file after the snapshot 2024-04-12T19:42:30.001 INFO:tasks.workunit.client.0.smithi131.stdout: create 234/36 file after the snapshot 2024-04-12T19:42:30.008 INFO:tasks.workunit.client.0.smithi131.stdout: create 234/37 file after the snapshot 2024-04-12T19:42:30.016 INFO:tasks.workunit.client.0.smithi131.stdout: create 234/38 file after the snapshot 2024-04-12T19:42:30.024 INFO:tasks.workunit.client.0.smithi131.stdout: create 234/39 file after the snapshot 2024-04-12T19:42:30.032 INFO:tasks.workunit.client.0.smithi131.stdout: create 235/.snap/snap-subdir-test 2024-04-12T19:42:30.073 INFO:tasks.workunit.client.0.smithi131.stdout: create 235/30 file after the snapshot 2024-04-12T19:42:30.079 INFO:tasks.workunit.client.0.smithi131.stdout: create 235/31 file after the snapshot 2024-04-12T19:42:30.087 INFO:tasks.workunit.client.0.smithi131.stdout: create 235/32 file after the snapshot 2024-04-12T19:42:30.094 INFO:tasks.workunit.client.0.smithi131.stdout: create 235/33 file after the snapshot 2024-04-12T19:42:30.102 INFO:tasks.workunit.client.0.smithi131.stdout: create 235/34 file after the snapshot 2024-04-12T19:42:30.109 INFO:tasks.workunit.client.0.smithi131.stdout: create 235/35 file after the snapshot 2024-04-12T19:42:30.116 INFO:tasks.workunit.client.0.smithi131.stdout: create 235/36 file after the snapshot 2024-04-12T19:42:30.125 INFO:tasks.workunit.client.0.smithi131.stdout: create 235/37 file after the snapshot 2024-04-12T19:42:30.132 INFO:tasks.workunit.client.0.smithi131.stdout: create 235/38 file after the snapshot 2024-04-12T19:42:30.140 INFO:tasks.workunit.client.0.smithi131.stdout: create 235/39 file after the snapshot 2024-04-12T19:42:30.148 INFO:tasks.workunit.client.0.smithi131.stdout: create 236/.snap/snap-subdir-test 2024-04-12T19:42:30.190 INFO:tasks.workunit.client.0.smithi131.stdout: create 236/30 file after the snapshot 2024-04-12T19:42:30.195 INFO:tasks.workunit.client.0.smithi131.stdout: create 236/31 file after the snapshot 2024-04-12T19:42:30.201 INFO:tasks.workunit.client.0.smithi131.stdout: create 236/32 file after the snapshot 2024-04-12T19:42:30.208 INFO:tasks.workunit.client.0.smithi131.stdout: create 236/33 file after the snapshot 2024-04-12T19:42:30.215 INFO:tasks.workunit.client.0.smithi131.stdout: create 236/34 file after the snapshot 2024-04-12T19:42:30.223 INFO:tasks.workunit.client.0.smithi131.stdout: create 236/35 file after the snapshot 2024-04-12T19:42:30.232 INFO:tasks.workunit.client.0.smithi131.stdout: create 236/36 file after the snapshot 2024-04-12T19:42:30.239 INFO:tasks.workunit.client.0.smithi131.stdout: create 236/37 file after the snapshot 2024-04-12T19:42:30.248 INFO:tasks.workunit.client.0.smithi131.stdout: create 236/38 file after the snapshot 2024-04-12T19:42:30.255 INFO:tasks.workunit.client.0.smithi131.stdout: create 236/39 file after the snapshot 2024-04-12T19:42:30.262 INFO:tasks.workunit.client.0.smithi131.stdout: create 237/.snap/snap-subdir-test 2024-04-12T19:42:30.370 INFO:tasks.workunit.client.0.smithi131.stdout: create 237/30 file after the snapshot 2024-04-12T19:42:30.408 INFO:tasks.workunit.client.0.smithi131.stdout: create 237/31 file after the snapshot 2024-04-12T19:42:30.415 INFO:tasks.workunit.client.0.smithi131.stdout: create 237/32 file after the snapshot 2024-04-12T19:42:30.422 INFO:tasks.workunit.client.0.smithi131.stdout: create 237/33 file after the snapshot 2024-04-12T19:42:30.430 INFO:tasks.workunit.client.0.smithi131.stdout: create 237/34 file after the snapshot 2024-04-12T19:42:30.436 INFO:tasks.workunit.client.0.smithi131.stdout: create 237/35 file after the snapshot 2024-04-12T19:42:30.445 INFO:tasks.workunit.client.0.smithi131.stdout: create 237/36 file after the snapshot 2024-04-12T19:42:30.455 INFO:tasks.workunit.client.0.smithi131.stdout: create 237/37 file after the snapshot 2024-04-12T19:42:30.461 INFO:tasks.workunit.client.0.smithi131.stdout: create 237/38 file after the snapshot 2024-04-12T19:42:30.468 INFO:tasks.workunit.client.0.smithi131.stdout: create 237/39 file after the snapshot 2024-04-12T19:42:30.476 INFO:tasks.workunit.client.0.smithi131.stdout: create 238/.snap/snap-subdir-test 2024-04-12T19:42:30.546 INFO:tasks.workunit.client.0.smithi131.stdout: create 238/30 file after the snapshot 2024-04-12T19:42:30.551 INFO:tasks.workunit.client.0.smithi131.stdout: create 238/31 file after the snapshot 2024-04-12T19:42:30.556 INFO:tasks.workunit.client.0.smithi131.stdout: create 238/32 file after the snapshot 2024-04-12T19:42:30.563 INFO:tasks.workunit.client.0.smithi131.stdout: create 238/33 file after the snapshot 2024-04-12T19:42:30.570 INFO:tasks.workunit.client.0.smithi131.stdout: create 238/34 file after the snapshot 2024-04-12T19:42:30.578 INFO:tasks.workunit.client.0.smithi131.stdout: create 238/35 file after the snapshot 2024-04-12T19:42:30.586 INFO:tasks.workunit.client.0.smithi131.stdout: create 238/36 file after the snapshot 2024-04-12T19:42:30.594 INFO:tasks.workunit.client.0.smithi131.stdout: create 238/37 file after the snapshot 2024-04-12T19:42:30.603 INFO:tasks.workunit.client.0.smithi131.stdout: create 238/38 file after the snapshot 2024-04-12T19:42:30.610 INFO:tasks.workunit.client.0.smithi131.stdout: create 238/39 file after the snapshot 2024-04-12T19:42:30.619 INFO:tasks.workunit.client.0.smithi131.stdout: create 239/.snap/snap-subdir-test 2024-04-12T19:42:30.664 INFO:tasks.workunit.client.0.smithi131.stdout: create 239/30 file after the snapshot 2024-04-12T19:42:30.669 INFO:tasks.workunit.client.0.smithi131.stdout: create 239/31 file after the snapshot 2024-04-12T19:42:30.678 INFO:tasks.workunit.client.0.smithi131.stdout: create 239/32 file after the snapshot 2024-04-12T19:42:30.686 INFO:tasks.workunit.client.0.smithi131.stdout: create 239/33 file after the snapshot 2024-04-12T19:42:30.695 INFO:tasks.workunit.client.0.smithi131.stdout: create 239/34 file after the snapshot 2024-04-12T19:42:30.704 INFO:tasks.workunit.client.0.smithi131.stdout: create 239/35 file after the snapshot 2024-04-12T19:42:30.712 INFO:tasks.workunit.client.0.smithi131.stdout: create 239/36 file after the snapshot 2024-04-12T19:42:30.719 INFO:tasks.workunit.client.0.smithi131.stdout: create 239/37 file after the snapshot 2024-04-12T19:42:30.726 INFO:tasks.workunit.client.0.smithi131.stdout: create 239/38 file after the snapshot 2024-04-12T19:42:30.735 INFO:tasks.workunit.client.0.smithi131.stdout: create 239/39 file after the snapshot 2024-04-12T19:42:30.743 INFO:tasks.workunit.client.0.smithi131.stdout: create 240/.snap/snap-subdir-test 2024-04-12T19:42:30.786 INFO:tasks.workunit.client.0.smithi131.stdout: create 240/30 file after the snapshot 2024-04-12T19:42:30.792 INFO:tasks.workunit.client.0.smithi131.stdout: create 240/31 file after the snapshot 2024-04-12T19:42:30.797 INFO:tasks.workunit.client.0.smithi131.stdout: create 240/32 file after the snapshot 2024-04-12T19:42:30.804 INFO:tasks.workunit.client.0.smithi131.stdout: create 240/33 file after the snapshot 2024-04-12T19:42:30.812 INFO:tasks.workunit.client.0.smithi131.stdout: create 240/34 file after the snapshot 2024-04-12T19:42:30.820 INFO:tasks.workunit.client.0.smithi131.stdout: create 240/35 file after the snapshot 2024-04-12T19:42:30.828 INFO:tasks.workunit.client.0.smithi131.stdout: create 240/36 file after the snapshot 2024-04-12T19:42:30.836 INFO:tasks.workunit.client.0.smithi131.stdout: create 240/37 file after the snapshot 2024-04-12T19:42:30.846 INFO:tasks.workunit.client.0.smithi131.stdout: create 240/38 file after the snapshot 2024-04-12T19:42:30.852 INFO:tasks.workunit.client.0.smithi131.stdout: create 240/39 file after the snapshot 2024-04-12T19:42:30.858 INFO:tasks.workunit.client.0.smithi131.stdout: create 241/.snap/snap-subdir-test 2024-04-12T19:42:30.900 INFO:tasks.workunit.client.0.smithi131.stdout: create 241/30 file after the snapshot 2024-04-12T19:42:30.906 INFO:tasks.workunit.client.0.smithi131.stdout: create 241/31 file after the snapshot 2024-04-12T19:42:30.913 INFO:tasks.workunit.client.0.smithi131.stdout: create 241/32 file after the snapshot 2024-04-12T19:42:30.922 INFO:tasks.workunit.client.0.smithi131.stdout: create 241/33 file after the snapshot 2024-04-12T19:42:30.929 INFO:tasks.workunit.client.0.smithi131.stdout: create 241/34 file after the snapshot 2024-04-12T19:42:30.935 INFO:tasks.workunit.client.0.smithi131.stdout: create 241/35 file after the snapshot 2024-04-12T19:42:30.942 INFO:tasks.workunit.client.0.smithi131.stdout: create 241/36 file after the snapshot 2024-04-12T19:42:30.949 INFO:tasks.workunit.client.0.smithi131.stdout: create 241/37 file after the snapshot 2024-04-12T19:42:30.955 INFO:tasks.workunit.client.0.smithi131.stdout: create 241/38 file after the snapshot 2024-04-12T19:42:30.962 INFO:tasks.workunit.client.0.smithi131.stdout: create 241/39 file after the snapshot 2024-04-12T19:42:30.969 INFO:tasks.workunit.client.0.smithi131.stdout: create 242/.snap/snap-subdir-test 2024-04-12T19:42:31.012 INFO:tasks.workunit.client.0.smithi131.stdout: create 242/30 file after the snapshot 2024-04-12T19:42:31.017 INFO:tasks.workunit.client.0.smithi131.stdout: create 242/31 file after the snapshot 2024-04-12T19:42:31.025 INFO:tasks.workunit.client.0.smithi131.stdout: create 242/32 file after the snapshot 2024-04-12T19:42:31.033 INFO:tasks.workunit.client.0.smithi131.stdout: create 242/33 file after the snapshot 2024-04-12T19:42:31.039 INFO:tasks.workunit.client.0.smithi131.stdout: create 242/34 file after the snapshot 2024-04-12T19:42:31.047 INFO:tasks.workunit.client.0.smithi131.stdout: create 242/35 file after the snapshot 2024-04-12T19:42:31.054 INFO:tasks.workunit.client.0.smithi131.stdout: create 242/36 file after the snapshot 2024-04-12T19:42:31.062 INFO:tasks.workunit.client.0.smithi131.stdout: create 242/37 file after the snapshot 2024-04-12T19:42:31.069 INFO:tasks.workunit.client.0.smithi131.stdout: create 242/38 file after the snapshot 2024-04-12T19:42:31.074 INFO:tasks.workunit.client.0.smithi131.stdout: create 242/39 file after the snapshot 2024-04-12T19:42:31.081 INFO:tasks.workunit.client.0.smithi131.stdout: create 243/.snap/snap-subdir-test 2024-04-12T19:42:31.123 INFO:tasks.workunit.client.0.smithi131.stdout: create 243/30 file after the snapshot 2024-04-12T19:42:31.128 INFO:tasks.workunit.client.0.smithi131.stdout: create 243/31 file after the snapshot 2024-04-12T19:42:31.134 INFO:tasks.workunit.client.0.smithi131.stdout: create 243/32 file after the snapshot 2024-04-12T19:42:31.142 INFO:tasks.workunit.client.0.smithi131.stdout: create 243/33 file after the snapshot 2024-04-12T19:42:31.149 INFO:tasks.workunit.client.0.smithi131.stdout: create 243/34 file after the snapshot 2024-04-12T19:42:31.158 INFO:tasks.workunit.client.0.smithi131.stdout: create 243/35 file after the snapshot 2024-04-12T19:42:31.165 INFO:tasks.workunit.client.0.smithi131.stdout: create 243/36 file after the snapshot 2024-04-12T19:42:31.172 INFO:tasks.workunit.client.0.smithi131.stdout: create 243/37 file after the snapshot 2024-04-12T19:42:31.180 INFO:tasks.workunit.client.0.smithi131.stdout: create 243/38 file after the snapshot 2024-04-12T19:42:31.188 INFO:tasks.workunit.client.0.smithi131.stdout: create 243/39 file after the snapshot 2024-04-12T19:42:31.195 INFO:tasks.workunit.client.0.smithi131.stdout: create 244/.snap/snap-subdir-test 2024-04-12T19:42:31.242 INFO:tasks.workunit.client.0.smithi131.stdout: create 244/30 file after the snapshot 2024-04-12T19:42:31.247 INFO:tasks.workunit.client.0.smithi131.stdout: create 244/31 file after the snapshot 2024-04-12T19:42:31.253 INFO:tasks.workunit.client.0.smithi131.stdout: create 244/32 file after the snapshot 2024-04-12T19:42:31.260 INFO:tasks.workunit.client.0.smithi131.stdout: create 244/33 file after the snapshot 2024-04-12T19:42:31.268 INFO:tasks.workunit.client.0.smithi131.stdout: create 244/34 file after the snapshot 2024-04-12T19:42:31.275 INFO:tasks.workunit.client.0.smithi131.stdout: create 244/35 file after the snapshot 2024-04-12T19:42:31.282 INFO:tasks.workunit.client.0.smithi131.stdout: create 244/36 file after the snapshot 2024-04-12T19:42:31.299 INFO:tasks.workunit.client.0.smithi131.stdout: create 244/37 file after the snapshot 2024-04-12T19:42:31.356 INFO:tasks.workunit.client.0.smithi131.stdout: create 244/38 file after the snapshot 2024-04-12T19:42:31.363 INFO:tasks.workunit.client.0.smithi131.stdout: create 244/39 file after the snapshot 2024-04-12T19:42:31.371 INFO:tasks.workunit.client.0.smithi131.stdout: create 245/.snap/snap-subdir-test 2024-04-12T19:42:31.452 INFO:tasks.workunit.client.0.smithi131.stdout: create 245/30 file after the snapshot 2024-04-12T19:42:31.458 INFO:tasks.workunit.client.0.smithi131.stdout: create 245/31 file after the snapshot 2024-04-12T19:42:31.467 INFO:tasks.workunit.client.0.smithi131.stdout: create 245/32 file after the snapshot 2024-04-12T19:42:31.477 INFO:tasks.workunit.client.0.smithi131.stdout: create 245/33 file after the snapshot 2024-04-12T19:42:31.484 INFO:tasks.workunit.client.0.smithi131.stdout: create 245/34 file after the snapshot 2024-04-12T19:42:31.492 INFO:tasks.workunit.client.0.smithi131.stdout: create 245/35 file after the snapshot 2024-04-12T19:42:31.500 INFO:tasks.workunit.client.0.smithi131.stdout: create 245/36 file after the snapshot 2024-04-12T19:42:31.507 INFO:tasks.workunit.client.0.smithi131.stdout: create 245/37 file after the snapshot 2024-04-12T19:42:31.515 INFO:tasks.workunit.client.0.smithi131.stdout: create 245/38 file after the snapshot 2024-04-12T19:42:31.523 INFO:tasks.workunit.client.0.smithi131.stdout: create 245/39 file after the snapshot 2024-04-12T19:42:31.530 INFO:tasks.workunit.client.0.smithi131.stdout: create 246/.snap/snap-subdir-test 2024-04-12T19:42:31.577 INFO:tasks.workunit.client.0.smithi131.stdout: create 246/30 file after the snapshot 2024-04-12T19:42:31.583 INFO:tasks.workunit.client.0.smithi131.stdout: create 246/31 file after the snapshot 2024-04-12T19:42:31.591 INFO:tasks.workunit.client.0.smithi131.stdout: create 246/32 file after the snapshot 2024-04-12T19:42:31.598 INFO:tasks.workunit.client.0.smithi131.stdout: create 246/33 file after the snapshot 2024-04-12T19:42:31.605 INFO:tasks.workunit.client.0.smithi131.stdout: create 246/34 file after the snapshot 2024-04-12T19:42:31.613 INFO:tasks.workunit.client.0.smithi131.stdout: create 246/35 file after the snapshot 2024-04-12T19:42:31.622 INFO:tasks.workunit.client.0.smithi131.stdout: create 246/36 file after the snapshot 2024-04-12T19:42:31.630 INFO:tasks.workunit.client.0.smithi131.stdout: create 246/37 file after the snapshot 2024-04-12T19:42:31.639 INFO:tasks.workunit.client.0.smithi131.stdout: create 246/38 file after the snapshot 2024-04-12T19:42:31.647 INFO:tasks.workunit.client.0.smithi131.stdout: create 246/39 file after the snapshot 2024-04-12T19:42:31.655 INFO:tasks.workunit.client.0.smithi131.stdout: create 247/.snap/snap-subdir-test 2024-04-12T19:42:31.700 INFO:tasks.workunit.client.0.smithi131.stdout: create 247/30 file after the snapshot 2024-04-12T19:42:31.705 INFO:tasks.workunit.client.0.smithi131.stdout: create 247/31 file after the snapshot 2024-04-12T19:42:31.712 INFO:tasks.workunit.client.0.smithi131.stdout: create 247/32 file after the snapshot 2024-04-12T19:42:31.719 INFO:tasks.workunit.client.0.smithi131.stdout: create 247/33 file after the snapshot 2024-04-12T19:42:31.727 INFO:tasks.workunit.client.0.smithi131.stdout: create 247/34 file after the snapshot 2024-04-12T19:42:31.735 INFO:tasks.workunit.client.0.smithi131.stdout: create 247/35 file after the snapshot 2024-04-12T19:42:31.742 INFO:tasks.workunit.client.0.smithi131.stdout: create 247/36 file after the snapshot 2024-04-12T19:42:31.750 INFO:tasks.workunit.client.0.smithi131.stdout: create 247/37 file after the snapshot 2024-04-12T19:42:31.756 INFO:tasks.workunit.client.0.smithi131.stdout: create 247/38 file after the snapshot 2024-04-12T19:42:31.764 INFO:tasks.workunit.client.0.smithi131.stdout: create 247/39 file after the snapshot 2024-04-12T19:42:31.770 INFO:tasks.workunit.client.0.smithi131.stdout: create 248/.snap/snap-subdir-test 2024-04-12T19:42:31.820 INFO:tasks.workunit.client.0.smithi131.stdout: create 248/30 file after the snapshot 2024-04-12T19:42:31.826 INFO:tasks.workunit.client.0.smithi131.stdout: create 248/31 file after the snapshot 2024-04-12T19:42:31.833 INFO:tasks.workunit.client.0.smithi131.stdout: create 248/32 file after the snapshot 2024-04-12T19:42:31.840 INFO:tasks.workunit.client.0.smithi131.stdout: create 248/33 file after the snapshot 2024-04-12T19:42:31.847 INFO:tasks.workunit.client.0.smithi131.stdout: create 248/34 file after the snapshot 2024-04-12T19:42:31.855 INFO:tasks.workunit.client.0.smithi131.stdout: create 248/35 file after the snapshot 2024-04-12T19:42:31.862 INFO:tasks.workunit.client.0.smithi131.stdout: create 248/36 file after the snapshot 2024-04-12T19:42:31.870 INFO:tasks.workunit.client.0.smithi131.stdout: create 248/37 file after the snapshot 2024-04-12T19:42:31.877 INFO:tasks.workunit.client.0.smithi131.stdout: create 248/38 file after the snapshot 2024-04-12T19:42:31.883 INFO:tasks.workunit.client.0.smithi131.stdout: create 248/39 file after the snapshot 2024-04-12T19:42:31.891 INFO:tasks.workunit.client.0.smithi131.stdout: create 249/.snap/snap-subdir-test 2024-04-12T19:42:31.934 INFO:tasks.workunit.client.0.smithi131.stdout: create 249/30 file after the snapshot 2024-04-12T19:42:31.939 INFO:tasks.workunit.client.0.smithi131.stdout: create 249/31 file after the snapshot 2024-04-12T19:42:31.946 INFO:tasks.workunit.client.0.smithi131.stdout: create 249/32 file after the snapshot 2024-04-12T19:42:31.954 INFO:tasks.workunit.client.0.smithi131.stdout: create 249/33 file after the snapshot 2024-04-12T19:42:31.961 INFO:tasks.workunit.client.0.smithi131.stdout: create 249/34 file after the snapshot 2024-04-12T19:42:31.971 INFO:tasks.workunit.client.0.smithi131.stdout: create 249/35 file after the snapshot 2024-04-12T19:42:31.979 INFO:tasks.workunit.client.0.smithi131.stdout: create 249/36 file after the snapshot 2024-04-12T19:42:31.986 INFO:tasks.workunit.client.0.smithi131.stdout: create 249/37 file after the snapshot 2024-04-12T19:42:31.993 INFO:tasks.workunit.client.0.smithi131.stdout: create 249/38 file after the snapshot 2024-04-12T19:42:32.001 INFO:tasks.workunit.client.0.smithi131.stdout: create 249/39 file after the snapshot 2024-04-12T19:42:32.009 INFO:tasks.workunit.client.0.smithi131.stdout: create 250/.snap/snap-subdir-test 2024-04-12T19:42:32.059 INFO:tasks.workunit.client.0.smithi131.stdout: create 250/30 file after the snapshot 2024-04-12T19:42:32.065 INFO:tasks.workunit.client.0.smithi131.stdout: create 250/31 file after the snapshot 2024-04-12T19:42:32.072 INFO:tasks.workunit.client.0.smithi131.stdout: create 250/32 file after the snapshot 2024-04-12T19:42:32.081 INFO:tasks.workunit.client.0.smithi131.stdout: create 250/33 file after the snapshot 2024-04-12T19:42:32.089 INFO:tasks.workunit.client.0.smithi131.stdout: create 250/34 file after the snapshot 2024-04-12T19:42:32.096 INFO:tasks.workunit.client.0.smithi131.stdout: create 250/35 file after the snapshot 2024-04-12T19:42:32.104 INFO:tasks.workunit.client.0.smithi131.stdout: create 250/36 file after the snapshot 2024-04-12T19:42:32.113 INFO:tasks.workunit.client.0.smithi131.stdout: create 250/37 file after the snapshot 2024-04-12T19:42:32.121 INFO:tasks.workunit.client.0.smithi131.stdout: create 250/38 file after the snapshot 2024-04-12T19:42:32.129 INFO:tasks.workunit.client.0.smithi131.stdout: create 250/39 file after the snapshot 2024-04-12T19:42:32.136 INFO:tasks.workunit.client.0.smithi131.stdout: create 251/.snap/snap-subdir-test 2024-04-12T19:42:32.180 INFO:tasks.workunit.client.0.smithi131.stdout: create 251/30 file after the snapshot 2024-04-12T19:42:32.185 INFO:tasks.workunit.client.0.smithi131.stdout: create 251/31 file after the snapshot 2024-04-12T19:42:32.191 INFO:tasks.workunit.client.0.smithi131.stdout: create 251/32 file after the snapshot 2024-04-12T19:42:32.198 INFO:tasks.workunit.client.0.smithi131.stdout: create 251/33 file after the snapshot 2024-04-12T19:42:32.205 INFO:tasks.workunit.client.0.smithi131.stdout: create 251/34 file after the snapshot 2024-04-12T19:42:32.213 INFO:tasks.workunit.client.0.smithi131.stdout: create 251/35 file after the snapshot 2024-04-12T19:42:32.221 INFO:tasks.workunit.client.0.smithi131.stdout: create 251/36 file after the snapshot 2024-04-12T19:42:32.228 INFO:tasks.workunit.client.0.smithi131.stdout: create 251/37 file after the snapshot 2024-04-12T19:42:32.236 INFO:tasks.workunit.client.0.smithi131.stdout: create 251/38 file after the snapshot 2024-04-12T19:42:32.244 INFO:tasks.workunit.client.0.smithi131.stdout: create 251/39 file after the snapshot 2024-04-12T19:42:32.252 INFO:tasks.workunit.client.0.smithi131.stdout: create 252/.snap/snap-subdir-test 2024-04-12T19:42:32.293 INFO:tasks.workunit.client.0.smithi131.stdout: create 252/30 file after the snapshot 2024-04-12T19:42:32.307 INFO:tasks.workunit.client.0.smithi131.stdout: create 252/31 file after the snapshot 2024-04-12T19:42:32.362 INFO:tasks.workunit.client.0.smithi131.stdout: create 252/32 file after the snapshot 2024-04-12T19:42:32.368 INFO:tasks.workunit.client.0.smithi131.stdout: create 252/33 file after the snapshot 2024-04-12T19:42:32.377 INFO:tasks.workunit.client.0.smithi131.stdout: create 252/34 file after the snapshot 2024-04-12T19:42:32.384 INFO:tasks.workunit.client.0.smithi131.stdout: create 252/35 file after the snapshot 2024-04-12T19:42:32.392 INFO:tasks.workunit.client.0.smithi131.stdout: create 252/36 file after the snapshot 2024-04-12T19:42:32.400 INFO:tasks.workunit.client.0.smithi131.stdout: create 252/37 file after the snapshot 2024-04-12T19:42:32.407 INFO:tasks.workunit.client.0.smithi131.stdout: create 252/38 file after the snapshot 2024-04-12T19:42:32.415 INFO:tasks.workunit.client.0.smithi131.stdout: create 252/39 file after the snapshot 2024-04-12T19:42:32.422 INFO:tasks.workunit.client.0.smithi131.stdout: create 253/.snap/snap-subdir-test 2024-04-12T19:42:32.502 INFO:tasks.workunit.client.0.smithi131.stdout: create 253/30 file after the snapshot 2024-04-12T19:42:32.507 INFO:tasks.workunit.client.0.smithi131.stdout: create 253/31 file after the snapshot 2024-04-12T19:42:32.515 INFO:tasks.workunit.client.0.smithi131.stdout: create 253/32 file after the snapshot 2024-04-12T19:42:32.523 INFO:tasks.workunit.client.0.smithi131.stdout: create 253/33 file after the snapshot 2024-04-12T19:42:32.532 INFO:tasks.workunit.client.0.smithi131.stdout: create 253/34 file after the snapshot 2024-04-12T19:42:32.539 INFO:tasks.workunit.client.0.smithi131.stdout: create 253/35 file after the snapshot 2024-04-12T19:42:32.548 INFO:tasks.workunit.client.0.smithi131.stdout: create 253/36 file after the snapshot 2024-04-12T19:42:32.556 INFO:tasks.workunit.client.0.smithi131.stdout: create 253/37 file after the snapshot 2024-04-12T19:42:32.565 INFO:tasks.workunit.client.0.smithi131.stdout: create 253/38 file after the snapshot 2024-04-12T19:42:32.573 INFO:tasks.workunit.client.0.smithi131.stdout: create 253/39 file after the snapshot 2024-04-12T19:42:32.580 INFO:tasks.workunit.client.0.smithi131.stdout: create 254/.snap/snap-subdir-test 2024-04-12T19:42:32.624 INFO:tasks.workunit.client.0.smithi131.stdout: create 254/30 file after the snapshot 2024-04-12T19:42:32.629 INFO:tasks.workunit.client.0.smithi131.stdout: create 254/31 file after the snapshot 2024-04-12T19:42:32.635 INFO:tasks.workunit.client.0.smithi131.stdout: create 254/32 file after the snapshot 2024-04-12T19:42:32.643 INFO:tasks.workunit.client.0.smithi131.stdout: create 254/33 file after the snapshot 2024-04-12T19:42:32.651 INFO:tasks.workunit.client.0.smithi131.stdout: create 254/34 file after the snapshot 2024-04-12T19:42:32.660 INFO:tasks.workunit.client.0.smithi131.stdout: create 254/35 file after the snapshot 2024-04-12T19:42:32.668 INFO:tasks.workunit.client.0.smithi131.stdout: create 254/36 file after the snapshot 2024-04-12T19:42:32.675 INFO:tasks.workunit.client.0.smithi131.stdout: create 254/37 file after the snapshot 2024-04-12T19:42:32.683 INFO:tasks.workunit.client.0.smithi131.stdout: create 254/38 file after the snapshot 2024-04-12T19:42:32.692 INFO:tasks.workunit.client.0.smithi131.stdout: create 254/39 file after the snapshot 2024-04-12T19:42:32.700 INFO:tasks.workunit.client.0.smithi131.stdout: create 255/.snap/snap-subdir-test 2024-04-12T19:42:32.749 INFO:tasks.workunit.client.0.smithi131.stdout: create 255/30 file after the snapshot 2024-04-12T19:42:32.754 INFO:tasks.workunit.client.0.smithi131.stdout: create 255/31 file after the snapshot 2024-04-12T19:42:32.761 INFO:tasks.workunit.client.0.smithi131.stdout: create 255/32 file after the snapshot 2024-04-12T19:42:32.769 INFO:tasks.workunit.client.0.smithi131.stdout: create 255/33 file after the snapshot 2024-04-12T19:42:32.778 INFO:tasks.workunit.client.0.smithi131.stdout: create 255/34 file after the snapshot 2024-04-12T19:42:32.787 INFO:tasks.workunit.client.0.smithi131.stdout: create 255/35 file after the snapshot 2024-04-12T19:42:32.795 INFO:tasks.workunit.client.0.smithi131.stdout: create 255/36 file after the snapshot 2024-04-12T19:42:32.803 INFO:tasks.workunit.client.0.smithi131.stdout: create 255/37 file after the snapshot 2024-04-12T19:42:32.810 INFO:tasks.workunit.client.0.smithi131.stdout: create 255/38 file after the snapshot 2024-04-12T19:42:32.817 INFO:tasks.workunit.client.0.smithi131.stdout: create 255/39 file after the snapshot 2024-04-12T19:42:32.825 INFO:tasks.workunit.client.0.smithi131.stdout: create 256/.snap/snap-subdir-test 2024-04-12T19:42:32.873 INFO:tasks.workunit.client.0.smithi131.stdout: create 256/30 file after the snapshot 2024-04-12T19:42:32.878 INFO:tasks.workunit.client.0.smithi131.stdout: create 256/31 file after the snapshot 2024-04-12T19:42:32.884 INFO:tasks.workunit.client.0.smithi131.stdout: create 256/32 file after the snapshot 2024-04-12T19:42:32.894 INFO:tasks.workunit.client.0.smithi131.stdout: create 256/33 file after the snapshot 2024-04-12T19:42:32.899 INFO:tasks.workunit.client.0.smithi131.stdout: create 256/34 file after the snapshot 2024-04-12T19:42:32.907 INFO:tasks.workunit.client.0.smithi131.stdout: create 256/35 file after the snapshot 2024-04-12T19:42:32.913 INFO:tasks.workunit.client.0.smithi131.stdout: create 256/36 file after the snapshot 2024-04-12T19:42:32.920 INFO:tasks.workunit.client.0.smithi131.stdout: create 256/37 file after the snapshot 2024-04-12T19:42:32.928 INFO:tasks.workunit.client.0.smithi131.stdout: create 256/38 file after the snapshot 2024-04-12T19:42:32.934 INFO:tasks.workunit.client.0.smithi131.stdout: create 256/39 file after the snapshot 2024-04-12T19:42:32.943 INFO:tasks.workunit.client.0.smithi131.stdout: create 257/.snap/snap-subdir-test 2024-04-12T19:42:32.988 INFO:tasks.workunit.client.0.smithi131.stdout: create 257/30 file after the snapshot 2024-04-12T19:42:32.993 INFO:tasks.workunit.client.0.smithi131.stdout: create 257/31 file after the snapshot 2024-04-12T19:42:33.000 INFO:tasks.workunit.client.0.smithi131.stdout: create 257/32 file after the snapshot 2024-04-12T19:42:33.007 INFO:tasks.workunit.client.0.smithi131.stdout: create 257/33 file after the snapshot 2024-04-12T19:42:33.015 INFO:tasks.workunit.client.0.smithi131.stdout: create 257/34 file after the snapshot 2024-04-12T19:42:33.022 INFO:tasks.workunit.client.0.smithi131.stdout: create 257/35 file after the snapshot 2024-04-12T19:42:33.033 INFO:tasks.workunit.client.0.smithi131.stdout: create 257/36 file after the snapshot 2024-04-12T19:42:33.041 INFO:tasks.workunit.client.0.smithi131.stdout: create 257/37 file after the snapshot 2024-04-12T19:42:33.050 INFO:tasks.workunit.client.0.smithi131.stdout: create 257/38 file after the snapshot 2024-04-12T19:42:33.056 INFO:tasks.workunit.client.0.smithi131.stdout: create 257/39 file after the snapshot 2024-04-12T19:42:33.064 INFO:tasks.workunit.client.0.smithi131.stdout: create 258/.snap/snap-subdir-test 2024-04-12T19:42:33.110 INFO:tasks.workunit.client.0.smithi131.stdout: create 258/30 file after the snapshot 2024-04-12T19:42:33.115 INFO:tasks.workunit.client.0.smithi131.stdout: create 258/31 file after the snapshot 2024-04-12T19:42:33.122 INFO:tasks.workunit.client.0.smithi131.stdout: create 258/32 file after the snapshot 2024-04-12T19:42:33.128 INFO:tasks.workunit.client.0.smithi131.stdout: create 258/33 file after the snapshot 2024-04-12T19:42:33.135 INFO:tasks.workunit.client.0.smithi131.stdout: create 258/34 file after the snapshot 2024-04-12T19:42:33.142 INFO:tasks.workunit.client.0.smithi131.stdout: create 258/35 file after the snapshot 2024-04-12T19:42:33.149 INFO:tasks.workunit.client.0.smithi131.stdout: create 258/36 file after the snapshot 2024-04-12T19:42:33.156 INFO:tasks.workunit.client.0.smithi131.stdout: create 258/37 file after the snapshot 2024-04-12T19:42:33.164 INFO:tasks.workunit.client.0.smithi131.stdout: create 258/38 file after the snapshot 2024-04-12T19:42:33.172 INFO:tasks.workunit.client.0.smithi131.stdout: create 258/39 file after the snapshot 2024-04-12T19:42:33.179 INFO:tasks.workunit.client.0.smithi131.stdout: create 259/.snap/snap-subdir-test 2024-04-12T19:42:33.223 INFO:tasks.workunit.client.0.smithi131.stdout: create 259/30 file after the snapshot 2024-04-12T19:42:33.228 INFO:tasks.workunit.client.0.smithi131.stdout: create 259/31 file after the snapshot 2024-04-12T19:42:33.235 INFO:tasks.workunit.client.0.smithi131.stdout: create 259/32 file after the snapshot 2024-04-12T19:42:33.243 INFO:tasks.workunit.client.0.smithi131.stdout: create 259/33 file after the snapshot 2024-04-12T19:42:33.252 INFO:tasks.workunit.client.0.smithi131.stdout: create 259/34 file after the snapshot 2024-04-12T19:42:33.260 INFO:tasks.workunit.client.0.smithi131.stdout: create 259/35 file after the snapshot 2024-04-12T19:42:33.268 INFO:tasks.workunit.client.0.smithi131.stdout: create 259/36 file after the snapshot 2024-04-12T19:42:33.277 INFO:tasks.workunit.client.0.smithi131.stdout: create 259/37 file after the snapshot 2024-04-12T19:42:33.284 INFO:tasks.workunit.client.0.smithi131.stdout: create 259/38 file after the snapshot 2024-04-12T19:42:33.291 INFO:tasks.workunit.client.0.smithi131.stdout: create 259/39 file after the snapshot 2024-04-12T19:42:33.299 INFO:tasks.workunit.client.0.smithi131.stdout: create 260/.snap/snap-subdir-test 2024-04-12T19:42:33.443 INFO:tasks.workunit.client.0.smithi131.stdout: create 260/30 file after the snapshot 2024-04-12T19:42:33.449 INFO:tasks.workunit.client.0.smithi131.stdout: create 260/31 file after the snapshot 2024-04-12T19:42:33.456 INFO:tasks.workunit.client.0.smithi131.stdout: create 260/32 file after the snapshot 2024-04-12T19:42:33.464 INFO:tasks.workunit.client.0.smithi131.stdout: create 260/33 file after the snapshot 2024-04-12T19:42:33.472 INFO:tasks.workunit.client.0.smithi131.stdout: create 260/34 file after the snapshot 2024-04-12T19:42:33.480 INFO:tasks.workunit.client.0.smithi131.stdout: create 260/35 file after the snapshot 2024-04-12T19:42:33.488 INFO:tasks.workunit.client.0.smithi131.stdout: create 260/36 file after the snapshot 2024-04-12T19:42:33.496 INFO:tasks.workunit.client.0.smithi131.stdout: create 260/37 file after the snapshot 2024-04-12T19:42:33.503 INFO:tasks.workunit.client.0.smithi131.stdout: create 260/38 file after the snapshot 2024-04-12T19:42:33.512 INFO:tasks.workunit.client.0.smithi131.stdout: create 260/39 file after the snapshot 2024-04-12T19:42:33.520 INFO:tasks.workunit.client.0.smithi131.stdout: create 261/.snap/snap-subdir-test 2024-04-12T19:42:33.565 INFO:tasks.workunit.client.0.smithi131.stdout: create 261/30 file after the snapshot 2024-04-12T19:42:33.571 INFO:tasks.workunit.client.0.smithi131.stdout: create 261/31 file after the snapshot 2024-04-12T19:42:33.579 INFO:tasks.workunit.client.0.smithi131.stdout: create 261/32 file after the snapshot 2024-04-12T19:42:33.586 INFO:tasks.workunit.client.0.smithi131.stdout: create 261/33 file after the snapshot 2024-04-12T19:42:33.595 INFO:tasks.workunit.client.0.smithi131.stdout: create 261/34 file after the snapshot 2024-04-12T19:42:33.603 INFO:tasks.workunit.client.0.smithi131.stdout: create 261/35 file after the snapshot 2024-04-12T19:42:33.611 INFO:tasks.workunit.client.0.smithi131.stdout: create 261/36 file after the snapshot 2024-04-12T19:42:33.620 INFO:tasks.workunit.client.0.smithi131.stdout: create 261/37 file after the snapshot 2024-04-12T19:42:33.627 INFO:tasks.workunit.client.0.smithi131.stdout: create 261/38 file after the snapshot 2024-04-12T19:42:33.634 INFO:tasks.workunit.client.0.smithi131.stdout: create 261/39 file after the snapshot 2024-04-12T19:42:33.641 INFO:tasks.workunit.client.0.smithi131.stdout: create 262/.snap/snap-subdir-test 2024-04-12T19:42:33.690 INFO:tasks.workunit.client.0.smithi131.stdout: create 262/30 file after the snapshot 2024-04-12T19:42:33.695 INFO:tasks.workunit.client.0.smithi131.stdout: create 262/31 file after the snapshot 2024-04-12T19:42:33.702 INFO:tasks.workunit.client.0.smithi131.stdout: create 262/32 file after the snapshot 2024-04-12T19:42:33.712 INFO:tasks.workunit.client.0.smithi131.stdout: create 262/33 file after the snapshot 2024-04-12T19:42:33.719 INFO:tasks.workunit.client.0.smithi131.stdout: create 262/34 file after the snapshot 2024-04-12T19:42:33.727 INFO:tasks.workunit.client.0.smithi131.stdout: create 262/35 file after the snapshot 2024-04-12T19:42:33.735 INFO:tasks.workunit.client.0.smithi131.stdout: create 262/36 file after the snapshot 2024-04-12T19:42:33.743 INFO:tasks.workunit.client.0.smithi131.stdout: create 262/37 file after the snapshot 2024-04-12T19:42:33.751 INFO:tasks.workunit.client.0.smithi131.stdout: create 262/38 file after the snapshot 2024-04-12T19:42:33.759 INFO:tasks.workunit.client.0.smithi131.stdout: create 262/39 file after the snapshot 2024-04-12T19:42:33.767 INFO:tasks.workunit.client.0.smithi131.stdout: create 263/.snap/snap-subdir-test 2024-04-12T19:42:33.823 INFO:tasks.workunit.client.0.smithi131.stdout: create 263/30 file after the snapshot 2024-04-12T19:42:33.829 INFO:tasks.workunit.client.0.smithi131.stdout: create 263/31 file after the snapshot 2024-04-12T19:42:33.836 INFO:tasks.workunit.client.0.smithi131.stdout: create 263/32 file after the snapshot 2024-04-12T19:42:33.843 INFO:tasks.workunit.client.0.smithi131.stdout: create 263/33 file after the snapshot 2024-04-12T19:42:33.851 INFO:tasks.workunit.client.0.smithi131.stdout: create 263/34 file after the snapshot 2024-04-12T19:42:33.859 INFO:tasks.workunit.client.0.smithi131.stdout: create 263/35 file after the snapshot 2024-04-12T19:42:33.866 INFO:tasks.workunit.client.0.smithi131.stdout: create 263/36 file after the snapshot 2024-04-12T19:42:33.875 INFO:tasks.workunit.client.0.smithi131.stdout: create 263/37 file after the snapshot 2024-04-12T19:42:33.882 INFO:tasks.workunit.client.0.smithi131.stdout: create 263/38 file after the snapshot 2024-04-12T19:42:33.893 INFO:tasks.workunit.client.0.smithi131.stdout: create 263/39 file after the snapshot 2024-04-12T19:42:33.900 INFO:tasks.workunit.client.0.smithi131.stdout: create 264/.snap/snap-subdir-test 2024-04-12T19:42:33.945 INFO:tasks.workunit.client.0.smithi131.stdout: create 264/30 file after the snapshot 2024-04-12T19:42:33.951 INFO:tasks.workunit.client.0.smithi131.stdout: create 264/31 file after the snapshot 2024-04-12T19:42:33.957 INFO:tasks.workunit.client.0.smithi131.stdout: create 264/32 file after the snapshot 2024-04-12T19:42:33.964 INFO:tasks.workunit.client.0.smithi131.stdout: create 264/33 file after the snapshot 2024-04-12T19:42:33.972 INFO:tasks.workunit.client.0.smithi131.stdout: create 264/34 file after the snapshot 2024-04-12T19:42:33.981 INFO:tasks.workunit.client.0.smithi131.stdout: create 264/35 file after the snapshot 2024-04-12T19:42:33.989 INFO:tasks.workunit.client.0.smithi131.stdout: create 264/36 file after the snapshot 2024-04-12T19:42:33.997 INFO:tasks.workunit.client.0.smithi131.stdout: create 264/37 file after the snapshot 2024-04-12T19:42:34.005 INFO:tasks.workunit.client.0.smithi131.stdout: create 264/38 file after the snapshot 2024-04-12T19:42:34.013 INFO:tasks.workunit.client.0.smithi131.stdout: create 264/39 file after the snapshot 2024-04-12T19:42:34.020 INFO:tasks.workunit.client.0.smithi131.stdout: create 265/.snap/snap-subdir-test 2024-04-12T19:42:34.065 INFO:tasks.workunit.client.0.smithi131.stdout: create 265/30 file after the snapshot 2024-04-12T19:42:34.070 INFO:tasks.workunit.client.0.smithi131.stdout: create 265/31 file after the snapshot 2024-04-12T19:42:34.077 INFO:tasks.workunit.client.0.smithi131.stdout: create 265/32 file after the snapshot 2024-04-12T19:42:34.084 INFO:tasks.workunit.client.0.smithi131.stdout: create 265/33 file after the snapshot 2024-04-12T19:42:34.092 INFO:tasks.workunit.client.0.smithi131.stdout: create 265/34 file after the snapshot 2024-04-12T19:42:34.100 INFO:tasks.workunit.client.0.smithi131.stdout: create 265/35 file after the snapshot 2024-04-12T19:42:34.107 INFO:tasks.workunit.client.0.smithi131.stdout: create 265/36 file after the snapshot 2024-04-12T19:42:34.117 INFO:tasks.workunit.client.0.smithi131.stdout: create 265/37 file after the snapshot 2024-04-12T19:42:34.125 INFO:tasks.workunit.client.0.smithi131.stdout: create 265/38 file after the snapshot 2024-04-12T19:42:34.131 INFO:tasks.workunit.client.0.smithi131.stdout: create 265/39 file after the snapshot 2024-04-12T19:42:34.138 INFO:tasks.workunit.client.0.smithi131.stdout: create 266/.snap/snap-subdir-test 2024-04-12T19:42:34.185 INFO:tasks.workunit.client.0.smithi131.stdout: create 266/30 file after the snapshot 2024-04-12T19:42:34.190 INFO:tasks.workunit.client.0.smithi131.stdout: create 266/31 file after the snapshot 2024-04-12T19:42:34.196 INFO:tasks.workunit.client.0.smithi131.stdout: create 266/32 file after the snapshot 2024-04-12T19:42:34.205 INFO:tasks.workunit.client.0.smithi131.stdout: create 266/33 file after the snapshot 2024-04-12T19:42:34.212 INFO:tasks.workunit.client.0.smithi131.stdout: create 266/34 file after the snapshot 2024-04-12T19:42:34.221 INFO:tasks.workunit.client.0.smithi131.stdout: create 266/35 file after the snapshot 2024-04-12T19:42:34.229 INFO:tasks.workunit.client.0.smithi131.stdout: create 266/36 file after the snapshot 2024-04-12T19:42:34.236 INFO:tasks.workunit.client.0.smithi131.stdout: create 266/37 file after the snapshot 2024-04-12T19:42:34.242 INFO:tasks.workunit.client.0.smithi131.stdout: create 266/38 file after the snapshot 2024-04-12T19:42:34.249 INFO:tasks.workunit.client.0.smithi131.stdout: create 266/39 file after the snapshot 2024-04-12T19:42:34.258 INFO:tasks.workunit.client.0.smithi131.stdout: create 267/.snap/snap-subdir-test 2024-04-12T19:42:34.304 INFO:tasks.workunit.client.0.smithi131.stdout: create 267/30 file after the snapshot 2024-04-12T19:42:34.309 INFO:tasks.workunit.client.0.smithi131.stdout: create 267/31 file after the snapshot 2024-04-12T19:42:34.325 INFO:tasks.workunit.client.0.smithi131.stdout: create 267/32 file after the snapshot 2024-04-12T19:42:34.391 INFO:tasks.workunit.client.0.smithi131.stdout: create 267/33 file after the snapshot 2024-04-12T19:42:34.397 INFO:tasks.workunit.client.0.smithi131.stdout: create 267/34 file after the snapshot 2024-04-12T19:42:34.406 INFO:tasks.workunit.client.0.smithi131.stdout: create 267/35 file after the snapshot 2024-04-12T19:42:34.415 INFO:tasks.workunit.client.0.smithi131.stdout: create 267/36 file after the snapshot 2024-04-12T19:42:34.422 INFO:tasks.workunit.client.0.smithi131.stdout: create 267/37 file after the snapshot 2024-04-12T19:42:34.430 INFO:tasks.workunit.client.0.smithi131.stdout: create 267/38 file after the snapshot 2024-04-12T19:42:34.439 INFO:tasks.workunit.client.0.smithi131.stdout: create 267/39 file after the snapshot 2024-04-12T19:42:34.446 INFO:tasks.workunit.client.0.smithi131.stdout: create 268/.snap/snap-subdir-test 2024-04-12T19:42:34.524 INFO:tasks.workunit.client.0.smithi131.stdout: create 268/30 file after the snapshot 2024-04-12T19:42:34.530 INFO:tasks.workunit.client.0.smithi131.stdout: create 268/31 file after the snapshot 2024-04-12T19:42:34.536 INFO:tasks.workunit.client.0.smithi131.stdout: create 268/32 file after the snapshot 2024-04-12T19:42:34.544 INFO:tasks.workunit.client.0.smithi131.stdout: create 268/33 file after the snapshot 2024-04-12T19:42:34.553 INFO:tasks.workunit.client.0.smithi131.stdout: create 268/34 file after the snapshot 2024-04-12T19:42:34.562 INFO:tasks.workunit.client.0.smithi131.stdout: create 268/35 file after the snapshot 2024-04-12T19:42:34.569 INFO:tasks.workunit.client.0.smithi131.stdout: create 268/36 file after the snapshot 2024-04-12T19:42:34.576 INFO:tasks.workunit.client.0.smithi131.stdout: create 268/37 file after the snapshot 2024-04-12T19:42:34.584 INFO:tasks.workunit.client.0.smithi131.stdout: create 268/38 file after the snapshot 2024-04-12T19:42:34.591 INFO:tasks.workunit.client.0.smithi131.stdout: create 268/39 file after the snapshot 2024-04-12T19:42:34.599 INFO:tasks.workunit.client.0.smithi131.stdout: create 269/.snap/snap-subdir-test 2024-04-12T19:42:34.660 INFO:tasks.workunit.client.0.smithi131.stdout: create 269/30 file after the snapshot 2024-04-12T19:42:34.665 INFO:tasks.workunit.client.0.smithi131.stdout: create 269/31 file after the snapshot 2024-04-12T19:42:34.671 INFO:tasks.workunit.client.0.smithi131.stdout: create 269/32 file after the snapshot 2024-04-12T19:42:34.680 INFO:tasks.workunit.client.0.smithi131.stdout: create 269/33 file after the snapshot 2024-04-12T19:42:34.688 INFO:tasks.workunit.client.0.smithi131.stdout: create 269/34 file after the snapshot 2024-04-12T19:42:34.698 INFO:tasks.workunit.client.0.smithi131.stdout: create 269/35 file after the snapshot 2024-04-12T19:42:34.708 INFO:tasks.workunit.client.0.smithi131.stdout: create 269/36 file after the snapshot 2024-04-12T19:42:34.717 INFO:tasks.workunit.client.0.smithi131.stdout: create 269/37 file after the snapshot 2024-04-12T19:42:34.725 INFO:tasks.workunit.client.0.smithi131.stdout: create 269/38 file after the snapshot 2024-04-12T19:42:34.733 INFO:tasks.workunit.client.0.smithi131.stdout: create 269/39 file after the snapshot 2024-04-12T19:42:34.741 INFO:tasks.workunit.client.0.smithi131.stdout: create 270/.snap/snap-subdir-test 2024-04-12T19:42:34.793 INFO:tasks.workunit.client.0.smithi131.stdout: create 270/30 file after the snapshot 2024-04-12T19:42:34.799 INFO:tasks.workunit.client.0.smithi131.stdout: create 270/31 file after the snapshot 2024-04-12T19:42:34.806 INFO:tasks.workunit.client.0.smithi131.stdout: create 270/32 file after the snapshot 2024-04-12T19:42:34.812 INFO:tasks.workunit.client.0.smithi131.stdout: create 270/33 file after the snapshot 2024-04-12T19:42:34.820 INFO:tasks.workunit.client.0.smithi131.stdout: create 270/34 file after the snapshot 2024-04-12T19:42:34.829 INFO:tasks.workunit.client.0.smithi131.stdout: create 270/35 file after the snapshot 2024-04-12T19:42:34.837 INFO:tasks.workunit.client.0.smithi131.stdout: create 270/36 file after the snapshot 2024-04-12T19:42:34.845 INFO:tasks.workunit.client.0.smithi131.stdout: create 270/37 file after the snapshot 2024-04-12T19:42:34.852 INFO:tasks.workunit.client.0.smithi131.stdout: create 270/38 file after the snapshot 2024-04-12T19:42:34.859 INFO:tasks.workunit.client.0.smithi131.stdout: create 270/39 file after the snapshot 2024-04-12T19:42:34.867 INFO:tasks.workunit.client.0.smithi131.stdout: create 271/.snap/snap-subdir-test 2024-04-12T19:42:34.917 INFO:tasks.workunit.client.0.smithi131.stdout: create 271/30 file after the snapshot 2024-04-12T19:42:34.922 INFO:tasks.workunit.client.0.smithi131.stdout: create 271/31 file after the snapshot 2024-04-12T19:42:34.930 INFO:tasks.workunit.client.0.smithi131.stdout: create 271/32 file after the snapshot 2024-04-12T19:42:34.937 INFO:tasks.workunit.client.0.smithi131.stdout: create 271/33 file after the snapshot 2024-04-12T19:42:34.945 INFO:tasks.workunit.client.0.smithi131.stdout: create 271/34 file after the snapshot 2024-04-12T19:42:34.953 INFO:tasks.workunit.client.0.smithi131.stdout: create 271/35 file after the snapshot 2024-04-12T19:42:34.961 INFO:tasks.workunit.client.0.smithi131.stdout: create 271/36 file after the snapshot 2024-04-12T19:42:34.970 INFO:tasks.workunit.client.0.smithi131.stdout: create 271/37 file after the snapshot 2024-04-12T19:42:34.978 INFO:tasks.workunit.client.0.smithi131.stdout: create 271/38 file after the snapshot 2024-04-12T19:42:34.986 INFO:tasks.workunit.client.0.smithi131.stdout: create 271/39 file after the snapshot 2024-04-12T19:42:34.993 INFO:tasks.workunit.client.0.smithi131.stdout: create 272/.snap/snap-subdir-test 2024-04-12T19:42:35.040 INFO:tasks.workunit.client.0.smithi131.stdout: create 272/30 file after the snapshot 2024-04-12T19:42:35.047 INFO:tasks.workunit.client.0.smithi131.stdout: create 272/31 file after the snapshot 2024-04-12T19:42:35.055 INFO:tasks.workunit.client.0.smithi131.stdout: create 272/32 file after the snapshot 2024-04-12T19:42:35.062 INFO:tasks.workunit.client.0.smithi131.stdout: create 272/33 file after the snapshot 2024-04-12T19:42:35.070 INFO:tasks.workunit.client.0.smithi131.stdout: create 272/34 file after the snapshot 2024-04-12T19:42:35.078 INFO:tasks.workunit.client.0.smithi131.stdout: create 272/35 file after the snapshot 2024-04-12T19:42:35.086 INFO:tasks.workunit.client.0.smithi131.stdout: create 272/36 file after the snapshot 2024-04-12T19:42:35.093 INFO:tasks.workunit.client.0.smithi131.stdout: create 272/37 file after the snapshot 2024-04-12T19:42:35.101 INFO:tasks.workunit.client.0.smithi131.stdout: create 272/38 file after the snapshot 2024-04-12T19:42:35.109 INFO:tasks.workunit.client.0.smithi131.stdout: create 272/39 file after the snapshot 2024-04-12T19:42:35.118 INFO:tasks.workunit.client.0.smithi131.stdout: create 273/.snap/snap-subdir-test 2024-04-12T19:42:35.165 INFO:tasks.workunit.client.0.smithi131.stdout: create 273/30 file after the snapshot 2024-04-12T19:42:35.169 INFO:tasks.workunit.client.0.smithi131.stdout: create 273/31 file after the snapshot 2024-04-12T19:42:35.177 INFO:tasks.workunit.client.0.smithi131.stdout: create 273/32 file after the snapshot 2024-04-12T19:42:35.184 INFO:tasks.workunit.client.0.smithi131.stdout: create 273/33 file after the snapshot 2024-04-12T19:42:35.192 INFO:tasks.workunit.client.0.smithi131.stdout: create 273/34 file after the snapshot 2024-04-12T19:42:35.200 INFO:tasks.workunit.client.0.smithi131.stdout: create 273/35 file after the snapshot 2024-04-12T19:42:35.207 INFO:tasks.workunit.client.0.smithi131.stdout: create 273/36 file after the snapshot 2024-04-12T19:42:35.215 INFO:tasks.workunit.client.0.smithi131.stdout: create 273/37 file after the snapshot 2024-04-12T19:42:35.224 INFO:tasks.workunit.client.0.smithi131.stdout: create 273/38 file after the snapshot 2024-04-12T19:42:35.232 INFO:tasks.workunit.client.0.smithi131.stdout: create 273/39 file after the snapshot 2024-04-12T19:42:35.239 INFO:tasks.workunit.client.0.smithi131.stdout: create 274/.snap/snap-subdir-test 2024-04-12T19:42:35.283 INFO:tasks.workunit.client.0.smithi131.stdout: create 274/30 file after the snapshot 2024-04-12T19:42:35.288 INFO:tasks.workunit.client.0.smithi131.stdout: create 274/31 file after the snapshot 2024-04-12T19:42:35.296 INFO:tasks.workunit.client.0.smithi131.stdout: create 274/32 file after the snapshot 2024-04-12T19:42:35.304 INFO:tasks.workunit.client.0.smithi131.stdout: create 274/33 file after the snapshot 2024-04-12T19:42:35.312 INFO:tasks.workunit.client.0.smithi131.stdout: create 274/34 file after the snapshot 2024-04-12T19:42:35.320 INFO:tasks.workunit.client.0.smithi131.stdout: create 274/35 file after the snapshot 2024-04-12T19:42:35.335 INFO:tasks.workunit.client.0.smithi131.stdout: create 274/36 file after the snapshot 2024-04-12T19:42:35.386 INFO:tasks.workunit.client.0.smithi131.stdout: create 274/37 file after the snapshot 2024-04-12T19:42:35.393 INFO:tasks.workunit.client.0.smithi131.stdout: create 274/38 file after the snapshot 2024-04-12T19:42:35.401 INFO:tasks.workunit.client.0.smithi131.stdout: create 274/39 file after the snapshot 2024-04-12T19:42:35.408 INFO:tasks.workunit.client.0.smithi131.stdout: create 275/.snap/snap-subdir-test 2024-04-12T19:42:35.502 INFO:tasks.workunit.client.0.smithi131.stdout: create 275/30 file after the snapshot 2024-04-12T19:42:35.509 INFO:tasks.workunit.client.0.smithi131.stdout: create 275/31 file after the snapshot 2024-04-12T19:42:35.517 INFO:tasks.workunit.client.0.smithi131.stdout: create 275/32 file after the snapshot 2024-04-12T19:42:35.526 INFO:tasks.workunit.client.0.smithi131.stdout: create 275/33 file after the snapshot 2024-04-12T19:42:35.536 INFO:tasks.workunit.client.0.smithi131.stdout: create 275/34 file after the snapshot 2024-04-12T19:42:35.545 INFO:tasks.workunit.client.0.smithi131.stdout: create 275/35 file after the snapshot 2024-04-12T19:42:35.553 INFO:tasks.workunit.client.0.smithi131.stdout: create 275/36 file after the snapshot 2024-04-12T19:42:35.560 INFO:tasks.workunit.client.0.smithi131.stdout: create 275/37 file after the snapshot 2024-04-12T19:42:35.567 INFO:tasks.workunit.client.0.smithi131.stdout: create 275/38 file after the snapshot 2024-04-12T19:42:35.575 INFO:tasks.workunit.client.0.smithi131.stdout: create 275/39 file after the snapshot 2024-04-12T19:42:35.583 INFO:tasks.workunit.client.0.smithi131.stdout: create 276/.snap/snap-subdir-test 2024-04-12T19:42:35.640 INFO:tasks.workunit.client.0.smithi131.stdout: create 276/30 file after the snapshot 2024-04-12T19:42:35.646 INFO:tasks.workunit.client.0.smithi131.stdout: create 276/31 file after the snapshot 2024-04-12T19:42:35.654 INFO:tasks.workunit.client.0.smithi131.stdout: create 276/32 file after the snapshot 2024-04-12T19:42:35.661 INFO:tasks.workunit.client.0.smithi131.stdout: create 276/33 file after the snapshot 2024-04-12T19:42:35.669 INFO:tasks.workunit.client.0.smithi131.stdout: create 276/34 file after the snapshot 2024-04-12T19:42:35.678 INFO:tasks.workunit.client.0.smithi131.stdout: create 276/35 file after the snapshot 2024-04-12T19:42:35.687 INFO:tasks.workunit.client.0.smithi131.stdout: create 276/36 file after the snapshot 2024-04-12T19:42:35.695 INFO:tasks.workunit.client.0.smithi131.stdout: create 276/37 file after the snapshot 2024-04-12T19:42:35.703 INFO:tasks.workunit.client.0.smithi131.stdout: create 276/38 file after the snapshot 2024-04-12T19:42:35.711 INFO:tasks.workunit.client.0.smithi131.stdout: create 276/39 file after the snapshot 2024-04-12T19:42:35.719 INFO:tasks.workunit.client.0.smithi131.stdout: create 277/.snap/snap-subdir-test 2024-04-12T19:42:35.774 INFO:tasks.workunit.client.0.smithi131.stdout: create 277/30 file after the snapshot 2024-04-12T19:42:35.779 INFO:tasks.workunit.client.0.smithi131.stdout: create 277/31 file after the snapshot 2024-04-12T19:42:35.787 INFO:tasks.workunit.client.0.smithi131.stdout: create 277/32 file after the snapshot 2024-04-12T19:42:35.794 INFO:tasks.workunit.client.0.smithi131.stdout: create 277/33 file after the snapshot 2024-04-12T19:42:35.802 INFO:tasks.workunit.client.0.smithi131.stdout: create 277/34 file after the snapshot 2024-04-12T19:42:35.809 INFO:tasks.workunit.client.0.smithi131.stdout: create 277/35 file after the snapshot 2024-04-12T19:42:35.818 INFO:tasks.workunit.client.0.smithi131.stdout: create 277/36 file after the snapshot 2024-04-12T19:42:35.826 INFO:tasks.workunit.client.0.smithi131.stdout: create 277/37 file after the snapshot 2024-04-12T19:42:35.834 INFO:tasks.workunit.client.0.smithi131.stdout: create 277/38 file after the snapshot 2024-04-12T19:42:35.842 INFO:tasks.workunit.client.0.smithi131.stdout: create 277/39 file after the snapshot 2024-04-12T19:42:35.849 INFO:tasks.workunit.client.0.smithi131.stdout: create 278/.snap/snap-subdir-test 2024-04-12T19:42:35.894 INFO:tasks.workunit.client.0.smithi131.stdout: create 278/30 file after the snapshot 2024-04-12T19:42:35.899 INFO:tasks.workunit.client.0.smithi131.stdout: create 278/31 file after the snapshot 2024-04-12T19:42:35.907 INFO:tasks.workunit.client.0.smithi131.stdout: create 278/32 file after the snapshot 2024-04-12T19:42:35.915 INFO:tasks.workunit.client.0.smithi131.stdout: create 278/33 file after the snapshot 2024-04-12T19:42:35.923 INFO:tasks.workunit.client.0.smithi131.stdout: create 278/34 file after the snapshot 2024-04-12T19:42:35.931 INFO:tasks.workunit.client.0.smithi131.stdout: create 278/35 file after the snapshot 2024-04-12T19:42:35.940 INFO:tasks.workunit.client.0.smithi131.stdout: create 278/36 file after the snapshot 2024-04-12T19:42:35.948 INFO:tasks.workunit.client.0.smithi131.stdout: create 278/37 file after the snapshot 2024-04-12T19:42:35.957 INFO:tasks.workunit.client.0.smithi131.stdout: create 278/38 file after the snapshot 2024-04-12T19:42:35.963 INFO:tasks.workunit.client.0.smithi131.stdout: create 278/39 file after the snapshot 2024-04-12T19:42:35.971 INFO:tasks.workunit.client.0.smithi131.stdout: create 279/.snap/snap-subdir-test 2024-04-12T19:42:36.022 INFO:tasks.workunit.client.0.smithi131.stdout: create 279/30 file after the snapshot 2024-04-12T19:42:36.028 INFO:tasks.workunit.client.0.smithi131.stdout: create 279/31 file after the snapshot 2024-04-12T19:42:36.036 INFO:tasks.workunit.client.0.smithi131.stdout: create 279/32 file after the snapshot 2024-04-12T19:42:36.043 INFO:tasks.workunit.client.0.smithi131.stdout: create 279/33 file after the snapshot 2024-04-12T19:42:36.050 INFO:tasks.workunit.client.0.smithi131.stdout: create 279/34 file after the snapshot 2024-04-12T19:42:36.059 INFO:tasks.workunit.client.0.smithi131.stdout: create 279/35 file after the snapshot 2024-04-12T19:42:36.066 INFO:tasks.workunit.client.0.smithi131.stdout: create 279/36 file after the snapshot 2024-04-12T19:42:36.074 INFO:tasks.workunit.client.0.smithi131.stdout: create 279/37 file after the snapshot 2024-04-12T19:42:36.081 INFO:tasks.workunit.client.0.smithi131.stdout: create 279/38 file after the snapshot 2024-04-12T19:42:36.089 INFO:tasks.workunit.client.0.smithi131.stdout: create 279/39 file after the snapshot 2024-04-12T19:42:36.098 INFO:tasks.workunit.client.0.smithi131.stdout: create 280/.snap/snap-subdir-test 2024-04-12T19:42:36.142 INFO:tasks.workunit.client.0.smithi131.stdout: create 280/30 file after the snapshot 2024-04-12T19:42:36.147 INFO:tasks.workunit.client.0.smithi131.stdout: create 280/31 file after the snapshot 2024-04-12T19:42:36.155 INFO:tasks.workunit.client.0.smithi131.stdout: create 280/32 file after the snapshot 2024-04-12T19:42:36.162 INFO:tasks.workunit.client.0.smithi131.stdout: create 280/33 file after the snapshot 2024-04-12T19:42:36.169 INFO:tasks.workunit.client.0.smithi131.stdout: create 280/34 file after the snapshot 2024-04-12T19:42:36.177 INFO:tasks.workunit.client.0.smithi131.stdout: create 280/35 file after the snapshot 2024-04-12T19:42:36.185 INFO:tasks.workunit.client.0.smithi131.stdout: create 280/36 file after the snapshot 2024-04-12T19:42:36.194 INFO:tasks.workunit.client.0.smithi131.stdout: create 280/37 file after the snapshot 2024-04-12T19:42:36.202 INFO:tasks.workunit.client.0.smithi131.stdout: create 280/38 file after the snapshot 2024-04-12T19:42:36.210 INFO:tasks.workunit.client.0.smithi131.stdout: create 280/39 file after the snapshot 2024-04-12T19:42:36.219 INFO:tasks.workunit.client.0.smithi131.stdout: create 281/.snap/snap-subdir-test 2024-04-12T19:42:36.270 INFO:tasks.workunit.client.0.smithi131.stdout: create 281/30 file after the snapshot 2024-04-12T19:42:36.276 INFO:tasks.workunit.client.0.smithi131.stdout: create 281/31 file after the snapshot 2024-04-12T19:42:36.283 INFO:tasks.workunit.client.0.smithi131.stdout: create 281/32 file after the snapshot 2024-04-12T19:42:36.290 INFO:tasks.workunit.client.0.smithi131.stdout: create 281/33 file after the snapshot 2024-04-12T19:42:36.298 INFO:tasks.workunit.client.0.smithi131.stdout: create 281/34 file after the snapshot 2024-04-12T19:42:36.306 INFO:tasks.workunit.client.0.smithi131.stdout: create 281/35 file after the snapshot 2024-04-12T19:42:36.314 INFO:tasks.workunit.client.0.smithi131.stdout: create 281/36 file after the snapshot 2024-04-12T19:42:36.322 INFO:tasks.workunit.client.0.smithi131.stdout: create 281/37 file after the snapshot 2024-04-12T19:42:36.330 INFO:tasks.workunit.client.0.smithi131.stdout: create 281/38 file after the snapshot 2024-04-12T19:42:36.345 INFO:tasks.workunit.client.0.smithi131.stdout: create 281/39 file after the snapshot 2024-04-12T19:42:36.387 INFO:tasks.workunit.client.0.smithi131.stdout: create 282/.snap/snap-subdir-test 2024-04-12T19:42:36.466 INFO:tasks.workunit.client.0.smithi131.stdout: create 282/30 file after the snapshot 2024-04-12T19:42:36.471 INFO:tasks.workunit.client.0.smithi131.stdout: create 282/31 file after the snapshot 2024-04-12T19:42:36.479 INFO:tasks.workunit.client.0.smithi131.stdout: create 282/32 file after the snapshot 2024-04-12T19:42:36.486 INFO:tasks.workunit.client.0.smithi131.stdout: create 282/33 file after the snapshot 2024-04-12T19:42:36.495 INFO:tasks.workunit.client.0.smithi131.stdout: create 282/34 file after the snapshot 2024-04-12T19:42:36.502 INFO:tasks.workunit.client.0.smithi131.stdout: create 282/35 file after the snapshot 2024-04-12T19:42:36.509 INFO:tasks.workunit.client.0.smithi131.stdout: create 282/36 file after the snapshot 2024-04-12T19:42:36.517 INFO:tasks.workunit.client.0.smithi131.stdout: create 282/37 file after the snapshot 2024-04-12T19:42:36.525 INFO:tasks.workunit.client.0.smithi131.stdout: create 282/38 file after the snapshot 2024-04-12T19:42:36.532 INFO:tasks.workunit.client.0.smithi131.stdout: create 282/39 file after the snapshot 2024-04-12T19:42:36.542 INFO:tasks.workunit.client.0.smithi131.stdout: create 283/.snap/snap-subdir-test 2024-04-12T19:42:36.590 INFO:tasks.workunit.client.0.smithi131.stdout: create 283/30 file after the snapshot 2024-04-12T19:42:36.595 INFO:tasks.workunit.client.0.smithi131.stdout: create 283/31 file after the snapshot 2024-04-12T19:42:36.602 INFO:tasks.workunit.client.0.smithi131.stdout: create 283/32 file after the snapshot 2024-04-12T19:42:36.609 INFO:tasks.workunit.client.0.smithi131.stdout: create 283/33 file after the snapshot 2024-04-12T19:42:36.617 INFO:tasks.workunit.client.0.smithi131.stdout: create 283/34 file after the snapshot 2024-04-12T19:42:36.624 INFO:tasks.workunit.client.0.smithi131.stdout: create 283/35 file after the snapshot 2024-04-12T19:42:36.631 INFO:tasks.workunit.client.0.smithi131.stdout: create 283/36 file after the snapshot 2024-04-12T19:42:36.639 INFO:tasks.workunit.client.0.smithi131.stdout: create 283/37 file after the snapshot 2024-04-12T19:42:36.647 INFO:tasks.workunit.client.0.smithi131.stdout: create 283/38 file after the snapshot 2024-04-12T19:42:36.655 INFO:tasks.workunit.client.0.smithi131.stdout: create 283/39 file after the snapshot 2024-04-12T19:42:36.663 INFO:tasks.workunit.client.0.smithi131.stdout: create 284/.snap/snap-subdir-test 2024-04-12T19:42:36.713 INFO:tasks.workunit.client.0.smithi131.stdout: create 284/30 file after the snapshot 2024-04-12T19:42:36.718 INFO:tasks.workunit.client.0.smithi131.stdout: create 284/31 file after the snapshot 2024-04-12T19:42:36.725 INFO:tasks.workunit.client.0.smithi131.stdout: create 284/32 file after the snapshot 2024-04-12T19:42:36.734 INFO:tasks.workunit.client.0.smithi131.stdout: create 284/33 file after the snapshot 2024-04-12T19:42:36.742 INFO:tasks.workunit.client.0.smithi131.stdout: create 284/34 file after the snapshot 2024-04-12T19:42:36.750 INFO:tasks.workunit.client.0.smithi131.stdout: create 284/35 file after the snapshot 2024-04-12T19:42:36.758 INFO:tasks.workunit.client.0.smithi131.stdout: create 284/36 file after the snapshot 2024-04-12T19:42:36.765 INFO:tasks.workunit.client.0.smithi131.stdout: create 284/37 file after the snapshot 2024-04-12T19:42:36.773 INFO:tasks.workunit.client.0.smithi131.stdout: create 284/38 file after the snapshot 2024-04-12T19:42:36.782 INFO:tasks.workunit.client.0.smithi131.stdout: create 284/39 file after the snapshot 2024-04-12T19:42:36.789 INFO:tasks.workunit.client.0.smithi131.stdout: create 285/.snap/snap-subdir-test 2024-04-12T19:42:36.836 INFO:tasks.workunit.client.0.smithi131.stdout: create 285/30 file after the snapshot 2024-04-12T19:42:36.842 INFO:tasks.workunit.client.0.smithi131.stdout: create 285/31 file after the snapshot 2024-04-12T19:42:36.848 INFO:tasks.workunit.client.0.smithi131.stdout: create 285/32 file after the snapshot 2024-04-12T19:42:36.857 INFO:tasks.workunit.client.0.smithi131.stdout: create 285/33 file after the snapshot 2024-04-12T19:42:36.864 INFO:tasks.workunit.client.0.smithi131.stdout: create 285/34 file after the snapshot 2024-04-12T19:42:36.872 INFO:tasks.workunit.client.0.smithi131.stdout: create 285/35 file after the snapshot 2024-04-12T19:42:36.880 INFO:tasks.workunit.client.0.smithi131.stdout: create 285/36 file after the snapshot 2024-04-12T19:42:36.889 INFO:tasks.workunit.client.0.smithi131.stdout: create 285/37 file after the snapshot 2024-04-12T19:42:36.896 INFO:tasks.workunit.client.0.smithi131.stdout: create 285/38 file after the snapshot 2024-04-12T19:42:36.905 INFO:tasks.workunit.client.0.smithi131.stdout: create 285/39 file after the snapshot 2024-04-12T19:42:36.912 INFO:tasks.workunit.client.0.smithi131.stdout: create 286/.snap/snap-subdir-test 2024-04-12T19:42:36.969 INFO:tasks.workunit.client.0.smithi131.stdout: create 286/30 file after the snapshot 2024-04-12T19:42:36.974 INFO:tasks.workunit.client.0.smithi131.stdout: create 286/31 file after the snapshot 2024-04-12T19:42:36.980 INFO:tasks.workunit.client.0.smithi131.stdout: create 286/32 file after the snapshot 2024-04-12T19:42:36.989 INFO:tasks.workunit.client.0.smithi131.stdout: create 286/33 file after the snapshot 2024-04-12T19:42:36.998 INFO:tasks.workunit.client.0.smithi131.stdout: create 286/34 file after the snapshot 2024-04-12T19:42:37.005 INFO:tasks.workunit.client.0.smithi131.stdout: create 286/35 file after the snapshot 2024-04-12T19:42:37.013 INFO:tasks.workunit.client.0.smithi131.stdout: create 286/36 file after the snapshot 2024-04-12T19:42:37.021 INFO:tasks.workunit.client.0.smithi131.stdout: create 286/37 file after the snapshot 2024-04-12T19:42:37.029 INFO:tasks.workunit.client.0.smithi131.stdout: create 286/38 file after the snapshot 2024-04-12T19:42:37.036 INFO:tasks.workunit.client.0.smithi131.stdout: create 286/39 file after the snapshot 2024-04-12T19:42:37.044 INFO:tasks.workunit.client.0.smithi131.stdout: create 287/.snap/snap-subdir-test 2024-04-12T19:42:37.092 INFO:tasks.workunit.client.0.smithi131.stdout: create 287/30 file after the snapshot 2024-04-12T19:42:37.098 INFO:tasks.workunit.client.0.smithi131.stdout: create 287/31 file after the snapshot 2024-04-12T19:42:37.105 INFO:tasks.workunit.client.0.smithi131.stdout: create 287/32 file after the snapshot 2024-04-12T19:42:37.113 INFO:tasks.workunit.client.0.smithi131.stdout: create 287/33 file after the snapshot 2024-04-12T19:42:37.120 INFO:tasks.workunit.client.0.smithi131.stdout: create 287/34 file after the snapshot 2024-04-12T19:42:37.129 INFO:tasks.workunit.client.0.smithi131.stdout: create 287/35 file after the snapshot 2024-04-12T19:42:37.135 INFO:tasks.workunit.client.0.smithi131.stdout: create 287/36 file after the snapshot 2024-04-12T19:42:37.143 INFO:tasks.workunit.client.0.smithi131.stdout: create 287/37 file after the snapshot 2024-04-12T19:42:37.151 INFO:tasks.workunit.client.0.smithi131.stdout: create 287/38 file after the snapshot 2024-04-12T19:42:37.158 INFO:tasks.workunit.client.0.smithi131.stdout: create 287/39 file after the snapshot 2024-04-12T19:42:37.165 INFO:tasks.workunit.client.0.smithi131.stdout: create 288/.snap/snap-subdir-test 2024-04-12T19:42:37.215 INFO:tasks.workunit.client.0.smithi131.stdout: create 288/30 file after the snapshot 2024-04-12T19:42:37.221 INFO:tasks.workunit.client.0.smithi131.stdout: create 288/31 file after the snapshot 2024-04-12T19:42:37.228 INFO:tasks.workunit.client.0.smithi131.stdout: create 288/32 file after the snapshot 2024-04-12T19:42:37.236 INFO:tasks.workunit.client.0.smithi131.stdout: create 288/33 file after the snapshot 2024-04-12T19:42:37.243 INFO:tasks.workunit.client.0.smithi131.stdout: create 288/34 file after the snapshot 2024-04-12T19:42:37.252 INFO:tasks.workunit.client.0.smithi131.stdout: create 288/35 file after the snapshot 2024-04-12T19:42:37.261 INFO:tasks.workunit.client.0.smithi131.stdout: create 288/36 file after the snapshot 2024-04-12T19:42:37.269 INFO:tasks.workunit.client.0.smithi131.stdout: create 288/37 file after the snapshot 2024-04-12T19:42:37.277 INFO:tasks.workunit.client.0.smithi131.stdout: create 288/38 file after the snapshot 2024-04-12T19:42:37.285 INFO:tasks.workunit.client.0.smithi131.stdout: create 288/39 file after the snapshot 2024-04-12T19:42:37.293 INFO:tasks.workunit.client.0.smithi131.stdout: create 289/.snap/snap-subdir-test 2024-04-12T19:42:37.340 INFO:tasks.workunit.client.0.smithi131.stdout: create 289/30 file after the snapshot 2024-04-12T19:42:37.362 INFO:tasks.workunit.client.0.smithi131.stdout: create 289/31 file after the snapshot 2024-04-12T19:42:37.399 INFO:tasks.workunit.client.0.smithi131.stdout: create 289/32 file after the snapshot 2024-04-12T19:42:37.406 INFO:tasks.workunit.client.0.smithi131.stdout: create 289/33 file after the snapshot 2024-04-12T19:42:37.413 INFO:tasks.workunit.client.0.smithi131.stdout: create 289/34 file after the snapshot 2024-04-12T19:42:37.421 INFO:tasks.workunit.client.0.smithi131.stdout: create 289/35 file after the snapshot 2024-04-12T19:42:37.429 INFO:tasks.workunit.client.0.smithi131.stdout: create 289/36 file after the snapshot 2024-04-12T19:42:37.436 INFO:tasks.workunit.client.0.smithi131.stdout: create 289/37 file after the snapshot 2024-04-12T19:42:37.442 INFO:tasks.workunit.client.0.smithi131.stdout: create 289/38 file after the snapshot 2024-04-12T19:42:37.450 INFO:tasks.workunit.client.0.smithi131.stdout: create 289/39 file after the snapshot 2024-04-12T19:42:37.457 INFO:tasks.workunit.client.0.smithi131.stdout: create 290/.snap/snap-subdir-test 2024-04-12T19:42:37.537 INFO:tasks.workunit.client.0.smithi131.stdout: create 290/30 file after the snapshot 2024-04-12T19:42:37.543 INFO:tasks.workunit.client.0.smithi131.stdout: create 290/31 file after the snapshot 2024-04-12T19:42:37.551 INFO:tasks.workunit.client.0.smithi131.stdout: create 290/32 file after the snapshot 2024-04-12T19:42:37.558 INFO:tasks.workunit.client.0.smithi131.stdout: create 290/33 file after the snapshot 2024-04-12T19:42:37.567 INFO:tasks.workunit.client.0.smithi131.stdout: create 290/34 file after the snapshot 2024-04-12T19:42:37.575 INFO:tasks.workunit.client.0.smithi131.stdout: create 290/35 file after the snapshot 2024-04-12T19:42:37.582 INFO:tasks.workunit.client.0.smithi131.stdout: create 290/36 file after the snapshot 2024-04-12T19:42:37.591 INFO:tasks.workunit.client.0.smithi131.stdout: create 290/37 file after the snapshot 2024-04-12T19:42:37.599 INFO:tasks.workunit.client.0.smithi131.stdout: create 290/38 file after the snapshot 2024-04-12T19:42:37.608 INFO:tasks.workunit.client.0.smithi131.stdout: create 290/39 file after the snapshot 2024-04-12T19:42:37.616 INFO:tasks.workunit.client.0.smithi131.stdout: create 291/.snap/snap-subdir-test 2024-04-12T19:42:37.665 INFO:tasks.workunit.client.0.smithi131.stdout: create 291/30 file after the snapshot 2024-04-12T19:42:37.670 INFO:tasks.workunit.client.0.smithi131.stdout: create 291/31 file after the snapshot 2024-04-12T19:42:37.677 INFO:tasks.workunit.client.0.smithi131.stdout: create 291/32 file after the snapshot 2024-04-12T19:42:37.685 INFO:tasks.workunit.client.0.smithi131.stdout: create 291/33 file after the snapshot 2024-04-12T19:42:37.693 INFO:tasks.workunit.client.0.smithi131.stdout: create 291/34 file after the snapshot 2024-04-12T19:42:37.701 INFO:tasks.workunit.client.0.smithi131.stdout: create 291/35 file after the snapshot 2024-04-12T19:42:37.709 INFO:tasks.workunit.client.0.smithi131.stdout: create 291/36 file after the snapshot 2024-04-12T19:42:37.717 INFO:tasks.workunit.client.0.smithi131.stdout: create 291/37 file after the snapshot 2024-04-12T19:42:37.725 INFO:tasks.workunit.client.0.smithi131.stdout: create 291/38 file after the snapshot 2024-04-12T19:42:37.733 INFO:tasks.workunit.client.0.smithi131.stdout: create 291/39 file after the snapshot 2024-04-12T19:42:37.741 INFO:tasks.workunit.client.0.smithi131.stdout: create 292/.snap/snap-subdir-test 2024-04-12T19:42:37.788 INFO:tasks.workunit.client.0.smithi131.stdout: create 292/30 file after the snapshot 2024-04-12T19:42:37.793 INFO:tasks.workunit.client.0.smithi131.stdout: create 292/31 file after the snapshot 2024-04-12T19:42:37.802 INFO:tasks.workunit.client.0.smithi131.stdout: create 292/32 file after the snapshot 2024-04-12T19:42:37.808 INFO:tasks.workunit.client.0.smithi131.stdout: create 292/33 file after the snapshot 2024-04-12T19:42:37.816 INFO:tasks.workunit.client.0.smithi131.stdout: create 292/34 file after the snapshot 2024-04-12T19:42:37.823 INFO:tasks.workunit.client.0.smithi131.stdout: create 292/35 file after the snapshot 2024-04-12T19:42:37.831 INFO:tasks.workunit.client.0.smithi131.stdout: create 292/36 file after the snapshot 2024-04-12T19:42:37.839 INFO:tasks.workunit.client.0.smithi131.stdout: create 292/37 file after the snapshot 2024-04-12T19:42:37.846 INFO:tasks.workunit.client.0.smithi131.stdout: create 292/38 file after the snapshot 2024-04-12T19:42:37.855 INFO:tasks.workunit.client.0.smithi131.stdout: create 292/39 file after the snapshot 2024-04-12T19:42:37.863 INFO:tasks.workunit.client.0.smithi131.stdout: create 293/.snap/snap-subdir-test 2024-04-12T19:42:37.909 INFO:tasks.workunit.client.0.smithi131.stdout: create 293/30 file after the snapshot 2024-04-12T19:42:37.916 INFO:tasks.workunit.client.0.smithi131.stdout: create 293/31 file after the snapshot 2024-04-12T19:42:37.923 INFO:tasks.workunit.client.0.smithi131.stdout: create 293/32 file after the snapshot 2024-04-12T19:42:37.931 INFO:tasks.workunit.client.0.smithi131.stdout: create 293/33 file after the snapshot 2024-04-12T19:42:37.939 INFO:tasks.workunit.client.0.smithi131.stdout: create 293/34 file after the snapshot 2024-04-12T19:42:37.947 INFO:tasks.workunit.client.0.smithi131.stdout: create 293/35 file after the snapshot 2024-04-12T19:42:37.954 INFO:tasks.workunit.client.0.smithi131.stdout: create 293/36 file after the snapshot 2024-04-12T19:42:37.962 INFO:tasks.workunit.client.0.smithi131.stdout: create 293/37 file after the snapshot 2024-04-12T19:42:37.969 INFO:tasks.workunit.client.0.smithi131.stdout: create 293/38 file after the snapshot 2024-04-12T19:42:37.978 INFO:tasks.workunit.client.0.smithi131.stdout: create 293/39 file after the snapshot 2024-04-12T19:42:37.985 INFO:tasks.workunit.client.0.smithi131.stdout: create 294/.snap/snap-subdir-test 2024-04-12T19:42:38.034 INFO:tasks.workunit.client.0.smithi131.stdout: create 294/30 file after the snapshot 2024-04-12T19:42:38.038 INFO:tasks.workunit.client.0.smithi131.stdout: create 294/31 file after the snapshot 2024-04-12T19:42:38.046 INFO:tasks.workunit.client.0.smithi131.stdout: create 294/32 file after the snapshot 2024-04-12T19:42:38.055 INFO:tasks.workunit.client.0.smithi131.stdout: create 294/33 file after the snapshot 2024-04-12T19:42:38.063 INFO:tasks.workunit.client.0.smithi131.stdout: create 294/34 file after the snapshot 2024-04-12T19:42:38.072 INFO:tasks.workunit.client.0.smithi131.stdout: create 294/35 file after the snapshot 2024-04-12T19:42:38.079 INFO:tasks.workunit.client.0.smithi131.stdout: create 294/36 file after the snapshot 2024-04-12T19:42:38.086 INFO:tasks.workunit.client.0.smithi131.stdout: create 294/37 file after the snapshot 2024-04-12T19:42:38.094 INFO:tasks.workunit.client.0.smithi131.stdout: create 294/38 file after the snapshot 2024-04-12T19:42:38.102 INFO:tasks.workunit.client.0.smithi131.stdout: create 294/39 file after the snapshot 2024-04-12T19:42:38.110 INFO:tasks.workunit.client.0.smithi131.stdout: create 295/.snap/snap-subdir-test 2024-04-12T19:42:38.161 INFO:tasks.workunit.client.0.smithi131.stdout: create 295/30 file after the snapshot 2024-04-12T19:42:38.166 INFO:tasks.workunit.client.0.smithi131.stdout: create 295/31 file after the snapshot 2024-04-12T19:42:38.174 INFO:tasks.workunit.client.0.smithi131.stdout: create 295/32 file after the snapshot 2024-04-12T19:42:38.182 INFO:tasks.workunit.client.0.smithi131.stdout: create 295/33 file after the snapshot 2024-04-12T19:42:38.189 INFO:tasks.workunit.client.0.smithi131.stdout: create 295/34 file after the snapshot 2024-04-12T19:42:38.197 INFO:tasks.workunit.client.0.smithi131.stdout: create 295/35 file after the snapshot 2024-04-12T19:42:38.206 INFO:tasks.workunit.client.0.smithi131.stdout: create 295/36 file after the snapshot 2024-04-12T19:42:38.214 INFO:tasks.workunit.client.0.smithi131.stdout: create 295/37 file after the snapshot 2024-04-12T19:42:38.222 INFO:tasks.workunit.client.0.smithi131.stdout: create 295/38 file after the snapshot 2024-04-12T19:42:38.230 INFO:tasks.workunit.client.0.smithi131.stdout: create 295/39 file after the snapshot 2024-04-12T19:42:38.238 INFO:tasks.workunit.client.0.smithi131.stdout: create 296/.snap/snap-subdir-test 2024-04-12T19:42:38.292 INFO:tasks.workunit.client.0.smithi131.stdout: create 296/30 file after the snapshot 2024-04-12T19:42:38.297 INFO:tasks.workunit.client.0.smithi131.stdout: create 296/31 file after the snapshot 2024-04-12T19:42:38.304 INFO:tasks.workunit.client.0.smithi131.stdout: create 296/32 file after the snapshot 2024-04-12T19:42:38.313 INFO:tasks.workunit.client.0.smithi131.stdout: create 296/33 file after the snapshot 2024-04-12T19:42:38.320 INFO:tasks.workunit.client.0.smithi131.stdout: create 296/34 file after the snapshot 2024-04-12T19:42:38.328 INFO:tasks.workunit.client.0.smithi131.stdout: create 296/35 file after the snapshot 2024-04-12T19:42:38.336 INFO:tasks.workunit.client.0.smithi131.stdout: create 296/36 file after the snapshot 2024-04-12T19:42:38.344 INFO:tasks.workunit.client.0.smithi131.stdout: create 296/37 file after the snapshot 2024-04-12T19:42:38.352 INFO:tasks.workunit.client.0.smithi131.stdout: create 296/38 file after the snapshot 2024-04-12T19:42:38.372 INFO:tasks.workunit.client.0.smithi131.stdout: create 296/39 file after the snapshot 2024-04-12T19:42:38.443 INFO:tasks.workunit.client.0.smithi131.stdout: create 297/.snap/snap-subdir-test 2024-04-12T19:42:38.530 INFO:tasks.workunit.client.0.smithi131.stdout: create 297/30 file after the snapshot 2024-04-12T19:42:38.536 INFO:tasks.workunit.client.0.smithi131.stdout: create 297/31 file after the snapshot 2024-04-12T19:42:38.543 INFO:tasks.workunit.client.0.smithi131.stdout: create 297/32 file after the snapshot 2024-04-12T19:42:38.551 INFO:tasks.workunit.client.0.smithi131.stdout: create 297/33 file after the snapshot 2024-04-12T19:42:38.559 INFO:tasks.workunit.client.0.smithi131.stdout: create 297/34 file after the snapshot 2024-04-12T19:42:38.566 INFO:tasks.workunit.client.0.smithi131.stdout: create 297/35 file after the snapshot 2024-04-12T19:42:38.574 INFO:tasks.workunit.client.0.smithi131.stdout: create 297/36 file after the snapshot 2024-04-12T19:42:38.581 INFO:tasks.workunit.client.0.smithi131.stdout: create 297/37 file after the snapshot 2024-04-12T19:42:38.588 INFO:tasks.workunit.client.0.smithi131.stdout: create 297/38 file after the snapshot 2024-04-12T19:42:38.595 INFO:tasks.workunit.client.0.smithi131.stdout: create 297/39 file after the snapshot 2024-04-12T19:42:38.603 INFO:tasks.workunit.client.0.smithi131.stdout: create 298/.snap/snap-subdir-test 2024-04-12T19:42:38.649 INFO:tasks.workunit.client.0.smithi131.stdout: create 298/30 file after the snapshot 2024-04-12T19:42:38.656 INFO:tasks.workunit.client.0.smithi131.stdout: create 298/31 file after the snapshot 2024-04-12T19:42:38.663 INFO:tasks.workunit.client.0.smithi131.stdout: create 298/32 file after the snapshot 2024-04-12T19:42:38.671 INFO:tasks.workunit.client.0.smithi131.stdout: create 298/33 file after the snapshot 2024-04-12T19:42:38.679 INFO:tasks.workunit.client.0.smithi131.stdout: create 298/34 file after the snapshot 2024-04-12T19:42:38.687 INFO:tasks.workunit.client.0.smithi131.stdout: create 298/35 file after the snapshot 2024-04-12T19:42:38.694 INFO:tasks.workunit.client.0.smithi131.stdout: create 298/36 file after the snapshot 2024-04-12T19:42:38.702 INFO:tasks.workunit.client.0.smithi131.stdout: create 298/37 file after the snapshot 2024-04-12T19:42:38.710 INFO:tasks.workunit.client.0.smithi131.stdout: create 298/38 file after the snapshot 2024-04-12T19:42:38.717 INFO:tasks.workunit.client.0.smithi131.stdout: create 298/39 file after the snapshot 2024-04-12T19:42:38.725 INFO:tasks.workunit.client.0.smithi131.stdout: create 299/.snap/snap-subdir-test 2024-04-12T19:42:38.773 INFO:tasks.workunit.client.0.smithi131.stdout: create 299/30 file after the snapshot 2024-04-12T19:42:38.779 INFO:tasks.workunit.client.0.smithi131.stdout: create 299/31 file after the snapshot 2024-04-12T19:42:38.786 INFO:tasks.workunit.client.0.smithi131.stdout: create 299/32 file after the snapshot 2024-04-12T19:42:38.793 INFO:tasks.workunit.client.0.smithi131.stdout: create 299/33 file after the snapshot 2024-04-12T19:42:38.801 INFO:tasks.workunit.client.0.smithi131.stdout: create 299/34 file after the snapshot 2024-04-12T19:42:38.809 INFO:tasks.workunit.client.0.smithi131.stdout: create 299/35 file after the snapshot 2024-04-12T19:42:38.817 INFO:tasks.workunit.client.0.smithi131.stdout: create 299/36 file after the snapshot 2024-04-12T19:42:38.824 INFO:tasks.workunit.client.0.smithi131.stdout: create 299/37 file after the snapshot 2024-04-12T19:42:38.832 INFO:tasks.workunit.client.0.smithi131.stdout: create 299/38 file after the snapshot 2024-04-12T19:42:38.841 INFO:tasks.workunit.client.0.smithi131.stdout: create 299/39 file after the snapshot 2024-04-12T19:42:38.849 INFO:tasks.workunit.client.0.smithi131.stdout:Take second snapshot .snap/test2 2024-04-12T19:42:38.980 INFO:tasks.workunit.client.0.smithi131.stdout:Copy content of .snap/test1 to copyofsnap1 ... 2024-04-12T19:42:39.966 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:42:39.976 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:42:41.867 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1' -> 'copyofsnap1/test1' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/100' -> 'copyofsnap1/test1/100' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/100/10' -> 'copyofsnap1/test1/100/10' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/100/11' -> 'copyofsnap1/test1/100/11' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/100/12' -> 'copyofsnap1/test1/100/12' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/100/13' -> 'copyofsnap1/test1/100/13' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/100/14' -> 'copyofsnap1/test1/100/14' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/100/15' -> 'copyofsnap1/test1/100/15' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/100/16' -> 'copyofsnap1/test1/100/16' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/100/17' -> 'copyofsnap1/test1/100/17' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/100/18' -> 'copyofsnap1/test1/100/18' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/100/19' -> 'copyofsnap1/test1/100/19' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/100/20' -> 'copyofsnap1/test1/100/20' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/101' -> 'copyofsnap1/test1/101' 2024-04-12T19:42:41.868 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/101/10' -> 'copyofsnap1/test1/101/10' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/101/11' -> 'copyofsnap1/test1/101/11' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/101/12' -> 'copyofsnap1/test1/101/12' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/101/13' -> 'copyofsnap1/test1/101/13' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/101/14' -> 'copyofsnap1/test1/101/14' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/101/15' -> 'copyofsnap1/test1/101/15' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/101/16' -> 'copyofsnap1/test1/101/16' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/101/17' -> 'copyofsnap1/test1/101/17' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/101/18' -> 'copyofsnap1/test1/101/18' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/101/19' -> 'copyofsnap1/test1/101/19' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/101/20' -> 'copyofsnap1/test1/101/20' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/102' -> 'copyofsnap1/test1/102' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/102/10' -> 'copyofsnap1/test1/102/10' 2024-04-12T19:42:41.869 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/102/11' -> 'copyofsnap1/test1/102/11' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/102/12' -> 'copyofsnap1/test1/102/12' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/102/13' -> 'copyofsnap1/test1/102/13' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/102/14' -> 'copyofsnap1/test1/102/14' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/102/15' -> 'copyofsnap1/test1/102/15' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/102/16' -> 'copyofsnap1/test1/102/16' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/102/17' -> 'copyofsnap1/test1/102/17' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/102/18' -> 'copyofsnap1/test1/102/18' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/102/19' -> 'copyofsnap1/test1/102/19' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/102/20' -> 'copyofsnap1/test1/102/20' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/103' -> 'copyofsnap1/test1/103' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/103/10' -> 'copyofsnap1/test1/103/10' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/103/11' -> 'copyofsnap1/test1/103/11' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/103/12' -> 'copyofsnap1/test1/103/12' 2024-04-12T19:42:41.870 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/103/13' -> 'copyofsnap1/test1/103/13' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/103/14' -> 'copyofsnap1/test1/103/14' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/103/15' -> 'copyofsnap1/test1/103/15' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/103/16' -> 'copyofsnap1/test1/103/16' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/103/17' -> 'copyofsnap1/test1/103/17' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/103/18' -> 'copyofsnap1/test1/103/18' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/103/19' -> 'copyofsnap1/test1/103/19' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/103/20' -> 'copyofsnap1/test1/103/20' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/104' -> 'copyofsnap1/test1/104' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/104/10' -> 'copyofsnap1/test1/104/10' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/104/11' -> 'copyofsnap1/test1/104/11' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/104/12' -> 'copyofsnap1/test1/104/12' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/104/13' -> 'copyofsnap1/test1/104/13' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/104/14' -> 'copyofsnap1/test1/104/14' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/104/15' -> 'copyofsnap1/test1/104/15' 2024-04-12T19:42:41.871 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/104/16' -> 'copyofsnap1/test1/104/16' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/104/17' -> 'copyofsnap1/test1/104/17' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/104/18' -> 'copyofsnap1/test1/104/18' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/104/19' -> 'copyofsnap1/test1/104/19' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/104/20' -> 'copyofsnap1/test1/104/20' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/105' -> 'copyofsnap1/test1/105' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/105/10' -> 'copyofsnap1/test1/105/10' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/105/11' -> 'copyofsnap1/test1/105/11' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/105/12' -> 'copyofsnap1/test1/105/12' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/105/13' -> 'copyofsnap1/test1/105/13' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/105/14' -> 'copyofsnap1/test1/105/14' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/105/15' -> 'copyofsnap1/test1/105/15' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/105/16' -> 'copyofsnap1/test1/105/16' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/105/17' -> 'copyofsnap1/test1/105/17' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/105/18' -> 'copyofsnap1/test1/105/18' 2024-04-12T19:42:41.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/105/19' -> 'copyofsnap1/test1/105/19' 2024-04-12T19:42:41.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/105/20' -> 'copyofsnap1/test1/105/20' 2024-04-12T19:42:41.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/106' -> 'copyofsnap1/test1/106' 2024-04-12T19:42:41.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/106/10' -> 'copyofsnap1/test1/106/10' 2024-04-12T19:42:41.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/106/11' -> 'copyofsnap1/test1/106/11' 2024-04-12T19:42:41.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/106/12' -> 'copyofsnap1/test1/106/12' 2024-04-12T19:42:41.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/106/13' -> 'copyofsnap1/test1/106/13' 2024-04-12T19:42:41.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/106/14' -> 'copyofsnap1/test1/106/14' 2024-04-12T19:42:41.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/106/15' -> 'copyofsnap1/test1/106/15' 2024-04-12T19:42:41.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/106/16' -> 'copyofsnap1/test1/106/16' 2024-04-12T19:42:44.576 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/106/17' -> 'copyofsnap1/test1/106/17' 2024-04-12T19:42:44.576 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/106/18' -> 'copyofsnap1/test1/106/18' 2024-04-12T19:42:44.576 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/106/19' -> 'copyofsnap1/test1/106/19' 2024-04-12T19:42:44.576 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/106/20' -> 'copyofsnap1/test1/106/20' 2024-04-12T19:42:44.576 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/107' -> 'copyofsnap1/test1/107' 2024-04-12T19:42:44.576 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/107/10' -> 'copyofsnap1/test1/107/10' 2024-04-12T19:42:44.576 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/107/11' -> 'copyofsnap1/test1/107/11' 2024-04-12T19:42:44.576 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/107/12' -> 'copyofsnap1/test1/107/12' 2024-04-12T19:42:44.576 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/107/13' -> 'copyofsnap1/test1/107/13' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/107/14' -> 'copyofsnap1/test1/107/14' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/107/15' -> 'copyofsnap1/test1/107/15' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/107/16' -> 'copyofsnap1/test1/107/16' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/107/17' -> 'copyofsnap1/test1/107/17' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/107/18' -> 'copyofsnap1/test1/107/18' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/107/19' -> 'copyofsnap1/test1/107/19' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/107/20' -> 'copyofsnap1/test1/107/20' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/108' -> 'copyofsnap1/test1/108' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/108/10' -> 'copyofsnap1/test1/108/10' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/108/11' -> 'copyofsnap1/test1/108/11' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/108/12' -> 'copyofsnap1/test1/108/12' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/108/13' -> 'copyofsnap1/test1/108/13' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/108/14' -> 'copyofsnap1/test1/108/14' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/108/15' -> 'copyofsnap1/test1/108/15' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/108/16' -> 'copyofsnap1/test1/108/16' 2024-04-12T19:42:44.577 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/108/17' -> 'copyofsnap1/test1/108/17' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/108/18' -> 'copyofsnap1/test1/108/18' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/108/19' -> 'copyofsnap1/test1/108/19' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/108/20' -> 'copyofsnap1/test1/108/20' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/109' -> 'copyofsnap1/test1/109' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/109/10' -> 'copyofsnap1/test1/109/10' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/109/11' -> 'copyofsnap1/test1/109/11' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/109/12' -> 'copyofsnap1/test1/109/12' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/109/13' -> 'copyofsnap1/test1/109/13' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/109/14' -> 'copyofsnap1/test1/109/14' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/109/15' -> 'copyofsnap1/test1/109/15' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/109/16' -> 'copyofsnap1/test1/109/16' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/109/17' -> 'copyofsnap1/test1/109/17' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/109/18' -> 'copyofsnap1/test1/109/18' 2024-04-12T19:42:44.578 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/109/19' -> 'copyofsnap1/test1/109/19' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/109/20' -> 'copyofsnap1/test1/109/20' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/110' -> 'copyofsnap1/test1/110' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/110/10' -> 'copyofsnap1/test1/110/10' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/110/11' -> 'copyofsnap1/test1/110/11' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/110/12' -> 'copyofsnap1/test1/110/12' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/110/13' -> 'copyofsnap1/test1/110/13' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/110/14' -> 'copyofsnap1/test1/110/14' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/110/15' -> 'copyofsnap1/test1/110/15' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/110/16' -> 'copyofsnap1/test1/110/16' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/110/17' -> 'copyofsnap1/test1/110/17' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/110/18' -> 'copyofsnap1/test1/110/18' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/110/19' -> 'copyofsnap1/test1/110/19' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/110/20' -> 'copyofsnap1/test1/110/20' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/111' -> 'copyofsnap1/test1/111' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/111/10' -> 'copyofsnap1/test1/111/10' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/111/11' -> 'copyofsnap1/test1/111/11' 2024-04-12T19:42:44.579 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/111/12' -> 'copyofsnap1/test1/111/12' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/111/13' -> 'copyofsnap1/test1/111/13' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/111/14' -> 'copyofsnap1/test1/111/14' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/111/15' -> 'copyofsnap1/test1/111/15' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/111/16' -> 'copyofsnap1/test1/111/16' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/111/17' -> 'copyofsnap1/test1/111/17' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/111/18' -> 'copyofsnap1/test1/111/18' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/111/19' -> 'copyofsnap1/test1/111/19' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/111/20' -> 'copyofsnap1/test1/111/20' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/112' -> 'copyofsnap1/test1/112' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/112/10' -> 'copyofsnap1/test1/112/10' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/112/11' -> 'copyofsnap1/test1/112/11' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/112/12' -> 'copyofsnap1/test1/112/12' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/112/13' -> 'copyofsnap1/test1/112/13' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/112/14' -> 'copyofsnap1/test1/112/14' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/112/15' -> 'copyofsnap1/test1/112/15' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/112/16' -> 'copyofsnap1/test1/112/16' 2024-04-12T19:42:44.580 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/112/17' -> 'copyofsnap1/test1/112/17' 2024-04-12T19:42:44.581 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/112/18' -> 'copyofsnap1/test1/112/18' 2024-04-12T19:42:44.581 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/112/19' -> 'copyofsnap1/test1/112/19' 2024-04-12T19:42:44.581 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/112/20' -> 'copyofsnap1/test1/112/20' 2024-04-12T19:42:44.581 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/113' -> 'copyofsnap1/test1/113' 2024-04-12T19:42:44.581 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/113/10' -> 'copyofsnap1/test1/113/10' 2024-04-12T19:42:44.581 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/113/11' -> 'copyofsnap1/test1/113/11' 2024-04-12T19:42:44.581 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/113/12' -> 'copyofsnap1/test1/113/12' 2024-04-12T19:42:44.581 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/113/13' -> 'copyofsnap1/test1/113/13' 2024-04-12T19:42:47.191 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/113/14' -> 'copyofsnap1/test1/113/14' 2024-04-12T19:42:47.191 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/113/15' -> 'copyofsnap1/test1/113/15' 2024-04-12T19:42:47.191 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/113/16' -> 'copyofsnap1/test1/113/16' 2024-04-12T19:42:47.191 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/113/17' -> 'copyofsnap1/test1/113/17' 2024-04-12T19:42:47.191 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/113/18' -> 'copyofsnap1/test1/113/18' 2024-04-12T19:42:47.191 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/113/19' -> 'copyofsnap1/test1/113/19' 2024-04-12T19:42:47.191 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/113/20' -> 'copyofsnap1/test1/113/20' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/114' -> 'copyofsnap1/test1/114' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/114/10' -> 'copyofsnap1/test1/114/10' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/114/11' -> 'copyofsnap1/test1/114/11' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/114/12' -> 'copyofsnap1/test1/114/12' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/114/13' -> 'copyofsnap1/test1/114/13' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/114/14' -> 'copyofsnap1/test1/114/14' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/114/15' -> 'copyofsnap1/test1/114/15' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/114/16' -> 'copyofsnap1/test1/114/16' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/114/17' -> 'copyofsnap1/test1/114/17' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/114/18' -> 'copyofsnap1/test1/114/18' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/114/19' -> 'copyofsnap1/test1/114/19' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/114/20' -> 'copyofsnap1/test1/114/20' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/115' -> 'copyofsnap1/test1/115' 2024-04-12T19:42:47.192 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/115/10' -> 'copyofsnap1/test1/115/10' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/115/11' -> 'copyofsnap1/test1/115/11' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/115/12' -> 'copyofsnap1/test1/115/12' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/115/13' -> 'copyofsnap1/test1/115/13' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/115/14' -> 'copyofsnap1/test1/115/14' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/115/15' -> 'copyofsnap1/test1/115/15' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/115/16' -> 'copyofsnap1/test1/115/16' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/115/17' -> 'copyofsnap1/test1/115/17' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/115/18' -> 'copyofsnap1/test1/115/18' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/115/19' -> 'copyofsnap1/test1/115/19' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/115/20' -> 'copyofsnap1/test1/115/20' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/116' -> 'copyofsnap1/test1/116' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/116/10' -> 'copyofsnap1/test1/116/10' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/116/11' -> 'copyofsnap1/test1/116/11' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/116/12' -> 'copyofsnap1/test1/116/12' 2024-04-12T19:42:47.193 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/116/13' -> 'copyofsnap1/test1/116/13' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/116/14' -> 'copyofsnap1/test1/116/14' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/116/15' -> 'copyofsnap1/test1/116/15' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/116/16' -> 'copyofsnap1/test1/116/16' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/116/17' -> 'copyofsnap1/test1/116/17' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/116/18' -> 'copyofsnap1/test1/116/18' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/116/19' -> 'copyofsnap1/test1/116/19' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/116/20' -> 'copyofsnap1/test1/116/20' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/117' -> 'copyofsnap1/test1/117' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/117/10' -> 'copyofsnap1/test1/117/10' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/117/11' -> 'copyofsnap1/test1/117/11' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/117/12' -> 'copyofsnap1/test1/117/12' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/117/13' -> 'copyofsnap1/test1/117/13' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/117/14' -> 'copyofsnap1/test1/117/14' 2024-04-12T19:42:47.194 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/117/15' -> 'copyofsnap1/test1/117/15' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/117/16' -> 'copyofsnap1/test1/117/16' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/117/17' -> 'copyofsnap1/test1/117/17' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/117/18' -> 'copyofsnap1/test1/117/18' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/117/19' -> 'copyofsnap1/test1/117/19' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/117/20' -> 'copyofsnap1/test1/117/20' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/118' -> 'copyofsnap1/test1/118' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/118/10' -> 'copyofsnap1/test1/118/10' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/118/11' -> 'copyofsnap1/test1/118/11' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/118/12' -> 'copyofsnap1/test1/118/12' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/118/13' -> 'copyofsnap1/test1/118/13' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/118/14' -> 'copyofsnap1/test1/118/14' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/118/15' -> 'copyofsnap1/test1/118/15' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/118/16' -> 'copyofsnap1/test1/118/16' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/118/17' -> 'copyofsnap1/test1/118/17' 2024-04-12T19:42:47.195 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/118/18' -> 'copyofsnap1/test1/118/18' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/118/19' -> 'copyofsnap1/test1/118/19' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/118/20' -> 'copyofsnap1/test1/118/20' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/119' -> 'copyofsnap1/test1/119' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/119/10' -> 'copyofsnap1/test1/119/10' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/119/11' -> 'copyofsnap1/test1/119/11' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/119/12' -> 'copyofsnap1/test1/119/12' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/119/13' -> 'copyofsnap1/test1/119/13' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/119/14' -> 'copyofsnap1/test1/119/14' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/119/15' -> 'copyofsnap1/test1/119/15' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/119/16' -> 'copyofsnap1/test1/119/16' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/119/17' -> 'copyofsnap1/test1/119/17' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/119/18' -> 'copyofsnap1/test1/119/18' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/119/19' -> 'copyofsnap1/test1/119/19' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/119/20' -> 'copyofsnap1/test1/119/20' 2024-04-12T19:42:47.196 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/120' -> 'copyofsnap1/test1/120' 2024-04-12T19:42:47.197 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/120/10' -> 'copyofsnap1/test1/120/10' 2024-04-12T19:42:49.878 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/120/11' -> 'copyofsnap1/test1/120/11' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/120/12' -> 'copyofsnap1/test1/120/12' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/120/13' -> 'copyofsnap1/test1/120/13' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/120/14' -> 'copyofsnap1/test1/120/14' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/120/15' -> 'copyofsnap1/test1/120/15' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/120/16' -> 'copyofsnap1/test1/120/16' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/120/17' -> 'copyofsnap1/test1/120/17' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/120/18' -> 'copyofsnap1/test1/120/18' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/120/19' -> 'copyofsnap1/test1/120/19' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/120/20' -> 'copyofsnap1/test1/120/20' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/121' -> 'copyofsnap1/test1/121' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/121/10' -> 'copyofsnap1/test1/121/10' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/121/11' -> 'copyofsnap1/test1/121/11' 2024-04-12T19:42:49.879 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/121/12' -> 'copyofsnap1/test1/121/12' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/121/13' -> 'copyofsnap1/test1/121/13' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/121/14' -> 'copyofsnap1/test1/121/14' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/121/15' -> 'copyofsnap1/test1/121/15' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/121/16' -> 'copyofsnap1/test1/121/16' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/121/17' -> 'copyofsnap1/test1/121/17' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/121/18' -> 'copyofsnap1/test1/121/18' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/121/19' -> 'copyofsnap1/test1/121/19' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/121/20' -> 'copyofsnap1/test1/121/20' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/122' -> 'copyofsnap1/test1/122' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/122/10' -> 'copyofsnap1/test1/122/10' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/122/11' -> 'copyofsnap1/test1/122/11' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/122/12' -> 'copyofsnap1/test1/122/12' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/122/13' -> 'copyofsnap1/test1/122/13' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/122/14' -> 'copyofsnap1/test1/122/14' 2024-04-12T19:42:49.880 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/122/15' -> 'copyofsnap1/test1/122/15' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/122/16' -> 'copyofsnap1/test1/122/16' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/122/17' -> 'copyofsnap1/test1/122/17' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/122/18' -> 'copyofsnap1/test1/122/18' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/122/19' -> 'copyofsnap1/test1/122/19' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/122/20' -> 'copyofsnap1/test1/122/20' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/123' -> 'copyofsnap1/test1/123' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/123/10' -> 'copyofsnap1/test1/123/10' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/123/11' -> 'copyofsnap1/test1/123/11' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/123/12' -> 'copyofsnap1/test1/123/12' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/123/13' -> 'copyofsnap1/test1/123/13' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/123/14' -> 'copyofsnap1/test1/123/14' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/123/15' -> 'copyofsnap1/test1/123/15' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/123/16' -> 'copyofsnap1/test1/123/16' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/123/17' -> 'copyofsnap1/test1/123/17' 2024-04-12T19:42:49.881 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/123/18' -> 'copyofsnap1/test1/123/18' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/123/19' -> 'copyofsnap1/test1/123/19' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/123/20' -> 'copyofsnap1/test1/123/20' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/124' -> 'copyofsnap1/test1/124' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/124/10' -> 'copyofsnap1/test1/124/10' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/124/11' -> 'copyofsnap1/test1/124/11' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/124/12' -> 'copyofsnap1/test1/124/12' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/124/13' -> 'copyofsnap1/test1/124/13' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/124/14' -> 'copyofsnap1/test1/124/14' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/124/15' -> 'copyofsnap1/test1/124/15' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/124/16' -> 'copyofsnap1/test1/124/16' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/124/17' -> 'copyofsnap1/test1/124/17' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/124/18' -> 'copyofsnap1/test1/124/18' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/124/19' -> 'copyofsnap1/test1/124/19' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/124/20' -> 'copyofsnap1/test1/124/20' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/125' -> 'copyofsnap1/test1/125' 2024-04-12T19:42:49.882 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/125/10' -> 'copyofsnap1/test1/125/10' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/125/11' -> 'copyofsnap1/test1/125/11' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/125/12' -> 'copyofsnap1/test1/125/12' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/125/13' -> 'copyofsnap1/test1/125/13' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/125/14' -> 'copyofsnap1/test1/125/14' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/125/15' -> 'copyofsnap1/test1/125/15' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/125/16' -> 'copyofsnap1/test1/125/16' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/125/17' -> 'copyofsnap1/test1/125/17' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/125/18' -> 'copyofsnap1/test1/125/18' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/125/19' -> 'copyofsnap1/test1/125/19' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/125/20' -> 'copyofsnap1/test1/125/20' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/126' -> 'copyofsnap1/test1/126' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/126/10' -> 'copyofsnap1/test1/126/10' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/126/11' -> 'copyofsnap1/test1/126/11' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/126/12' -> 'copyofsnap1/test1/126/12' 2024-04-12T19:42:49.883 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/126/13' -> 'copyofsnap1/test1/126/13' 2024-04-12T19:42:49.884 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/126/14' -> 'copyofsnap1/test1/126/14' 2024-04-12T19:42:49.884 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/126/15' -> 'copyofsnap1/test1/126/15' 2024-04-12T19:42:49.884 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/126/16' -> 'copyofsnap1/test1/126/16' 2024-04-12T19:42:49.884 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/126/17' -> 'copyofsnap1/test1/126/17' 2024-04-12T19:42:49.884 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/126/18' -> 'copyofsnap1/test1/126/18' 2024-04-12T19:42:49.884 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/126/19' -> 'copyofsnap1/test1/126/19' 2024-04-12T19:42:52.652 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/126/20' -> 'copyofsnap1/test1/126/20' 2024-04-12T19:42:52.652 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/127' -> 'copyofsnap1/test1/127' 2024-04-12T19:42:52.652 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/127/10' -> 'copyofsnap1/test1/127/10' 2024-04-12T19:42:52.652 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/127/11' -> 'copyofsnap1/test1/127/11' 2024-04-12T19:42:52.652 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/127/12' -> 'copyofsnap1/test1/127/12' 2024-04-12T19:42:52.652 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/127/13' -> 'copyofsnap1/test1/127/13' 2024-04-12T19:42:52.652 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/127/14' -> 'copyofsnap1/test1/127/14' 2024-04-12T19:42:52.652 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/127/15' -> 'copyofsnap1/test1/127/15' 2024-04-12T19:42:52.652 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/127/16' -> 'copyofsnap1/test1/127/16' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/127/17' -> 'copyofsnap1/test1/127/17' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/127/18' -> 'copyofsnap1/test1/127/18' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/127/19' -> 'copyofsnap1/test1/127/19' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/127/20' -> 'copyofsnap1/test1/127/20' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/128' -> 'copyofsnap1/test1/128' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/128/10' -> 'copyofsnap1/test1/128/10' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/128/11' -> 'copyofsnap1/test1/128/11' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/128/12' -> 'copyofsnap1/test1/128/12' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/128/13' -> 'copyofsnap1/test1/128/13' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/128/14' -> 'copyofsnap1/test1/128/14' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/128/15' -> 'copyofsnap1/test1/128/15' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/128/16' -> 'copyofsnap1/test1/128/16' 2024-04-12T19:42:52.653 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/128/17' -> 'copyofsnap1/test1/128/17' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/128/18' -> 'copyofsnap1/test1/128/18' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/128/19' -> 'copyofsnap1/test1/128/19' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/128/20' -> 'copyofsnap1/test1/128/20' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/129' -> 'copyofsnap1/test1/129' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/129/10' -> 'copyofsnap1/test1/129/10' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/129/11' -> 'copyofsnap1/test1/129/11' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/129/12' -> 'copyofsnap1/test1/129/12' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/129/13' -> 'copyofsnap1/test1/129/13' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/129/14' -> 'copyofsnap1/test1/129/14' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/129/15' -> 'copyofsnap1/test1/129/15' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/129/16' -> 'copyofsnap1/test1/129/16' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/129/17' -> 'copyofsnap1/test1/129/17' 2024-04-12T19:42:52.654 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/129/18' -> 'copyofsnap1/test1/129/18' 2024-04-12T19:42:52.655 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/129/19' -> 'copyofsnap1/test1/129/19' 2024-04-12T19:42:52.655 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/129/20' -> 'copyofsnap1/test1/129/20' 2024-04-12T19:42:52.655 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/130' -> 'copyofsnap1/test1/130' 2024-04-12T19:42:52.655 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/130/10' -> 'copyofsnap1/test1/130/10' 2024-04-12T19:42:52.655 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/130/11' -> 'copyofsnap1/test1/130/11' 2024-04-12T19:42:52.655 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/130/12' -> 'copyofsnap1/test1/130/12' 2024-04-12T19:42:52.655 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/130/13' -> 'copyofsnap1/test1/130/13' 2024-04-12T19:42:52.655 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/130/14' -> 'copyofsnap1/test1/130/14' 2024-04-12T19:42:52.655 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/130/15' -> 'copyofsnap1/test1/130/15' 2024-04-12T19:42:52.655 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/130/16' -> 'copyofsnap1/test1/130/16' 2024-04-12T19:42:52.655 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/130/17' -> 'copyofsnap1/test1/130/17' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/130/18' -> 'copyofsnap1/test1/130/18' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/130/19' -> 'copyofsnap1/test1/130/19' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/130/20' -> 'copyofsnap1/test1/130/20' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/131' -> 'copyofsnap1/test1/131' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/131/10' -> 'copyofsnap1/test1/131/10' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/131/11' -> 'copyofsnap1/test1/131/11' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/131/12' -> 'copyofsnap1/test1/131/12' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/131/13' -> 'copyofsnap1/test1/131/13' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/131/14' -> 'copyofsnap1/test1/131/14' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/131/15' -> 'copyofsnap1/test1/131/15' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/131/16' -> 'copyofsnap1/test1/131/16' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/131/17' -> 'copyofsnap1/test1/131/17' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/131/18' -> 'copyofsnap1/test1/131/18' 2024-04-12T19:42:52.656 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/131/19' -> 'copyofsnap1/test1/131/19' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/131/20' -> 'copyofsnap1/test1/131/20' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/132' -> 'copyofsnap1/test1/132' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/132/10' -> 'copyofsnap1/test1/132/10' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/132/11' -> 'copyofsnap1/test1/132/11' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/132/12' -> 'copyofsnap1/test1/132/12' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/132/13' -> 'copyofsnap1/test1/132/13' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/132/14' -> 'copyofsnap1/test1/132/14' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/132/15' -> 'copyofsnap1/test1/132/15' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/132/16' -> 'copyofsnap1/test1/132/16' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/132/17' -> 'copyofsnap1/test1/132/17' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/132/18' -> 'copyofsnap1/test1/132/18' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/132/19' -> 'copyofsnap1/test1/132/19' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/132/20' -> 'copyofsnap1/test1/132/20' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/133' -> 'copyofsnap1/test1/133' 2024-04-12T19:42:52.657 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/133/10' -> 'copyofsnap1/test1/133/10' 2024-04-12T19:42:52.658 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/133/11' -> 'copyofsnap1/test1/133/11' 2024-04-12T19:42:52.658 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/133/12' -> 'copyofsnap1/test1/133/12' 2024-04-12T19:42:52.658 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/133/13' -> 'copyofsnap1/test1/133/13' 2024-04-12T19:42:52.658 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/133/14' -> 'copyofsnap1/test1/133/14' 2024-04-12T19:42:52.658 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/133/15' -> 'copyofsnap1/test1/133/15' 2024-04-12T19:42:52.658 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/133/16' -> 'copyofsnap1/test1/133/16' 2024-04-12T19:42:55.294 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/133/17' -> 'copyofsnap1/test1/133/17' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/133/18' -> 'copyofsnap1/test1/133/18' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/133/19' -> 'copyofsnap1/test1/133/19' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/133/20' -> 'copyofsnap1/test1/133/20' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/134' -> 'copyofsnap1/test1/134' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/134/10' -> 'copyofsnap1/test1/134/10' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/134/11' -> 'copyofsnap1/test1/134/11' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/134/12' -> 'copyofsnap1/test1/134/12' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/134/13' -> 'copyofsnap1/test1/134/13' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/134/14' -> 'copyofsnap1/test1/134/14' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/134/15' -> 'copyofsnap1/test1/134/15' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/134/16' -> 'copyofsnap1/test1/134/16' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/134/17' -> 'copyofsnap1/test1/134/17' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/134/18' -> 'copyofsnap1/test1/134/18' 2024-04-12T19:42:55.295 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/134/19' -> 'copyofsnap1/test1/134/19' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/134/20' -> 'copyofsnap1/test1/134/20' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/135' -> 'copyofsnap1/test1/135' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/135/10' -> 'copyofsnap1/test1/135/10' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/135/11' -> 'copyofsnap1/test1/135/11' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/135/12' -> 'copyofsnap1/test1/135/12' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/135/13' -> 'copyofsnap1/test1/135/13' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/135/14' -> 'copyofsnap1/test1/135/14' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/135/15' -> 'copyofsnap1/test1/135/15' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/135/16' -> 'copyofsnap1/test1/135/16' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/135/17' -> 'copyofsnap1/test1/135/17' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/135/18' -> 'copyofsnap1/test1/135/18' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/135/19' -> 'copyofsnap1/test1/135/19' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/135/20' -> 'copyofsnap1/test1/135/20' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/136' -> 'copyofsnap1/test1/136' 2024-04-12T19:42:55.296 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/136/10' -> 'copyofsnap1/test1/136/10' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/136/11' -> 'copyofsnap1/test1/136/11' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/136/12' -> 'copyofsnap1/test1/136/12' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/136/13' -> 'copyofsnap1/test1/136/13' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/136/14' -> 'copyofsnap1/test1/136/14' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/136/15' -> 'copyofsnap1/test1/136/15' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/136/16' -> 'copyofsnap1/test1/136/16' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/136/17' -> 'copyofsnap1/test1/136/17' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/136/18' -> 'copyofsnap1/test1/136/18' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/136/19' -> 'copyofsnap1/test1/136/19' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/136/20' -> 'copyofsnap1/test1/136/20' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/137' -> 'copyofsnap1/test1/137' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/137/10' -> 'copyofsnap1/test1/137/10' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/137/11' -> 'copyofsnap1/test1/137/11' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/137/12' -> 'copyofsnap1/test1/137/12' 2024-04-12T19:42:55.297 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/137/13' -> 'copyofsnap1/test1/137/13' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/137/14' -> 'copyofsnap1/test1/137/14' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/137/15' -> 'copyofsnap1/test1/137/15' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/137/16' -> 'copyofsnap1/test1/137/16' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/137/17' -> 'copyofsnap1/test1/137/17' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/137/18' -> 'copyofsnap1/test1/137/18' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/137/19' -> 'copyofsnap1/test1/137/19' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/137/20' -> 'copyofsnap1/test1/137/20' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/138' -> 'copyofsnap1/test1/138' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/138/10' -> 'copyofsnap1/test1/138/10' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/138/11' -> 'copyofsnap1/test1/138/11' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/138/12' -> 'copyofsnap1/test1/138/12' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/138/13' -> 'copyofsnap1/test1/138/13' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/138/14' -> 'copyofsnap1/test1/138/14' 2024-04-12T19:42:55.298 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/138/15' -> 'copyofsnap1/test1/138/15' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/138/16' -> 'copyofsnap1/test1/138/16' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/138/17' -> 'copyofsnap1/test1/138/17' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/138/18' -> 'copyofsnap1/test1/138/18' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/138/19' -> 'copyofsnap1/test1/138/19' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/138/20' -> 'copyofsnap1/test1/138/20' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/139' -> 'copyofsnap1/test1/139' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/139/10' -> 'copyofsnap1/test1/139/10' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/139/11' -> 'copyofsnap1/test1/139/11' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/139/12' -> 'copyofsnap1/test1/139/12' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/139/13' -> 'copyofsnap1/test1/139/13' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/139/14' -> 'copyofsnap1/test1/139/14' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/139/15' -> 'copyofsnap1/test1/139/15' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/139/16' -> 'copyofsnap1/test1/139/16' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/139/17' -> 'copyofsnap1/test1/139/17' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/139/18' -> 'copyofsnap1/test1/139/18' 2024-04-12T19:42:55.299 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/139/19' -> 'copyofsnap1/test1/139/19' 2024-04-12T19:42:55.300 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/139/20' -> 'copyofsnap1/test1/139/20' 2024-04-12T19:42:55.300 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/140' -> 'copyofsnap1/test1/140' 2024-04-12T19:42:55.300 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/140/10' -> 'copyofsnap1/test1/140/10' 2024-04-12T19:42:55.300 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/140/11' -> 'copyofsnap1/test1/140/11' 2024-04-12T19:42:55.300 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/140/12' -> 'copyofsnap1/test1/140/12' 2024-04-12T19:42:55.300 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/140/13' -> 'copyofsnap1/test1/140/13' 2024-04-12T19:42:57.996 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/140/14' -> 'copyofsnap1/test1/140/14' 2024-04-12T19:42:57.996 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/140/15' -> 'copyofsnap1/test1/140/15' 2024-04-12T19:42:57.996 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/140/16' -> 'copyofsnap1/test1/140/16' 2024-04-12T19:42:57.996 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/140/17' -> 'copyofsnap1/test1/140/17' 2024-04-12T19:42:57.996 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/140/18' -> 'copyofsnap1/test1/140/18' 2024-04-12T19:42:57.996 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/140/19' -> 'copyofsnap1/test1/140/19' 2024-04-12T19:42:57.996 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/140/20' -> 'copyofsnap1/test1/140/20' 2024-04-12T19:42:57.996 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/141' -> 'copyofsnap1/test1/141' 2024-04-12T19:42:57.996 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/141/10' -> 'copyofsnap1/test1/141/10' 2024-04-12T19:42:57.996 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/141/11' -> 'copyofsnap1/test1/141/11' 2024-04-12T19:42:57.996 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/141/12' -> 'copyofsnap1/test1/141/12' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/141/13' -> 'copyofsnap1/test1/141/13' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/141/14' -> 'copyofsnap1/test1/141/14' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/141/15' -> 'copyofsnap1/test1/141/15' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/141/16' -> 'copyofsnap1/test1/141/16' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/141/17' -> 'copyofsnap1/test1/141/17' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/141/18' -> 'copyofsnap1/test1/141/18' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/141/19' -> 'copyofsnap1/test1/141/19' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/141/20' -> 'copyofsnap1/test1/141/20' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/142' -> 'copyofsnap1/test1/142' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/142/10' -> 'copyofsnap1/test1/142/10' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/142/11' -> 'copyofsnap1/test1/142/11' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/142/12' -> 'copyofsnap1/test1/142/12' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/142/13' -> 'copyofsnap1/test1/142/13' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/142/14' -> 'copyofsnap1/test1/142/14' 2024-04-12T19:42:57.997 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/142/15' -> 'copyofsnap1/test1/142/15' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/142/16' -> 'copyofsnap1/test1/142/16' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/142/17' -> 'copyofsnap1/test1/142/17' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/142/18' -> 'copyofsnap1/test1/142/18' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/142/19' -> 'copyofsnap1/test1/142/19' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/142/20' -> 'copyofsnap1/test1/142/20' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/143' -> 'copyofsnap1/test1/143' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/143/10' -> 'copyofsnap1/test1/143/10' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/143/11' -> 'copyofsnap1/test1/143/11' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/143/12' -> 'copyofsnap1/test1/143/12' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/143/13' -> 'copyofsnap1/test1/143/13' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/143/14' -> 'copyofsnap1/test1/143/14' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/143/15' -> 'copyofsnap1/test1/143/15' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/143/16' -> 'copyofsnap1/test1/143/16' 2024-04-12T19:42:57.998 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/143/17' -> 'copyofsnap1/test1/143/17' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/143/18' -> 'copyofsnap1/test1/143/18' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/143/19' -> 'copyofsnap1/test1/143/19' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/143/20' -> 'copyofsnap1/test1/143/20' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/144' -> 'copyofsnap1/test1/144' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/144/10' -> 'copyofsnap1/test1/144/10' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/144/11' -> 'copyofsnap1/test1/144/11' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/144/12' -> 'copyofsnap1/test1/144/12' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/144/13' -> 'copyofsnap1/test1/144/13' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/144/14' -> 'copyofsnap1/test1/144/14' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/144/15' -> 'copyofsnap1/test1/144/15' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/144/16' -> 'copyofsnap1/test1/144/16' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/144/17' -> 'copyofsnap1/test1/144/17' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/144/18' -> 'copyofsnap1/test1/144/18' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/144/19' -> 'copyofsnap1/test1/144/19' 2024-04-12T19:42:57.999 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/144/20' -> 'copyofsnap1/test1/144/20' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/145' -> 'copyofsnap1/test1/145' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/145/10' -> 'copyofsnap1/test1/145/10' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/145/11' -> 'copyofsnap1/test1/145/11' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/145/12' -> 'copyofsnap1/test1/145/12' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/145/13' -> 'copyofsnap1/test1/145/13' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/145/14' -> 'copyofsnap1/test1/145/14' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/145/15' -> 'copyofsnap1/test1/145/15' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/145/16' -> 'copyofsnap1/test1/145/16' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/145/17' -> 'copyofsnap1/test1/145/17' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/145/18' -> 'copyofsnap1/test1/145/18' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/145/19' -> 'copyofsnap1/test1/145/19' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/145/20' -> 'copyofsnap1/test1/145/20' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/146' -> 'copyofsnap1/test1/146' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/146/10' -> 'copyofsnap1/test1/146/10' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/146/11' -> 'copyofsnap1/test1/146/11' 2024-04-12T19:42:58.000 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/146/12' -> 'copyofsnap1/test1/146/12' 2024-04-12T19:42:58.001 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/146/13' -> 'copyofsnap1/test1/146/13' 2024-04-12T19:42:58.001 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/146/14' -> 'copyofsnap1/test1/146/14' 2024-04-12T19:42:58.001 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/146/15' -> 'copyofsnap1/test1/146/15' 2024-04-12T19:42:58.001 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/146/16' -> 'copyofsnap1/test1/146/16' 2024-04-12T19:42:58.001 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/146/17' -> 'copyofsnap1/test1/146/17' 2024-04-12T19:42:58.001 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/146/18' -> 'copyofsnap1/test1/146/18' 2024-04-12T19:42:58.001 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/146/19' -> 'copyofsnap1/test1/146/19' 2024-04-12T19:42:58.001 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/146/20' -> 'copyofsnap1/test1/146/20' 2024-04-12T19:42:58.001 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/147' -> 'copyofsnap1/test1/147' 2024-04-12T19:42:58.001 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/147/10' -> 'copyofsnap1/test1/147/10' 2024-04-12T19:42:58.001 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/147/11' -> 'copyofsnap1/test1/147/11' 2024-04-12T19:43:00.622 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/147/12' -> 'copyofsnap1/test1/147/12' 2024-04-12T19:43:00.622 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/147/13' -> 'copyofsnap1/test1/147/13' 2024-04-12T19:43:00.622 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/147/14' -> 'copyofsnap1/test1/147/14' 2024-04-12T19:43:00.622 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/147/15' -> 'copyofsnap1/test1/147/15' 2024-04-12T19:43:00.622 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/147/16' -> 'copyofsnap1/test1/147/16' 2024-04-12T19:43:00.622 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/147/17' -> 'copyofsnap1/test1/147/17' 2024-04-12T19:43:00.622 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/147/18' -> 'copyofsnap1/test1/147/18' 2024-04-12T19:43:00.622 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/147/19' -> 'copyofsnap1/test1/147/19' 2024-04-12T19:43:00.622 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/147/20' -> 'copyofsnap1/test1/147/20' 2024-04-12T19:43:00.622 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/148' -> 'copyofsnap1/test1/148' 2024-04-12T19:43:00.622 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/148/10' -> 'copyofsnap1/test1/148/10' 2024-04-12T19:43:00.622 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/148/11' -> 'copyofsnap1/test1/148/11' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/148/12' -> 'copyofsnap1/test1/148/12' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/148/13' -> 'copyofsnap1/test1/148/13' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/148/14' -> 'copyofsnap1/test1/148/14' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/148/15' -> 'copyofsnap1/test1/148/15' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/148/16' -> 'copyofsnap1/test1/148/16' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/148/17' -> 'copyofsnap1/test1/148/17' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/148/18' -> 'copyofsnap1/test1/148/18' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/148/19' -> 'copyofsnap1/test1/148/19' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/148/20' -> 'copyofsnap1/test1/148/20' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/149' -> 'copyofsnap1/test1/149' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/149/10' -> 'copyofsnap1/test1/149/10' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/149/11' -> 'copyofsnap1/test1/149/11' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/149/12' -> 'copyofsnap1/test1/149/12' 2024-04-12T19:43:00.623 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/149/13' -> 'copyofsnap1/test1/149/13' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/149/14' -> 'copyofsnap1/test1/149/14' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/149/15' -> 'copyofsnap1/test1/149/15' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/149/16' -> 'copyofsnap1/test1/149/16' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/149/17' -> 'copyofsnap1/test1/149/17' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/149/18' -> 'copyofsnap1/test1/149/18' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/149/19' -> 'copyofsnap1/test1/149/19' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/149/20' -> 'copyofsnap1/test1/149/20' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/150' -> 'copyofsnap1/test1/150' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/150/10' -> 'copyofsnap1/test1/150/10' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/150/11' -> 'copyofsnap1/test1/150/11' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/150/12' -> 'copyofsnap1/test1/150/12' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/150/13' -> 'copyofsnap1/test1/150/13' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/150/14' -> 'copyofsnap1/test1/150/14' 2024-04-12T19:43:00.624 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/150/15' -> 'copyofsnap1/test1/150/15' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/150/16' -> 'copyofsnap1/test1/150/16' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/150/17' -> 'copyofsnap1/test1/150/17' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/150/18' -> 'copyofsnap1/test1/150/18' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/150/19' -> 'copyofsnap1/test1/150/19' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/150/20' -> 'copyofsnap1/test1/150/20' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/151' -> 'copyofsnap1/test1/151' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/151/10' -> 'copyofsnap1/test1/151/10' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/151/11' -> 'copyofsnap1/test1/151/11' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/151/12' -> 'copyofsnap1/test1/151/12' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/151/13' -> 'copyofsnap1/test1/151/13' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/151/14' -> 'copyofsnap1/test1/151/14' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/151/15' -> 'copyofsnap1/test1/151/15' 2024-04-12T19:43:00.625 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/151/16' -> 'copyofsnap1/test1/151/16' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/151/17' -> 'copyofsnap1/test1/151/17' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/151/18' -> 'copyofsnap1/test1/151/18' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/151/19' -> 'copyofsnap1/test1/151/19' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/151/20' -> 'copyofsnap1/test1/151/20' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/152' -> 'copyofsnap1/test1/152' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/152/10' -> 'copyofsnap1/test1/152/10' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/152/11' -> 'copyofsnap1/test1/152/11' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/152/12' -> 'copyofsnap1/test1/152/12' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/152/13' -> 'copyofsnap1/test1/152/13' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/152/14' -> 'copyofsnap1/test1/152/14' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/152/15' -> 'copyofsnap1/test1/152/15' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/152/16' -> 'copyofsnap1/test1/152/16' 2024-04-12T19:43:00.626 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/152/17' -> 'copyofsnap1/test1/152/17' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/152/18' -> 'copyofsnap1/test1/152/18' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/152/19' -> 'copyofsnap1/test1/152/19' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/152/20' -> 'copyofsnap1/test1/152/20' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/153' -> 'copyofsnap1/test1/153' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/153/10' -> 'copyofsnap1/test1/153/10' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/153/11' -> 'copyofsnap1/test1/153/11' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/153/12' -> 'copyofsnap1/test1/153/12' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/153/13' -> 'copyofsnap1/test1/153/13' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/153/14' -> 'copyofsnap1/test1/153/14' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/153/15' -> 'copyofsnap1/test1/153/15' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/153/16' -> 'copyofsnap1/test1/153/16' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/153/17' -> 'copyofsnap1/test1/153/17' 2024-04-12T19:43:00.627 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/153/18' -> 'copyofsnap1/test1/153/18' 2024-04-12T19:43:00.628 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/153/19' -> 'copyofsnap1/test1/153/19' 2024-04-12T19:43:00.628 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/153/20' -> 'copyofsnap1/test1/153/20' 2024-04-12T19:43:03.234 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/154' -> 'copyofsnap1/test1/154' 2024-04-12T19:43:03.234 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/154/10' -> 'copyofsnap1/test1/154/10' 2024-04-12T19:43:03.234 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/154/11' -> 'copyofsnap1/test1/154/11' 2024-04-12T19:43:03.234 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/154/12' -> 'copyofsnap1/test1/154/12' 2024-04-12T19:43:03.234 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/154/13' -> 'copyofsnap1/test1/154/13' 2024-04-12T19:43:03.234 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/154/14' -> 'copyofsnap1/test1/154/14' 2024-04-12T19:43:03.234 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/154/15' -> 'copyofsnap1/test1/154/15' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/154/16' -> 'copyofsnap1/test1/154/16' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/154/17' -> 'copyofsnap1/test1/154/17' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/154/18' -> 'copyofsnap1/test1/154/18' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/154/19' -> 'copyofsnap1/test1/154/19' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/154/20' -> 'copyofsnap1/test1/154/20' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/155' -> 'copyofsnap1/test1/155' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/155/10' -> 'copyofsnap1/test1/155/10' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/155/11' -> 'copyofsnap1/test1/155/11' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/155/12' -> 'copyofsnap1/test1/155/12' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/155/13' -> 'copyofsnap1/test1/155/13' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/155/14' -> 'copyofsnap1/test1/155/14' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/155/15' -> 'copyofsnap1/test1/155/15' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/155/16' -> 'copyofsnap1/test1/155/16' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/155/17' -> 'copyofsnap1/test1/155/17' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/155/18' -> 'copyofsnap1/test1/155/18' 2024-04-12T19:43:03.235 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/155/19' -> 'copyofsnap1/test1/155/19' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/155/20' -> 'copyofsnap1/test1/155/20' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/156' -> 'copyofsnap1/test1/156' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/156/10' -> 'copyofsnap1/test1/156/10' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/156/11' -> 'copyofsnap1/test1/156/11' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/156/12' -> 'copyofsnap1/test1/156/12' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/156/13' -> 'copyofsnap1/test1/156/13' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/156/14' -> 'copyofsnap1/test1/156/14' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/156/15' -> 'copyofsnap1/test1/156/15' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/156/16' -> 'copyofsnap1/test1/156/16' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/156/17' -> 'copyofsnap1/test1/156/17' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/156/18' -> 'copyofsnap1/test1/156/18' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/156/19' -> 'copyofsnap1/test1/156/19' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/156/20' -> 'copyofsnap1/test1/156/20' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/157' -> 'copyofsnap1/test1/157' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/157/10' -> 'copyofsnap1/test1/157/10' 2024-04-12T19:43:03.236 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/157/11' -> 'copyofsnap1/test1/157/11' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/157/12' -> 'copyofsnap1/test1/157/12' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/157/13' -> 'copyofsnap1/test1/157/13' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/157/14' -> 'copyofsnap1/test1/157/14' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/157/15' -> 'copyofsnap1/test1/157/15' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/157/16' -> 'copyofsnap1/test1/157/16' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/157/17' -> 'copyofsnap1/test1/157/17' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/157/18' -> 'copyofsnap1/test1/157/18' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/157/19' -> 'copyofsnap1/test1/157/19' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/157/20' -> 'copyofsnap1/test1/157/20' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/158' -> 'copyofsnap1/test1/158' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/158/10' -> 'copyofsnap1/test1/158/10' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/158/11' -> 'copyofsnap1/test1/158/11' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/158/12' -> 'copyofsnap1/test1/158/12' 2024-04-12T19:43:03.237 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/158/13' -> 'copyofsnap1/test1/158/13' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/158/14' -> 'copyofsnap1/test1/158/14' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/158/15' -> 'copyofsnap1/test1/158/15' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/158/16' -> 'copyofsnap1/test1/158/16' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/158/17' -> 'copyofsnap1/test1/158/17' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/158/18' -> 'copyofsnap1/test1/158/18' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/158/19' -> 'copyofsnap1/test1/158/19' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/158/20' -> 'copyofsnap1/test1/158/20' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/159' -> 'copyofsnap1/test1/159' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/159/10' -> 'copyofsnap1/test1/159/10' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/159/11' -> 'copyofsnap1/test1/159/11' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/159/12' -> 'copyofsnap1/test1/159/12' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/159/13' -> 'copyofsnap1/test1/159/13' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/159/14' -> 'copyofsnap1/test1/159/14' 2024-04-12T19:43:03.238 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/159/15' -> 'copyofsnap1/test1/159/15' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/159/16' -> 'copyofsnap1/test1/159/16' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/159/17' -> 'copyofsnap1/test1/159/17' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/159/18' -> 'copyofsnap1/test1/159/18' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/159/19' -> 'copyofsnap1/test1/159/19' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/159/20' -> 'copyofsnap1/test1/159/20' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/160' -> 'copyofsnap1/test1/160' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/160/10' -> 'copyofsnap1/test1/160/10' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/160/11' -> 'copyofsnap1/test1/160/11' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/160/12' -> 'copyofsnap1/test1/160/12' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/160/13' -> 'copyofsnap1/test1/160/13' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/160/14' -> 'copyofsnap1/test1/160/14' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/160/15' -> 'copyofsnap1/test1/160/15' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/160/16' -> 'copyofsnap1/test1/160/16' 2024-04-12T19:43:03.239 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/160/17' -> 'copyofsnap1/test1/160/17' 2024-04-12T19:43:05.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/160/18' -> 'copyofsnap1/test1/160/18' 2024-04-12T19:43:05.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/160/19' -> 'copyofsnap1/test1/160/19' 2024-04-12T19:43:05.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/160/20' -> 'copyofsnap1/test1/160/20' 2024-04-12T19:43:05.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/161' -> 'copyofsnap1/test1/161' 2024-04-12T19:43:05.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/161/10' -> 'copyofsnap1/test1/161/10' 2024-04-12T19:43:05.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/161/11' -> 'copyofsnap1/test1/161/11' 2024-04-12T19:43:05.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/161/12' -> 'copyofsnap1/test1/161/12' 2024-04-12T19:43:05.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/161/13' -> 'copyofsnap1/test1/161/13' 2024-04-12T19:43:05.872 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/161/14' -> 'copyofsnap1/test1/161/14' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/161/15' -> 'copyofsnap1/test1/161/15' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/161/16' -> 'copyofsnap1/test1/161/16' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/161/17' -> 'copyofsnap1/test1/161/17' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/161/18' -> 'copyofsnap1/test1/161/18' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/161/19' -> 'copyofsnap1/test1/161/19' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/161/20' -> 'copyofsnap1/test1/161/20' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/162' -> 'copyofsnap1/test1/162' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/162/10' -> 'copyofsnap1/test1/162/10' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/162/11' -> 'copyofsnap1/test1/162/11' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/162/12' -> 'copyofsnap1/test1/162/12' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/162/13' -> 'copyofsnap1/test1/162/13' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/162/14' -> 'copyofsnap1/test1/162/14' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/162/15' -> 'copyofsnap1/test1/162/15' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/162/16' -> 'copyofsnap1/test1/162/16' 2024-04-12T19:43:05.873 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/162/17' -> 'copyofsnap1/test1/162/17' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/162/18' -> 'copyofsnap1/test1/162/18' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/162/19' -> 'copyofsnap1/test1/162/19' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/162/20' -> 'copyofsnap1/test1/162/20' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/163' -> 'copyofsnap1/test1/163' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/163/10' -> 'copyofsnap1/test1/163/10' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/163/11' -> 'copyofsnap1/test1/163/11' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/163/12' -> 'copyofsnap1/test1/163/12' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/163/13' -> 'copyofsnap1/test1/163/13' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/163/14' -> 'copyofsnap1/test1/163/14' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/163/15' -> 'copyofsnap1/test1/163/15' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/163/16' -> 'copyofsnap1/test1/163/16' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/163/17' -> 'copyofsnap1/test1/163/17' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/163/18' -> 'copyofsnap1/test1/163/18' 2024-04-12T19:43:05.874 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/163/19' -> 'copyofsnap1/test1/163/19' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/163/20' -> 'copyofsnap1/test1/163/20' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/164' -> 'copyofsnap1/test1/164' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/164/10' -> 'copyofsnap1/test1/164/10' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/164/11' -> 'copyofsnap1/test1/164/11' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/164/12' -> 'copyofsnap1/test1/164/12' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/164/13' -> 'copyofsnap1/test1/164/13' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/164/14' -> 'copyofsnap1/test1/164/14' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/164/15' -> 'copyofsnap1/test1/164/15' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/164/16' -> 'copyofsnap1/test1/164/16' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/164/17' -> 'copyofsnap1/test1/164/17' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/164/18' -> 'copyofsnap1/test1/164/18' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/164/19' -> 'copyofsnap1/test1/164/19' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/164/20' -> 'copyofsnap1/test1/164/20' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/165' -> 'copyofsnap1/test1/165' 2024-04-12T19:43:05.875 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/165/10' -> 'copyofsnap1/test1/165/10' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/165/11' -> 'copyofsnap1/test1/165/11' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/165/12' -> 'copyofsnap1/test1/165/12' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/165/13' -> 'copyofsnap1/test1/165/13' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/165/14' -> 'copyofsnap1/test1/165/14' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/165/15' -> 'copyofsnap1/test1/165/15' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/165/16' -> 'copyofsnap1/test1/165/16' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/165/17' -> 'copyofsnap1/test1/165/17' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/165/18' -> 'copyofsnap1/test1/165/18' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/165/19' -> 'copyofsnap1/test1/165/19' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/165/20' -> 'copyofsnap1/test1/165/20' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/166' -> 'copyofsnap1/test1/166' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/166/10' -> 'copyofsnap1/test1/166/10' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/166/11' -> 'copyofsnap1/test1/166/11' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/166/12' -> 'copyofsnap1/test1/166/12' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/166/13' -> 'copyofsnap1/test1/166/13' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/166/14' -> 'copyofsnap1/test1/166/14' 2024-04-12T19:43:05.876 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/166/15' -> 'copyofsnap1/test1/166/15' 2024-04-12T19:43:05.877 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/166/16' -> 'copyofsnap1/test1/166/16' 2024-04-12T19:43:05.877 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/166/17' -> 'copyofsnap1/test1/166/17' 2024-04-12T19:43:05.877 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/166/18' -> 'copyofsnap1/test1/166/18' 2024-04-12T19:43:05.877 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/166/19' -> 'copyofsnap1/test1/166/19' 2024-04-12T19:43:05.877 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/166/20' -> 'copyofsnap1/test1/166/20' 2024-04-12T19:43:05.877 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/167' -> 'copyofsnap1/test1/167' 2024-04-12T19:43:05.877 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/167/10' -> 'copyofsnap1/test1/167/10' 2024-04-12T19:43:05.877 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/167/11' -> 'copyofsnap1/test1/167/11' 2024-04-12T19:43:05.877 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/167/12' -> 'copyofsnap1/test1/167/12' 2024-04-12T19:43:05.877 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/167/13' -> 'copyofsnap1/test1/167/13' 2024-04-12T19:43:05.877 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/167/14' -> 'copyofsnap1/test1/167/14' 2024-04-12T19:43:08.501 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/167/15' -> 'copyofsnap1/test1/167/15' 2024-04-12T19:43:08.501 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/167/16' -> 'copyofsnap1/test1/167/16' 2024-04-12T19:43:08.501 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/167/17' -> 'copyofsnap1/test1/167/17' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/167/18' -> 'copyofsnap1/test1/167/18' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/167/19' -> 'copyofsnap1/test1/167/19' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/167/20' -> 'copyofsnap1/test1/167/20' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/168' -> 'copyofsnap1/test1/168' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/168/10' -> 'copyofsnap1/test1/168/10' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/168/11' -> 'copyofsnap1/test1/168/11' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/168/12' -> 'copyofsnap1/test1/168/12' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/168/13' -> 'copyofsnap1/test1/168/13' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/168/14' -> 'copyofsnap1/test1/168/14' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/168/15' -> 'copyofsnap1/test1/168/15' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/168/16' -> 'copyofsnap1/test1/168/16' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/168/17' -> 'copyofsnap1/test1/168/17' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/168/18' -> 'copyofsnap1/test1/168/18' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/168/19' -> 'copyofsnap1/test1/168/19' 2024-04-12T19:43:08.502 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/168/20' -> 'copyofsnap1/test1/168/20' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/169' -> 'copyofsnap1/test1/169' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/169/10' -> 'copyofsnap1/test1/169/10' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/169/11' -> 'copyofsnap1/test1/169/11' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/169/12' -> 'copyofsnap1/test1/169/12' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/169/13' -> 'copyofsnap1/test1/169/13' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/169/14' -> 'copyofsnap1/test1/169/14' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/169/15' -> 'copyofsnap1/test1/169/15' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/169/16' -> 'copyofsnap1/test1/169/16' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/169/17' -> 'copyofsnap1/test1/169/17' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/169/18' -> 'copyofsnap1/test1/169/18' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/169/19' -> 'copyofsnap1/test1/169/19' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/169/20' -> 'copyofsnap1/test1/169/20' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/170' -> 'copyofsnap1/test1/170' 2024-04-12T19:43:08.503 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/170/10' -> 'copyofsnap1/test1/170/10' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/170/11' -> 'copyofsnap1/test1/170/11' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/170/12' -> 'copyofsnap1/test1/170/12' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/170/13' -> 'copyofsnap1/test1/170/13' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/170/14' -> 'copyofsnap1/test1/170/14' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/170/15' -> 'copyofsnap1/test1/170/15' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/170/16' -> 'copyofsnap1/test1/170/16' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/170/17' -> 'copyofsnap1/test1/170/17' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/170/18' -> 'copyofsnap1/test1/170/18' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/170/19' -> 'copyofsnap1/test1/170/19' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/170/20' -> 'copyofsnap1/test1/170/20' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/171' -> 'copyofsnap1/test1/171' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/171/10' -> 'copyofsnap1/test1/171/10' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/171/11' -> 'copyofsnap1/test1/171/11' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/171/12' -> 'copyofsnap1/test1/171/12' 2024-04-12T19:43:08.504 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/171/13' -> 'copyofsnap1/test1/171/13' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/171/14' -> 'copyofsnap1/test1/171/14' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/171/15' -> 'copyofsnap1/test1/171/15' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/171/16' -> 'copyofsnap1/test1/171/16' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/171/17' -> 'copyofsnap1/test1/171/17' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/171/18' -> 'copyofsnap1/test1/171/18' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/171/19' -> 'copyofsnap1/test1/171/19' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/171/20' -> 'copyofsnap1/test1/171/20' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/172' -> 'copyofsnap1/test1/172' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/172/10' -> 'copyofsnap1/test1/172/10' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/172/11' -> 'copyofsnap1/test1/172/11' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/172/12' -> 'copyofsnap1/test1/172/12' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/172/13' -> 'copyofsnap1/test1/172/13' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/172/14' -> 'copyofsnap1/test1/172/14' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/172/15' -> 'copyofsnap1/test1/172/15' 2024-04-12T19:43:08.505 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/172/16' -> 'copyofsnap1/test1/172/16' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/172/17' -> 'copyofsnap1/test1/172/17' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/172/18' -> 'copyofsnap1/test1/172/18' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/172/19' -> 'copyofsnap1/test1/172/19' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/172/20' -> 'copyofsnap1/test1/172/20' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/173' -> 'copyofsnap1/test1/173' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/173/10' -> 'copyofsnap1/test1/173/10' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/173/11' -> 'copyofsnap1/test1/173/11' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/173/12' -> 'copyofsnap1/test1/173/12' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/173/13' -> 'copyofsnap1/test1/173/13' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/173/14' -> 'copyofsnap1/test1/173/14' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/173/15' -> 'copyofsnap1/test1/173/15' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/173/16' -> 'copyofsnap1/test1/173/16' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/173/17' -> 'copyofsnap1/test1/173/17' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/173/18' -> 'copyofsnap1/test1/173/18' 2024-04-12T19:43:08.506 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/173/19' -> 'copyofsnap1/test1/173/19' 2024-04-12T19:43:08.507 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/173/20' -> 'copyofsnap1/test1/173/20' 2024-04-12T19:43:08.507 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/174' -> 'copyofsnap1/test1/174' 2024-04-12T19:43:08.507 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/174/10' -> 'copyofsnap1/test1/174/10' 2024-04-12T19:43:08.507 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/174/11' -> 'copyofsnap1/test1/174/11' 2024-04-12T19:43:10.142 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:43:10.150 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:43:11.112 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/174/12' -> 'copyofsnap1/test1/174/12' 2024-04-12T19:43:11.112 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/174/13' -> 'copyofsnap1/test1/174/13' 2024-04-12T19:43:11.112 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/174/14' -> 'copyofsnap1/test1/174/14' 2024-04-12T19:43:11.112 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/174/15' -> 'copyofsnap1/test1/174/15' 2024-04-12T19:43:11.112 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/174/16' -> 'copyofsnap1/test1/174/16' 2024-04-12T19:43:11.112 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/174/17' -> 'copyofsnap1/test1/174/17' 2024-04-12T19:43:11.112 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/174/18' -> 'copyofsnap1/test1/174/18' 2024-04-12T19:43:11.112 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/174/19' -> 'copyofsnap1/test1/174/19' 2024-04-12T19:43:11.112 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/174/20' -> 'copyofsnap1/test1/174/20' 2024-04-12T19:43:11.112 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/175' -> 'copyofsnap1/test1/175' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/175/10' -> 'copyofsnap1/test1/175/10' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/175/11' -> 'copyofsnap1/test1/175/11' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/175/12' -> 'copyofsnap1/test1/175/12' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/175/13' -> 'copyofsnap1/test1/175/13' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/175/14' -> 'copyofsnap1/test1/175/14' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/175/15' -> 'copyofsnap1/test1/175/15' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/175/16' -> 'copyofsnap1/test1/175/16' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/175/17' -> 'copyofsnap1/test1/175/17' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/175/18' -> 'copyofsnap1/test1/175/18' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/175/19' -> 'copyofsnap1/test1/175/19' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/175/20' -> 'copyofsnap1/test1/175/20' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/176' -> 'copyofsnap1/test1/176' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/176/10' -> 'copyofsnap1/test1/176/10' 2024-04-12T19:43:11.113 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/176/11' -> 'copyofsnap1/test1/176/11' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/176/12' -> 'copyofsnap1/test1/176/12' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/176/13' -> 'copyofsnap1/test1/176/13' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/176/14' -> 'copyofsnap1/test1/176/14' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/176/15' -> 'copyofsnap1/test1/176/15' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/176/16' -> 'copyofsnap1/test1/176/16' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/176/17' -> 'copyofsnap1/test1/176/17' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/176/18' -> 'copyofsnap1/test1/176/18' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/176/19' -> 'copyofsnap1/test1/176/19' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/176/20' -> 'copyofsnap1/test1/176/20' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/177' -> 'copyofsnap1/test1/177' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/177/10' -> 'copyofsnap1/test1/177/10' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/177/11' -> 'copyofsnap1/test1/177/11' 2024-04-12T19:43:11.114 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/177/12' -> 'copyofsnap1/test1/177/12' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/177/13' -> 'copyofsnap1/test1/177/13' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/177/14' -> 'copyofsnap1/test1/177/14' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/177/15' -> 'copyofsnap1/test1/177/15' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/177/16' -> 'copyofsnap1/test1/177/16' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/177/17' -> 'copyofsnap1/test1/177/17' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/177/18' -> 'copyofsnap1/test1/177/18' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/177/19' -> 'copyofsnap1/test1/177/19' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/177/20' -> 'copyofsnap1/test1/177/20' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/178' -> 'copyofsnap1/test1/178' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/178/10' -> 'copyofsnap1/test1/178/10' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/178/11' -> 'copyofsnap1/test1/178/11' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/178/12' -> 'copyofsnap1/test1/178/12' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/178/13' -> 'copyofsnap1/test1/178/13' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/178/14' -> 'copyofsnap1/test1/178/14' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/178/15' -> 'copyofsnap1/test1/178/15' 2024-04-12T19:43:11.115 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/178/16' -> 'copyofsnap1/test1/178/16' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/178/17' -> 'copyofsnap1/test1/178/17' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/178/18' -> 'copyofsnap1/test1/178/18' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/178/19' -> 'copyofsnap1/test1/178/19' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/178/20' -> 'copyofsnap1/test1/178/20' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/179' -> 'copyofsnap1/test1/179' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/179/10' -> 'copyofsnap1/test1/179/10' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/179/11' -> 'copyofsnap1/test1/179/11' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/179/12' -> 'copyofsnap1/test1/179/12' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/179/13' -> 'copyofsnap1/test1/179/13' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/179/14' -> 'copyofsnap1/test1/179/14' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/179/15' -> 'copyofsnap1/test1/179/15' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/179/16' -> 'copyofsnap1/test1/179/16' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/179/17' -> 'copyofsnap1/test1/179/17' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/179/18' -> 'copyofsnap1/test1/179/18' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/179/19' -> 'copyofsnap1/test1/179/19' 2024-04-12T19:43:11.116 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/179/20' -> 'copyofsnap1/test1/179/20' 2024-04-12T19:43:11.117 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/180' -> 'copyofsnap1/test1/180' 2024-04-12T19:43:11.117 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/180/10' -> 'copyofsnap1/test1/180/10' 2024-04-12T19:43:11.117 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/180/11' -> 'copyofsnap1/test1/180/11' 2024-04-12T19:43:11.117 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/180/12' -> 'copyofsnap1/test1/180/12' 2024-04-12T19:43:11.117 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/180/13' -> 'copyofsnap1/test1/180/13' 2024-04-12T19:43:11.117 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/180/14' -> 'copyofsnap1/test1/180/14' 2024-04-12T19:43:11.117 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/180/15' -> 'copyofsnap1/test1/180/15' 2024-04-12T19:43:11.117 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/180/16' -> 'copyofsnap1/test1/180/16' 2024-04-12T19:43:11.117 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/180/17' -> 'copyofsnap1/test1/180/17' 2024-04-12T19:43:11.117 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/180/18' -> 'copyofsnap1/test1/180/18' 2024-04-12T19:43:11.117 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/180/19' -> 'copyofsnap1/test1/180/19' 2024-04-12T19:43:11.117 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/180/20' -> 'copyofsnap1/test1/180/20' 2024-04-12T19:43:13.746 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/181' -> 'copyofsnap1/test1/181' 2024-04-12T19:43:13.746 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/181/10' -> 'copyofsnap1/test1/181/10' 2024-04-12T19:43:13.746 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/181/11' -> 'copyofsnap1/test1/181/11' 2024-04-12T19:43:13.746 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/181/12' -> 'copyofsnap1/test1/181/12' 2024-04-12T19:43:13.746 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/181/13' -> 'copyofsnap1/test1/181/13' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/181/14' -> 'copyofsnap1/test1/181/14' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/181/15' -> 'copyofsnap1/test1/181/15' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/181/16' -> 'copyofsnap1/test1/181/16' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/181/17' -> 'copyofsnap1/test1/181/17' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/181/18' -> 'copyofsnap1/test1/181/18' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/181/19' -> 'copyofsnap1/test1/181/19' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/181/20' -> 'copyofsnap1/test1/181/20' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/182' -> 'copyofsnap1/test1/182' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/182/10' -> 'copyofsnap1/test1/182/10' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/182/11' -> 'copyofsnap1/test1/182/11' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/182/12' -> 'copyofsnap1/test1/182/12' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/182/13' -> 'copyofsnap1/test1/182/13' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/182/14' -> 'copyofsnap1/test1/182/14' 2024-04-12T19:43:13.747 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/182/15' -> 'copyofsnap1/test1/182/15' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/182/16' -> 'copyofsnap1/test1/182/16' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/182/17' -> 'copyofsnap1/test1/182/17' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/182/18' -> 'copyofsnap1/test1/182/18' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/182/19' -> 'copyofsnap1/test1/182/19' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/182/20' -> 'copyofsnap1/test1/182/20' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/183' -> 'copyofsnap1/test1/183' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/183/10' -> 'copyofsnap1/test1/183/10' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/183/11' -> 'copyofsnap1/test1/183/11' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/183/12' -> 'copyofsnap1/test1/183/12' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/183/13' -> 'copyofsnap1/test1/183/13' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/183/14' -> 'copyofsnap1/test1/183/14' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/183/15' -> 'copyofsnap1/test1/183/15' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/183/16' -> 'copyofsnap1/test1/183/16' 2024-04-12T19:43:13.748 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/183/17' -> 'copyofsnap1/test1/183/17' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/183/18' -> 'copyofsnap1/test1/183/18' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/183/19' -> 'copyofsnap1/test1/183/19' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/183/20' -> 'copyofsnap1/test1/183/20' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/184' -> 'copyofsnap1/test1/184' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/184/10' -> 'copyofsnap1/test1/184/10' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/184/11' -> 'copyofsnap1/test1/184/11' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/184/12' -> 'copyofsnap1/test1/184/12' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/184/13' -> 'copyofsnap1/test1/184/13' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/184/14' -> 'copyofsnap1/test1/184/14' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/184/15' -> 'copyofsnap1/test1/184/15' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/184/16' -> 'copyofsnap1/test1/184/16' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/184/17' -> 'copyofsnap1/test1/184/17' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/184/18' -> 'copyofsnap1/test1/184/18' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/184/19' -> 'copyofsnap1/test1/184/19' 2024-04-12T19:43:13.749 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/184/20' -> 'copyofsnap1/test1/184/20' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/185' -> 'copyofsnap1/test1/185' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/185/10' -> 'copyofsnap1/test1/185/10' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/185/11' -> 'copyofsnap1/test1/185/11' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/185/12' -> 'copyofsnap1/test1/185/12' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/185/13' -> 'copyofsnap1/test1/185/13' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/185/14' -> 'copyofsnap1/test1/185/14' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/185/15' -> 'copyofsnap1/test1/185/15' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/185/16' -> 'copyofsnap1/test1/185/16' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/185/17' -> 'copyofsnap1/test1/185/17' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/185/18' -> 'copyofsnap1/test1/185/18' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/185/19' -> 'copyofsnap1/test1/185/19' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/185/20' -> 'copyofsnap1/test1/185/20' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/186' -> 'copyofsnap1/test1/186' 2024-04-12T19:43:13.750 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/186/10' -> 'copyofsnap1/test1/186/10' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/186/11' -> 'copyofsnap1/test1/186/11' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/186/12' -> 'copyofsnap1/test1/186/12' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/186/13' -> 'copyofsnap1/test1/186/13' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/186/14' -> 'copyofsnap1/test1/186/14' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/186/15' -> 'copyofsnap1/test1/186/15' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/186/16' -> 'copyofsnap1/test1/186/16' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/186/17' -> 'copyofsnap1/test1/186/17' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/186/18' -> 'copyofsnap1/test1/186/18' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/186/19' -> 'copyofsnap1/test1/186/19' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/186/20' -> 'copyofsnap1/test1/186/20' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/187' -> 'copyofsnap1/test1/187' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/187/10' -> 'copyofsnap1/test1/187/10' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/187/11' -> 'copyofsnap1/test1/187/11' 2024-04-12T19:43:13.751 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/187/12' -> 'copyofsnap1/test1/187/12' 2024-04-12T19:43:13.752 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/187/13' -> 'copyofsnap1/test1/187/13' 2024-04-12T19:43:13.752 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/187/14' -> 'copyofsnap1/test1/187/14' 2024-04-12T19:43:13.752 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/187/15' -> 'copyofsnap1/test1/187/15' 2024-04-12T19:43:13.752 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/187/16' -> 'copyofsnap1/test1/187/16' 2024-04-12T19:43:13.752 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/187/17' -> 'copyofsnap1/test1/187/17' 2024-04-12T19:43:16.365 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/187/18' -> 'copyofsnap1/test1/187/18' 2024-04-12T19:43:16.365 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/187/19' -> 'copyofsnap1/test1/187/19' 2024-04-12T19:43:16.365 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/187/20' -> 'copyofsnap1/test1/187/20' 2024-04-12T19:43:16.365 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/188' -> 'copyofsnap1/test1/188' 2024-04-12T19:43:16.365 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/188/10' -> 'copyofsnap1/test1/188/10' 2024-04-12T19:43:16.365 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/188/11' -> 'copyofsnap1/test1/188/11' 2024-04-12T19:43:16.365 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/188/12' -> 'copyofsnap1/test1/188/12' 2024-04-12T19:43:16.365 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/188/13' -> 'copyofsnap1/test1/188/13' 2024-04-12T19:43:16.365 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/188/14' -> 'copyofsnap1/test1/188/14' 2024-04-12T19:43:16.365 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/188/15' -> 'copyofsnap1/test1/188/15' 2024-04-12T19:43:16.365 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/188/16' -> 'copyofsnap1/test1/188/16' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/188/17' -> 'copyofsnap1/test1/188/17' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/188/18' -> 'copyofsnap1/test1/188/18' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/188/19' -> 'copyofsnap1/test1/188/19' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/188/20' -> 'copyofsnap1/test1/188/20' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/189' -> 'copyofsnap1/test1/189' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/189/10' -> 'copyofsnap1/test1/189/10' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/189/11' -> 'copyofsnap1/test1/189/11' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/189/12' -> 'copyofsnap1/test1/189/12' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/189/13' -> 'copyofsnap1/test1/189/13' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/189/14' -> 'copyofsnap1/test1/189/14' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/189/15' -> 'copyofsnap1/test1/189/15' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/189/16' -> 'copyofsnap1/test1/189/16' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/189/17' -> 'copyofsnap1/test1/189/17' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/189/18' -> 'copyofsnap1/test1/189/18' 2024-04-12T19:43:16.366 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/189/19' -> 'copyofsnap1/test1/189/19' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/189/20' -> 'copyofsnap1/test1/189/20' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/190' -> 'copyofsnap1/test1/190' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/190/10' -> 'copyofsnap1/test1/190/10' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/190/11' -> 'copyofsnap1/test1/190/11' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/190/12' -> 'copyofsnap1/test1/190/12' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/190/13' -> 'copyofsnap1/test1/190/13' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/190/14' -> 'copyofsnap1/test1/190/14' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/190/15' -> 'copyofsnap1/test1/190/15' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/190/16' -> 'copyofsnap1/test1/190/16' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/190/17' -> 'copyofsnap1/test1/190/17' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/190/18' -> 'copyofsnap1/test1/190/18' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/190/19' -> 'copyofsnap1/test1/190/19' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/190/20' -> 'copyofsnap1/test1/190/20' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/191' -> 'copyofsnap1/test1/191' 2024-04-12T19:43:16.367 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/191/10' -> 'copyofsnap1/test1/191/10' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/191/11' -> 'copyofsnap1/test1/191/11' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/191/12' -> 'copyofsnap1/test1/191/12' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/191/13' -> 'copyofsnap1/test1/191/13' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/191/14' -> 'copyofsnap1/test1/191/14' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/191/15' -> 'copyofsnap1/test1/191/15' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/191/16' -> 'copyofsnap1/test1/191/16' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/191/17' -> 'copyofsnap1/test1/191/17' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/191/18' -> 'copyofsnap1/test1/191/18' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/191/19' -> 'copyofsnap1/test1/191/19' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/191/20' -> 'copyofsnap1/test1/191/20' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/192' -> 'copyofsnap1/test1/192' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/192/10' -> 'copyofsnap1/test1/192/10' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/192/11' -> 'copyofsnap1/test1/192/11' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/192/12' -> 'copyofsnap1/test1/192/12' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/192/13' -> 'copyofsnap1/test1/192/13' 2024-04-12T19:43:16.368 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/192/14' -> 'copyofsnap1/test1/192/14' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/192/15' -> 'copyofsnap1/test1/192/15' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/192/16' -> 'copyofsnap1/test1/192/16' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/192/17' -> 'copyofsnap1/test1/192/17' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/192/18' -> 'copyofsnap1/test1/192/18' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/192/19' -> 'copyofsnap1/test1/192/19' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/192/20' -> 'copyofsnap1/test1/192/20' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/193' -> 'copyofsnap1/test1/193' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/193/10' -> 'copyofsnap1/test1/193/10' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/193/11' -> 'copyofsnap1/test1/193/11' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/193/12' -> 'copyofsnap1/test1/193/12' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/193/13' -> 'copyofsnap1/test1/193/13' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/193/14' -> 'copyofsnap1/test1/193/14' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/193/15' -> 'copyofsnap1/test1/193/15' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/193/16' -> 'copyofsnap1/test1/193/16' 2024-04-12T19:43:16.369 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/193/17' -> 'copyofsnap1/test1/193/17' 2024-04-12T19:43:16.370 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/193/18' -> 'copyofsnap1/test1/193/18' 2024-04-12T19:43:16.370 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/193/19' -> 'copyofsnap1/test1/193/19' 2024-04-12T19:43:16.370 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/193/20' -> 'copyofsnap1/test1/193/20' 2024-04-12T19:43:16.370 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/194' -> 'copyofsnap1/test1/194' 2024-04-12T19:43:16.370 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/194/10' -> 'copyofsnap1/test1/194/10' 2024-04-12T19:43:16.370 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/194/11' -> 'copyofsnap1/test1/194/11' 2024-04-12T19:43:16.370 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/194/12' -> 'copyofsnap1/test1/194/12' 2024-04-12T19:43:16.370 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/194/13' -> 'copyofsnap1/test1/194/13' 2024-04-12T19:43:16.370 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/194/14' -> 'copyofsnap1/test1/194/14' 2024-04-12T19:43:18.490 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/194/15' -> 'copyofsnap1/test1/194/15' 2024-04-12T19:43:18.491 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/194/16' -> 'copyofsnap1/test1/194/16' 2024-04-12T19:43:18.491 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/194/17' -> 'copyofsnap1/test1/194/17' 2024-04-12T19:43:18.491 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/194/18' -> 'copyofsnap1/test1/194/18' 2024-04-12T19:43:18.491 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/194/19' -> 'copyofsnap1/test1/194/19' 2024-04-12T19:43:18.491 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/194/20' -> 'copyofsnap1/test1/194/20' 2024-04-12T19:43:18.491 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/195' -> 'copyofsnap1/test1/195' 2024-04-12T19:43:18.491 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/195/10' -> 'copyofsnap1/test1/195/10' 2024-04-12T19:43:18.491 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/195/11' -> 'copyofsnap1/test1/195/11' 2024-04-12T19:43:18.491 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/195/12' -> 'copyofsnap1/test1/195/12' 2024-04-12T19:43:18.491 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/195/13' -> 'copyofsnap1/test1/195/13' 2024-04-12T19:43:18.491 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/195/14' -> 'copyofsnap1/test1/195/14' 2024-04-12T19:43:18.491 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/195/15' -> 'copyofsnap1/test1/195/15' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/195/16' -> 'copyofsnap1/test1/195/16' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/195/17' -> 'copyofsnap1/test1/195/17' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/195/18' -> 'copyofsnap1/test1/195/18' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/195/19' -> 'copyofsnap1/test1/195/19' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/195/20' -> 'copyofsnap1/test1/195/20' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/196' -> 'copyofsnap1/test1/196' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/196/10' -> 'copyofsnap1/test1/196/10' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/196/11' -> 'copyofsnap1/test1/196/11' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/196/12' -> 'copyofsnap1/test1/196/12' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/196/13' -> 'copyofsnap1/test1/196/13' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/196/14' -> 'copyofsnap1/test1/196/14' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/196/15' -> 'copyofsnap1/test1/196/15' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/196/16' -> 'copyofsnap1/test1/196/16' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/196/17' -> 'copyofsnap1/test1/196/17' 2024-04-12T19:43:18.492 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/196/18' -> 'copyofsnap1/test1/196/18' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/196/19' -> 'copyofsnap1/test1/196/19' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/196/20' -> 'copyofsnap1/test1/196/20' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/197' -> 'copyofsnap1/test1/197' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/197/10' -> 'copyofsnap1/test1/197/10' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/197/11' -> 'copyofsnap1/test1/197/11' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/197/12' -> 'copyofsnap1/test1/197/12' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/197/13' -> 'copyofsnap1/test1/197/13' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/197/14' -> 'copyofsnap1/test1/197/14' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/197/15' -> 'copyofsnap1/test1/197/15' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/197/16' -> 'copyofsnap1/test1/197/16' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/197/17' -> 'copyofsnap1/test1/197/17' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/197/18' -> 'copyofsnap1/test1/197/18' 2024-04-12T19:43:18.493 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/197/19' -> 'copyofsnap1/test1/197/19' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/197/20' -> 'copyofsnap1/test1/197/20' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/198' -> 'copyofsnap1/test1/198' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/198/10' -> 'copyofsnap1/test1/198/10' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/198/11' -> 'copyofsnap1/test1/198/11' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/198/12' -> 'copyofsnap1/test1/198/12' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/198/13' -> 'copyofsnap1/test1/198/13' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/198/14' -> 'copyofsnap1/test1/198/14' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/198/15' -> 'copyofsnap1/test1/198/15' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/198/16' -> 'copyofsnap1/test1/198/16' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/198/17' -> 'copyofsnap1/test1/198/17' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/198/18' -> 'copyofsnap1/test1/198/18' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/198/19' -> 'copyofsnap1/test1/198/19' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/198/20' -> 'copyofsnap1/test1/198/20' 2024-04-12T19:43:18.494 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/199' -> 'copyofsnap1/test1/199' 2024-04-12T19:43:18.495 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/199/10' -> 'copyofsnap1/test1/199/10' 2024-04-12T19:43:18.495 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/199/11' -> 'copyofsnap1/test1/199/11' 2024-04-12T19:43:18.495 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/199/12' -> 'copyofsnap1/test1/199/12' 2024-04-12T19:43:18.495 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/199/13' -> 'copyofsnap1/test1/199/13' 2024-04-12T19:43:18.495 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/199/14' -> 'copyofsnap1/test1/199/14' 2024-04-12T19:43:18.495 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/199/15' -> 'copyofsnap1/test1/199/15' 2024-04-12T19:43:18.495 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/199/16' -> 'copyofsnap1/test1/199/16' 2024-04-12T19:43:18.495 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/199/17' -> 'copyofsnap1/test1/199/17' 2024-04-12T19:43:18.495 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/199/18' -> 'copyofsnap1/test1/199/18' 2024-04-12T19:43:18.495 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/199/19' -> 'copyofsnap1/test1/199/19' 2024-04-12T19:43:18.495 INFO:tasks.workunit.client.0.smithi131.stdout:'.snap/test1/199/20' -> 'copyofsnap1/test1/199/20' 2024-04-12T19:43:18.496 INFO:tasks.workunit.client.0.smithi131.stdout:Take third snapshot .snap/test3 2024-04-12T19:43:18.847 INFO:tasks.workunit.client.0.smithi131.stdout:Delete the snapshots... 2024-04-12T19:43:23.256 INFO:tasks.workunit.client.0.smithi131.stdout:.//.snap/test1 2024-04-12T19:43:23.257 INFO:tasks.workunit.client.0.smithi131.stdout:.//.snap/test2 2024-04-12T19:43:23.257 INFO:tasks.workunit.client.0.smithi131.stdout:.//.snap/test3 2024-04-12T19:43:23.298 INFO:tasks.workunit.client.0.smithi131.stdout:./274/.snap/snap-subdir-test 2024-04-12T19:43:23.345 INFO:tasks.workunit.client.0.smithi131.stdout:./166/.snap/snap-subdir-test 2024-04-12T19:43:23.390 INFO:tasks.workunit.client.0.smithi131.stdout:./256/.snap/snap-subdir-test 2024-04-12T19:43:23.432 INFO:tasks.workunit.client.0.smithi131.stdout:./247/.snap/snap-subdir-test 2024-04-12T19:43:23.474 INFO:tasks.workunit.client.0.smithi131.stdout:./248/.snap/snap-subdir-test 2024-04-12T19:43:23.522 INFO:tasks.workunit.client.0.smithi131.stdout:./147/.snap/snap-subdir-test 2024-04-12T19:43:23.568 INFO:tasks.workunit.client.0.smithi131.stdout:./151/.snap/snap-subdir-test 2024-04-12T19:43:23.609 INFO:tasks.workunit.client.0.smithi131.stdout:./170/.snap/snap-subdir-test 2024-04-12T19:43:23.653 INFO:tasks.workunit.client.0.smithi131.stdout:./167/.snap/snap-subdir-test 2024-04-12T19:43:23.722 INFO:tasks.workunit.client.0.smithi131.stdout:./140/.snap/snap-subdir-test 2024-04-12T19:43:23.765 INFO:tasks.workunit.client.0.smithi131.stdout:./142/.snap/snap-subdir-test 2024-04-12T19:43:23.809 INFO:tasks.workunit.client.0.smithi131.stdout:./150/.snap/snap-subdir-test 2024-04-12T19:43:23.850 INFO:tasks.workunit.client.0.smithi131.stdout:./273/.snap/snap-subdir-test 2024-04-12T19:43:23.892 INFO:tasks.workunit.client.0.smithi131.stdout:./269/.snap/snap-subdir-test 2024-04-12T19:43:23.934 INFO:tasks.workunit.client.0.smithi131.stdout:./105/.snap/snap-subdir-test 2024-04-12T19:43:23.972 INFO:tasks.workunit.client.0.smithi131.stdout:./210/.snap/snap-subdir-test 2024-04-12T19:43:24.012 INFO:tasks.workunit.client.0.smithi131.stdout:./265/.snap/snap-subdir-test 2024-04-12T19:43:24.054 INFO:tasks.workunit.client.0.smithi131.stdout:./218/.snap/snap-subdir-test 2024-04-12T19:43:24.094 INFO:tasks.workunit.client.0.smithi131.stdout:./290/.snap/snap-subdir-test 2024-04-12T19:43:24.139 INFO:tasks.workunit.client.0.smithi131.stdout:./149/.snap/snap-subdir-test 2024-04-12T19:43:24.182 INFO:tasks.workunit.client.0.smithi131.stdout:./109/.snap/snap-subdir-test 2024-04-12T19:43:24.222 INFO:tasks.workunit.client.0.smithi131.stdout:./292/.snap/snap-subdir-test 2024-04-12T19:43:24.265 INFO:tasks.workunit.client.0.smithi131.stdout:./242/.snap/snap-subdir-test 2024-04-12T19:43:24.314 INFO:tasks.workunit.client.0.smithi131.stdout:./158/.snap/snap-subdir-test 2024-04-12T19:43:24.365 INFO:tasks.workunit.client.0.smithi131.stdout:./243/.snap/snap-subdir-test 2024-04-12T19:43:24.411 INFO:tasks.workunit.client.0.smithi131.stdout:./106/.snap/snap-subdir-test 2024-04-12T19:43:24.449 INFO:tasks.workunit.client.0.smithi131.stdout:./250/.snap/snap-subdir-test 2024-04-12T19:43:24.489 INFO:tasks.workunit.client.0.smithi131.stdout:./221/.snap/snap-subdir-test 2024-04-12T19:43:24.531 INFO:tasks.workunit.client.0.smithi131.stdout:./244/.snap/snap-subdir-test 2024-04-12T19:43:24.573 INFO:tasks.workunit.client.0.smithi131.stdout:./258/.snap/snap-subdir-test 2024-04-12T19:43:24.613 INFO:tasks.workunit.client.0.smithi131.stdout:./268/.snap/snap-subdir-test 2024-04-12T19:43:24.656 INFO:tasks.workunit.client.0.smithi131.stdout:./189/.snap/snap-subdir-test 2024-04-12T19:43:24.697 INFO:tasks.workunit.client.0.smithi131.stdout:./285/.snap/snap-subdir-test 2024-04-12T19:43:24.743 INFO:tasks.workunit.client.0.smithi131.stdout:./208/.snap/snap-subdir-test 2024-04-12T19:43:24.785 INFO:tasks.workunit.client.0.smithi131.stdout:./288/.snap/snap-subdir-test 2024-04-12T19:43:24.825 INFO:tasks.workunit.client.0.smithi131.stdout:./209/.snap/snap-subdir-test 2024-04-12T19:43:24.868 INFO:tasks.workunit.client.0.smithi131.stdout:./253/.snap/snap-subdir-test 2024-04-12T19:43:24.913 INFO:tasks.workunit.client.0.smithi131.stdout:./249/.snap/snap-subdir-test 2024-04-12T19:43:24.961 INFO:tasks.workunit.client.0.smithi131.stdout:./133/.snap/snap-subdir-test 2024-04-12T19:43:25.002 INFO:tasks.workunit.client.0.smithi131.stdout:./291/.snap/snap-subdir-test 2024-04-12T19:43:25.043 INFO:tasks.workunit.client.0.smithi131.stdout:./226/.snap/snap-subdir-test 2024-04-12T19:43:25.088 INFO:tasks.workunit.client.0.smithi131.stdout:./173/.snap/snap-subdir-test 2024-04-12T19:43:25.136 INFO:tasks.workunit.client.0.smithi131.stdout:./174/.snap/snap-subdir-test 2024-04-12T19:43:25.183 INFO:tasks.workunit.client.0.smithi131.stdout:./299/.snap/snap-subdir-test 2024-04-12T19:43:25.230 INFO:tasks.workunit.client.0.smithi131.stdout:./262/.snap/snap-subdir-test 2024-04-12T19:43:25.278 INFO:tasks.workunit.client.0.smithi131.stdout:./231/.snap/snap-subdir-test 2024-04-12T19:43:25.320 INFO:tasks.workunit.client.0.smithi131.stdout:./214/.snap/snap-subdir-test 2024-04-12T19:43:25.363 INFO:tasks.workunit.client.0.smithi131.stdout:./281/.snap/snap-subdir-test 2024-04-12T19:43:25.406 INFO:tasks.workunit.client.0.smithi131.stdout:./289/.snap/snap-subdir-test 2024-04-12T19:43:25.449 INFO:tasks.workunit.client.0.smithi131.stdout:./283/.snap/snap-subdir-test 2024-04-12T19:43:25.490 INFO:tasks.workunit.client.0.smithi131.stdout:./232/.snap/snap-subdir-test 2024-04-12T19:43:25.533 INFO:tasks.workunit.client.0.smithi131.stdout:./298/.snap/snap-subdir-test 2024-04-12T19:43:25.576 INFO:tasks.workunit.client.0.smithi131.stdout:./233/.snap/snap-subdir-test 2024-04-12T19:43:25.627 INFO:tasks.workunit.client.0.smithi131.stdout:./155/.snap/snap-subdir-test 2024-04-12T19:43:25.674 INFO:tasks.workunit.client.0.smithi131.stdout:./114/.snap/snap-subdir-test 2024-04-12T19:43:25.722 INFO:tasks.workunit.client.0.smithi131.stdout:./159/.snap/snap-subdir-test 2024-04-12T19:43:25.768 INFO:tasks.workunit.client.0.smithi131.stdout:./187/.snap/snap-subdir-test 2024-04-12T19:43:25.819 INFO:tasks.workunit.client.0.smithi131.stdout:./185/.snap/snap-subdir-test 2024-04-12T19:43:25.863 INFO:tasks.workunit.client.0.smithi131.stdout:./293/.snap/snap-subdir-test 2024-04-12T19:43:25.906 INFO:tasks.workunit.client.0.smithi131.stdout:./228/.snap/snap-subdir-test 2024-04-12T19:43:25.953 INFO:tasks.workunit.client.0.smithi131.stdout:./120/.snap/snap-subdir-test 2024-04-12T19:43:25.996 INFO:tasks.workunit.client.0.smithi131.stdout:./110/.snap/snap-subdir-test 2024-04-12T19:43:26.039 INFO:tasks.workunit.client.0.smithi131.stdout:./267/.snap/snap-subdir-test 2024-04-12T19:43:26.081 INFO:tasks.workunit.client.0.smithi131.stdout:./202/.snap/snap-subdir-test 2024-04-12T19:43:26.126 INFO:tasks.workunit.client.0.smithi131.stdout:./137/.snap/snap-subdir-test 2024-04-12T19:43:26.167 INFO:tasks.workunit.client.0.smithi131.stdout:./246/.snap/snap-subdir-test 2024-04-12T19:43:26.211 INFO:tasks.workunit.client.0.smithi131.stdout:./219/.snap/snap-subdir-test 2024-04-12T19:43:26.256 INFO:tasks.workunit.client.0.smithi131.stdout:./198/.snap/snap-subdir-test 2024-04-12T19:43:26.302 INFO:tasks.workunit.client.0.smithi131.stdout:./136/.snap/snap-subdir-test 2024-04-12T19:43:26.344 INFO:tasks.workunit.client.0.smithi131.stdout:./270/.snap/snap-subdir-test 2024-04-12T19:43:26.387 INFO:tasks.workunit.client.0.smithi131.stdout:./125/.snap/snap-subdir-test 2024-04-12T19:43:26.434 INFO:tasks.workunit.client.0.smithi131.stdout:./194/.snap/snap-subdir-test 2024-04-12T19:43:26.475 INFO:tasks.workunit.client.0.smithi131.stdout:./119/.snap/snap-subdir-test 2024-04-12T19:43:26.519 INFO:tasks.workunit.client.0.smithi131.stdout:./297/.snap/snap-subdir-test 2024-04-12T19:43:26.561 INFO:tasks.workunit.client.0.smithi131.stdout:./230/.snap/snap-subdir-test 2024-04-12T19:43:26.605 INFO:tasks.workunit.client.0.smithi131.stdout:./260/.snap/snap-subdir-test 2024-04-12T19:43:26.647 INFO:tasks.workunit.client.0.smithi131.stdout:./157/.snap/snap-subdir-test 2024-04-12T19:43:26.693 INFO:tasks.workunit.client.0.smithi131.stdout:./172/.snap/snap-subdir-test 2024-04-12T19:43:26.736 INFO:tasks.workunit.client.0.smithi131.stdout:./277/.snap/snap-subdir-test 2024-04-12T19:43:26.782 INFO:tasks.workunit.client.0.smithi131.stdout:./186/.snap/snap-subdir-test 2024-04-12T19:43:26.824 INFO:tasks.workunit.client.0.smithi131.stdout:./237/.snap/snap-subdir-test 2024-04-12T19:43:26.869 INFO:tasks.workunit.client.0.smithi131.stdout:./190/.snap/snap-subdir-test 2024-04-12T19:43:26.911 INFO:tasks.workunit.client.0.smithi131.stdout:./213/.snap/snap-subdir-test 2024-04-12T19:43:26.954 INFO:tasks.workunit.client.0.smithi131.stdout:./104/.snap/snap-subdir-test 2024-04-12T19:43:27.000 INFO:tasks.workunit.client.0.smithi131.stdout:./164/.snap/snap-subdir-test 2024-04-12T19:43:27.045 INFO:tasks.workunit.client.0.smithi131.stdout:./112/.snap/snap-subdir-test 2024-04-12T19:43:27.087 INFO:tasks.workunit.client.0.smithi131.stdout:./295/.snap/snap-subdir-test 2024-04-12T19:43:27.130 INFO:tasks.workunit.client.0.smithi131.stdout:./272/.snap/snap-subdir-test 2024-04-12T19:43:27.175 INFO:tasks.workunit.client.0.smithi131.stdout:./100/.snap/snap-subdir-test 2024-04-12T19:43:27.220 INFO:tasks.workunit.client.0.smithi131.stdout:./134/.snap/snap-subdir-test 2024-04-12T19:43:27.262 INFO:tasks.workunit.client.0.smithi131.stdout:./200/.snap/snap-subdir-test 2024-04-12T19:43:27.309 INFO:tasks.workunit.client.0.smithi131.stdout:./115/.snap/snap-subdir-test 2024-04-12T19:43:27.350 INFO:tasks.workunit.client.0.smithi131.stdout:./284/.snap/snap-subdir-test 2024-04-12T19:43:27.392 INFO:tasks.workunit.client.0.smithi131.stdout:./280/.snap/snap-subdir-test 2024-04-12T19:43:27.437 INFO:tasks.workunit.client.0.smithi131.stdout:./116/.snap/snap-subdir-test 2024-04-12T19:43:27.481 INFO:tasks.workunit.client.0.smithi131.stdout:./245/.snap/snap-subdir-test 2024-04-12T19:43:27.531 INFO:tasks.workunit.client.0.smithi131.stdout:./195/.snap/snap-subdir-test 2024-04-12T19:43:27.581 INFO:tasks.workunit.client.0.smithi131.stdout:./138/.snap/snap-subdir-test 2024-04-12T19:43:27.632 INFO:tasks.workunit.client.0.smithi131.stdout:./135/.snap/snap-subdir-test 2024-04-12T19:43:27.679 INFO:tasks.workunit.client.0.smithi131.stdout:./117/.snap/snap-subdir-test 2024-04-12T19:43:27.721 INFO:tasks.workunit.client.0.smithi131.stdout:./241/.snap/snap-subdir-test 2024-04-12T19:43:27.768 INFO:tasks.workunit.client.0.smithi131.stdout:./143/.snap/snap-subdir-test 2024-04-12T19:43:27.812 INFO:tasks.workunit.client.0.smithi131.stdout:./180/.snap/snap-subdir-test 2024-04-12T19:43:27.857 INFO:tasks.workunit.client.0.smithi131.stdout:./126/.snap/snap-subdir-test 2024-04-12T19:43:27.900 INFO:tasks.workunit.client.0.smithi131.stdout:./161/.snap/snap-subdir-test 2024-04-12T19:43:27.944 INFO:tasks.workunit.client.0.smithi131.stdout:./204/.snap/snap-subdir-test 2024-04-12T19:43:27.988 INFO:tasks.workunit.client.0.smithi131.stdout:./176/.snap/snap-subdir-test 2024-04-12T19:43:28.031 INFO:tasks.workunit.client.0.smithi131.stdout:./255/.snap/snap-subdir-test 2024-04-12T19:43:28.074 INFO:tasks.workunit.client.0.smithi131.stdout:./215/.snap/snap-subdir-test 2024-04-12T19:43:28.121 INFO:tasks.workunit.client.0.smithi131.stdout:./111/.snap/snap-subdir-test 2024-04-12T19:43:28.164 INFO:tasks.workunit.client.0.smithi131.stdout:./238/.snap/snap-subdir-test 2024-04-12T19:43:28.207 INFO:tasks.workunit.client.0.smithi131.stdout:./191/.snap/snap-subdir-test 2024-04-12T19:43:28.251 INFO:tasks.workunit.client.0.smithi131.stdout:./184/.snap/snap-subdir-test 2024-04-12T19:43:28.295 INFO:tasks.workunit.client.0.smithi131.stdout:./192/.snap/snap-subdir-test 2024-04-12T19:43:28.339 INFO:tasks.workunit.client.0.smithi131.stdout:./103/.snap/snap-subdir-test 2024-04-12T19:43:28.381 INFO:tasks.workunit.client.0.smithi131.stdout:./128/.snap/snap-subdir-test 2024-04-12T19:43:28.419 INFO:tasks.workunit.client.0.smithi131.stdout:./229/.snap/snap-subdir-test 2024-04-12T19:43:28.464 INFO:tasks.workunit.client.0.smithi131.stdout:./144/.snap/snap-subdir-test 2024-04-12T19:43:28.506 INFO:tasks.workunit.client.0.smithi131.stdout:./146/.snap/snap-subdir-test 2024-04-12T19:43:28.545 INFO:tasks.workunit.client.0.smithi131.stdout:./227/.snap/snap-subdir-test 2024-04-12T19:43:28.584 INFO:tasks.workunit.client.0.smithi131.stdout:./278/.snap/snap-subdir-test 2024-04-12T19:43:28.627 INFO:tasks.workunit.client.0.smithi131.stdout:./141/.snap/snap-subdir-test 2024-04-12T19:43:28.668 INFO:tasks.workunit.client.0.smithi131.stdout:./234/.snap/snap-subdir-test 2024-04-12T19:43:28.707 INFO:tasks.workunit.client.0.smithi131.stdout:./225/.snap/snap-subdir-test 2024-04-12T19:43:28.751 INFO:tasks.workunit.client.0.smithi131.stdout:./182/.snap/snap-subdir-test 2024-04-12T19:43:28.794 INFO:tasks.workunit.client.0.smithi131.stdout:./107/.snap/snap-subdir-test 2024-04-12T19:43:28.838 INFO:tasks.workunit.client.0.smithi131.stdout:./178/.snap/snap-subdir-test 2024-04-12T19:43:28.885 INFO:tasks.workunit.client.0.smithi131.stdout:./266/.snap/snap-subdir-test 2024-04-12T19:43:28.928 INFO:tasks.workunit.client.0.smithi131.stdout:./240/.snap/snap-subdir-test 2024-04-12T19:43:28.977 INFO:tasks.workunit.client.0.smithi131.stdout:./156/.snap/snap-subdir-test 2024-04-12T19:43:29.024 INFO:tasks.workunit.client.0.smithi131.stdout:./131/.snap/snap-subdir-test 2024-04-12T19:43:29.068 INFO:tasks.workunit.client.0.smithi131.stdout:./123/.snap/snap-subdir-test 2024-04-12T19:43:29.117 INFO:tasks.workunit.client.0.smithi131.stdout:./160/.snap/snap-subdir-test 2024-04-12T19:43:29.168 INFO:tasks.workunit.client.0.smithi131.stdout:./165/.snap/snap-subdir-test 2024-04-12T19:43:29.214 INFO:tasks.workunit.client.0.smithi131.stdout:./101/.snap/snap-subdir-test 2024-04-12T19:43:29.260 INFO:tasks.workunit.client.0.smithi131.stdout:./148/.snap/snap-subdir-test 2024-04-12T19:43:29.305 INFO:tasks.workunit.client.0.smithi131.stdout:./168/.snap/snap-subdir-test 2024-04-12T19:43:29.349 INFO:tasks.workunit.client.0.smithi131.stdout:./179/.snap/snap-subdir-test 2024-04-12T19:43:29.389 INFO:tasks.workunit.client.0.smithi131.stdout:./257/.snap/snap-subdir-test 2024-04-12T19:43:29.429 INFO:tasks.workunit.client.0.smithi131.stdout:./252/.snap/snap-subdir-test 2024-04-12T19:43:29.472 INFO:tasks.workunit.client.0.smithi131.stdout:./132/.snap/snap-subdir-test 2024-04-12T19:43:29.513 INFO:tasks.workunit.client.0.smithi131.stdout:./236/.snap/snap-subdir-test 2024-04-12T19:43:29.554 INFO:tasks.workunit.client.0.smithi131.stdout:./211/.snap/snap-subdir-test 2024-04-12T19:43:29.599 INFO:tasks.workunit.client.0.smithi131.stdout:./199/.snap/snap-subdir-test 2024-04-12T19:43:29.641 INFO:tasks.workunit.client.0.smithi131.stdout:./205/.snap/snap-subdir-test 2024-04-12T19:43:29.684 INFO:tasks.workunit.client.0.smithi131.stdout:./163/.snap/snap-subdir-test 2024-04-12T19:43:29.726 INFO:tasks.workunit.client.0.smithi131.stdout:./261/.snap/snap-subdir-test 2024-04-12T19:43:29.769 INFO:tasks.workunit.client.0.smithi131.stdout:./201/.snap/snap-subdir-test 2024-04-12T19:43:29.809 INFO:tasks.workunit.client.0.smithi131.stdout:./282/.snap/snap-subdir-test 2024-04-12T19:43:29.849 INFO:tasks.workunit.client.0.smithi131.stdout:./296/.snap/snap-subdir-test 2024-04-12T19:43:29.891 INFO:tasks.workunit.client.0.smithi131.stdout:./217/.snap/snap-subdir-test 2024-04-12T19:43:29.936 INFO:tasks.workunit.client.0.smithi131.stdout:./153/.snap/snap-subdir-test 2024-04-12T19:43:29.978 INFO:tasks.workunit.client.0.smithi131.stdout:./206/.snap/snap-subdir-test 2024-04-12T19:43:30.025 INFO:tasks.workunit.client.0.smithi131.stdout:./122/.snap/snap-subdir-test 2024-04-12T19:43:30.076 INFO:tasks.workunit.client.0.smithi131.stdout:./162/.snap/snap-subdir-test 2024-04-12T19:43:30.126 INFO:tasks.workunit.client.0.smithi131.stdout:./197/.snap/snap-subdir-test 2024-04-12T19:43:30.175 INFO:tasks.workunit.client.0.smithi131.stdout:./216/.snap/snap-subdir-test 2024-04-12T19:43:33.526 INFO:tasks.workunit.client.0.smithi131.stdout:./254/.snap/snap-subdir-test 2024-04-12T19:43:33.570 INFO:tasks.workunit.client.0.smithi131.stdout:./113/.snap/snap-subdir-test 2024-04-12T19:43:33.611 INFO:tasks.workunit.client.0.smithi131.stdout:./152/.snap/snap-subdir-test 2024-04-12T19:43:33.653 INFO:tasks.workunit.client.0.smithi131.stdout:./121/.snap/snap-subdir-test 2024-04-12T19:43:33.695 INFO:tasks.workunit.client.0.smithi131.stdout:./118/.snap/snap-subdir-test 2024-04-12T19:43:33.738 INFO:tasks.workunit.client.0.smithi131.stdout:./196/.snap/snap-subdir-test 2024-04-12T19:43:33.780 INFO:tasks.workunit.client.0.smithi131.stdout:./124/.snap/snap-subdir-test 2024-04-12T19:43:33.820 INFO:tasks.workunit.client.0.smithi131.stdout:./239/.snap/snap-subdir-test 2024-04-12T19:43:33.862 INFO:tasks.workunit.client.0.smithi131.stdout:./188/.snap/snap-subdir-test 2024-04-12T19:43:33.903 INFO:tasks.workunit.client.0.smithi131.stdout:./287/.snap/snap-subdir-test 2024-04-12T19:43:33.943 INFO:tasks.workunit.client.0.smithi131.stdout:./275/.snap/snap-subdir-test 2024-04-12T19:43:33.984 INFO:tasks.workunit.client.0.smithi131.stdout:./259/.snap/snap-subdir-test 2024-04-12T19:43:34.026 INFO:tasks.workunit.client.0.smithi131.stdout:./224/.snap/snap-subdir-test 2024-04-12T19:43:34.068 INFO:tasks.workunit.client.0.smithi131.stdout:./264/.snap/snap-subdir-test 2024-04-12T19:43:34.110 INFO:tasks.workunit.client.0.smithi131.stdout:./145/.snap/snap-subdir-test 2024-04-12T19:43:34.152 INFO:tasks.workunit.client.0.smithi131.stdout:./279/.snap/snap-subdir-test 2024-04-12T19:43:34.195 INFO:tasks.workunit.client.0.smithi131.stdout:./263/.snap/snap-subdir-test 2024-04-12T19:43:34.241 INFO:tasks.workunit.client.0.smithi131.stdout:./130/.snap/snap-subdir-test 2024-04-12T19:43:34.283 INFO:tasks.workunit.client.0.smithi131.stdout:./193/.snap/snap-subdir-test 2024-04-12T19:43:34.325 INFO:tasks.workunit.client.0.smithi131.stdout:./223/.snap/snap-subdir-test 2024-04-12T19:43:34.363 INFO:tasks.workunit.client.0.smithi131.stdout:./207/.snap/snap-subdir-test 2024-04-12T19:43:34.400 INFO:tasks.workunit.client.0.smithi131.stdout:./276/.snap/snap-subdir-test 2024-04-12T19:43:34.438 INFO:tasks.workunit.client.0.smithi131.stdout:./271/.snap/snap-subdir-test 2024-04-12T19:43:34.480 INFO:tasks.workunit.client.0.smithi131.stdout:./251/.snap/snap-subdir-test 2024-04-12T19:43:34.523 INFO:tasks.workunit.client.0.smithi131.stdout:./175/.snap/snap-subdir-test 2024-04-12T19:43:34.564 INFO:tasks.workunit.client.0.smithi131.stdout:./222/.snap/snap-subdir-test 2024-04-12T19:43:34.603 INFO:tasks.workunit.client.0.smithi131.stdout:./220/.snap/snap-subdir-test 2024-04-12T19:43:34.646 INFO:tasks.workunit.client.0.smithi131.stdout:./203/.snap/snap-subdir-test 2024-04-12T19:43:34.689 INFO:tasks.workunit.client.0.smithi131.stdout:./181/.snap/snap-subdir-test 2024-04-12T19:43:34.728 INFO:tasks.workunit.client.0.smithi131.stdout:./286/.snap/snap-subdir-test 2024-04-12T19:43:34.770 INFO:tasks.workunit.client.0.smithi131.stdout:./127/.snap/snap-subdir-test 2024-04-12T19:43:34.814 INFO:tasks.workunit.client.0.smithi131.stdout:./108/.snap/snap-subdir-test 2024-04-12T19:43:34.858 INFO:tasks.workunit.client.0.smithi131.stdout:./183/.snap/snap-subdir-test 2024-04-12T19:43:34.898 INFO:tasks.workunit.client.0.smithi131.stdout:./294/.snap/snap-subdir-test 2024-04-12T19:43:34.937 INFO:tasks.workunit.client.0.smithi131.stdout:./235/.snap/snap-subdir-test 2024-04-12T19:43:34.980 INFO:tasks.workunit.client.0.smithi131.stdout:./177/.snap/snap-subdir-test 2024-04-12T19:43:35.025 INFO:tasks.workunit.client.0.smithi131.stdout:./169/.snap/snap-subdir-test 2024-04-12T19:43:35.063 INFO:tasks.workunit.client.0.smithi131.stdout:./212/.snap/snap-subdir-test 2024-04-12T19:43:35.108 INFO:tasks.workunit.client.0.smithi131.stdout:./154/.snap/snap-subdir-test 2024-04-12T19:43:35.151 INFO:tasks.workunit.client.0.smithi131.stdout:./171/.snap/snap-subdir-test 2024-04-12T19:43:35.195 INFO:tasks.workunit.client.0.smithi131.stdout:./139/.snap/snap-subdir-test 2024-04-12T19:43:35.241 INFO:tasks.workunit.client.0.smithi131.stdout:./102/.snap/snap-subdir-test 2024-04-12T19:43:35.282 INFO:tasks.workunit.client.0.smithi131.stdout:./129/.snap/snap-subdir-test 2024-04-12T19:43:40.285 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:43:40.294 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:43:45.710 INFO:tasks.workunit.client.0.smithi131.stdout:Delete all the files and directories ... 2024-04-12T19:43:47.327 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/19' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/15' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/31' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/36' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/20' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/12' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/39' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/10' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/34' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/38' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/11' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/16' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/32' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/30' 2024-04-12T19:43:47.328 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/14' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/18' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/13' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/33' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/17' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/35' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed './100/37' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './100' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/19' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/15' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/31' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/36' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/20' 2024-04-12T19:43:47.329 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/12' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/39' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/10' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/34' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/38' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/11' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/16' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/32' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/30' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/14' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/18' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/13' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/33' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/17' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/35' 2024-04-12T19:43:47.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './101/37' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './101' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/19' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/15' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/31' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/36' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/20' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/12' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/39' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/10' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/34' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/38' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/11' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/16' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/32' 2024-04-12T19:43:47.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/30' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/14' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/18' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/13' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/33' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/17' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/35' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './102/37' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './102' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/19' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/15' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/31' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/36' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/20' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/12' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/39' 2024-04-12T19:43:47.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/10' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/34' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/38' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/11' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/16' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/32' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/30' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/14' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/18' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/13' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/33' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/17' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/35' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './103/37' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './103' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/19' 2024-04-12T19:43:47.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/15' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/31' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/36' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/20' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/12' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/39' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/10' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/34' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/38' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/11' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/16' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/32' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/30' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/14' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/18' 2024-04-12T19:43:47.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/13' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/33' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/17' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/35' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './104/37' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './104' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/19' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/15' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/31' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/36' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/20' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/12' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/39' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/10' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/34' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/38' 2024-04-12T19:43:47.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/11' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/16' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/32' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/30' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/14' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/18' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/13' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/33' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/17' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/35' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './105/37' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './105' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/19' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/15' 2024-04-12T19:43:47.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/31' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/36' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/20' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/12' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/39' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/10' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/34' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/38' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/11' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/16' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/32' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/30' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/14' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/18' 2024-04-12T19:43:47.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/13' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/33' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/17' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/35' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './106/37' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './106' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/19' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/15' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/31' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/36' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/20' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/12' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/39' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/10' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/34' 2024-04-12T19:43:47.338 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/38' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/11' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/16' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/32' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/30' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/14' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/18' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/13' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/33' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/17' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/35' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './107/37' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './107' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/19' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/15' 2024-04-12T19:43:47.339 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/31' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/36' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/20' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/12' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/39' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/10' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/34' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/38' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/11' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/16' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/32' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/30' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/14' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/18' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/13' 2024-04-12T19:43:47.340 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/33' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/17' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/35' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './108/37' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './108' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/19' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/15' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/31' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/36' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/20' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/12' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/39' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/10' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/34' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/38' 2024-04-12T19:43:47.341 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/11' 2024-04-12T19:43:47.342 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/16' 2024-04-12T19:43:47.342 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/32' 2024-04-12T19:43:47.342 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/30' 2024-04-12T19:43:48.896 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/14' 2024-04-12T19:43:48.896 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/18' 2024-04-12T19:43:48.896 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/13' 2024-04-12T19:43:48.896 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/33' 2024-04-12T19:43:48.896 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/17' 2024-04-12T19:43:48.896 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/35' 2024-04-12T19:43:48.896 INFO:tasks.workunit.client.0.smithi131.stdout:removed './109/37' 2024-04-12T19:43:48.896 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './109' 2024-04-12T19:43:48.896 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/19' 2024-04-12T19:43:48.896 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/15' 2024-04-12T19:43:48.896 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/31' 2024-04-12T19:43:48.896 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/36' 2024-04-12T19:43:48.897 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/20' 2024-04-12T19:43:48.897 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/12' 2024-04-12T19:43:48.897 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/39' 2024-04-12T19:43:48.897 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/10' 2024-04-12T19:43:48.897 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/34' 2024-04-12T19:43:48.897 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/38' 2024-04-12T19:43:48.897 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/11' 2024-04-12T19:43:48.897 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/16' 2024-04-12T19:43:48.897 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/32' 2024-04-12T19:43:48.897 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/30' 2024-04-12T19:43:48.897 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/14' 2024-04-12T19:43:48.897 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/18' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/13' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/33' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/17' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/35' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed './110/37' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './110' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/19' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/15' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/31' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/36' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/20' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/12' 2024-04-12T19:43:48.898 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/39' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/10' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/34' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/38' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/11' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/16' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/32' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/30' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/14' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/18' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/13' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/33' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/17' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/35' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed './111/37' 2024-04-12T19:43:48.899 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './111' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/19' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/15' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/31' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/36' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/20' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/12' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/39' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/10' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/34' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/38' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/11' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/16' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/32' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/30' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/14' 2024-04-12T19:43:48.900 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/18' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/13' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/33' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/17' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/35' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './112/37' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './112' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/19' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/15' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/31' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/36' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/20' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/12' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/39' 2024-04-12T19:43:48.901 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/10' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/34' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/38' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/11' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/16' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/32' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/30' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/14' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/18' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/13' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/33' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/17' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/35' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './113/37' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './113' 2024-04-12T19:43:48.902 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/19' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/15' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/31' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/36' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/20' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/12' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/39' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/10' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/34' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/38' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/11' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/16' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/32' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/30' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/14' 2024-04-12T19:43:48.903 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/18' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/13' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/33' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/17' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/35' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './114/37' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './114' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/19' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/15' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/31' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/36' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/20' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/12' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/39' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/10' 2024-04-12T19:43:48.904 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/34' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/38' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/11' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/16' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/32' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/30' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/14' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/18' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/13' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/33' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/17' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/35' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './115/37' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './115' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/19' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/15' 2024-04-12T19:43:48.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/31' 2024-04-12T19:43:48.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/36' 2024-04-12T19:43:48.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/20' 2024-04-12T19:43:48.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/12' 2024-04-12T19:43:48.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/39' 2024-04-12T19:43:48.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/10' 2024-04-12T19:43:48.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/34' 2024-04-12T19:43:48.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/38' 2024-04-12T19:43:48.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/11' 2024-04-12T19:43:48.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/16' 2024-04-12T19:43:48.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/32' 2024-04-12T19:43:48.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/30' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/14' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/18' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/13' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/33' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/17' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/35' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './116/37' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './116' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/19' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/15' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/31' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/36' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/20' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/12' 2024-04-12T19:43:48.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/39' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/10' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/34' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/38' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/11' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/16' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/32' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/30' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/14' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/18' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/13' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/33' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/17' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/35' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './117/37' 2024-04-12T19:43:48.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './117' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/19' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/15' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/31' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/36' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/20' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/12' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/39' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/10' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/34' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/38' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/11' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/16' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/32' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/30' 2024-04-12T19:43:48.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/14' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/18' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/13' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/33' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/17' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/35' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './118/37' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './118' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/19' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/15' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/31' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/36' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/20' 2024-04-12T19:43:48.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/12' 2024-04-12T19:43:50.287 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/39' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/10' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/34' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/38' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/11' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/16' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/32' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/30' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/14' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/18' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/13' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/33' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/17' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/35' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './119/37' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './119' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/19' 2024-04-12T19:43:50.288 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/15' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/31' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/36' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/20' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/12' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/39' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/10' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/34' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/38' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/11' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/16' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/32' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/30' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/14' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/18' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/13' 2024-04-12T19:43:50.289 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/33' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/17' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/35' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './120/37' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './120' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/19' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/15' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/31' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/36' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/20' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/12' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/39' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/10' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/34' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/38' 2024-04-12T19:43:50.290 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/11' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/16' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/32' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/30' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/14' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/18' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/13' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/33' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/17' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/35' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './121/37' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './121' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/19' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/15' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/31' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/36' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/20' 2024-04-12T19:43:50.291 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/12' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/39' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/10' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/34' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/38' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/11' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/16' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/32' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/30' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/14' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/18' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/13' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/33' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/17' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/35' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed './122/37' 2024-04-12T19:43:50.292 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './122' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/19' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/15' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/31' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/36' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/20' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/12' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/39' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/10' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/34' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/38' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/11' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/16' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/32' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/30' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/14' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/18' 2024-04-12T19:43:50.293 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/13' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/33' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/17' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/35' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './123/37' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './123' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/19' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/15' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/31' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/36' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/20' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/12' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/39' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/10' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/34' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/38' 2024-04-12T19:43:50.294 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/11' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/16' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/32' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/30' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/14' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/18' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/13' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/33' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/17' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/35' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './124/37' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './124' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/19' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/15' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/31' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/36' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/20' 2024-04-12T19:43:50.295 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/12' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/39' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/10' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/34' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/38' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/11' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/16' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/32' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/30' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/14' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/18' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/13' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/33' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/17' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/35' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed './125/37' 2024-04-12T19:43:50.296 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './125' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/19' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/15' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/31' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/36' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/20' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/12' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/39' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/10' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/34' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/38' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/11' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/16' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/32' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/30' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/14' 2024-04-12T19:43:50.297 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/18' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/13' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/33' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/17' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/35' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './126/37' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './126' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/19' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/15' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/31' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/36' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/20' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/12' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/39' 2024-04-12T19:43:50.298 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/10' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/34' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/38' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/11' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/16' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/32' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/30' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/14' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/18' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/13' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/33' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/17' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/35' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './127/37' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './127' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/19' 2024-04-12T19:43:50.299 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/15' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/31' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/36' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/20' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/12' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/39' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/10' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/34' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/38' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/11' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/16' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/32' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/30' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/14' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/18' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/13' 2024-04-12T19:43:50.300 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/33' 2024-04-12T19:43:50.301 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/17' 2024-04-12T19:43:50.301 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/35' 2024-04-12T19:43:51.931 INFO:tasks.workunit.client.0.smithi131.stdout:removed './128/37' 2024-04-12T19:43:51.931 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './128' 2024-04-12T19:43:51.931 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/19' 2024-04-12T19:43:51.931 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/15' 2024-04-12T19:43:51.931 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/31' 2024-04-12T19:43:51.931 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/36' 2024-04-12T19:43:51.931 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/20' 2024-04-12T19:43:51.931 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/12' 2024-04-12T19:43:51.931 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/39' 2024-04-12T19:43:51.931 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/10' 2024-04-12T19:43:51.931 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/34' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/38' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/11' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/16' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/32' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/30' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/14' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/18' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/13' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/33' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/17' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/35' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './129/37' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './129' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/19' 2024-04-12T19:43:51.932 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/15' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/31' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/36' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/20' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/12' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/39' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/10' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/34' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/38' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/11' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/16' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/32' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/30' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/14' 2024-04-12T19:43:51.933 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/18' 2024-04-12T19:43:51.934 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/13' 2024-04-12T19:43:51.934 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/33' 2024-04-12T19:43:51.934 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/17' 2024-04-12T19:43:51.934 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/35' 2024-04-12T19:43:51.934 INFO:tasks.workunit.client.0.smithi131.stdout:removed './130/37' 2024-04-12T19:43:51.935 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './130' 2024-04-12T19:43:51.935 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/19' 2024-04-12T19:43:51.935 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/15' 2024-04-12T19:43:51.935 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/31' 2024-04-12T19:43:51.935 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/36' 2024-04-12T19:43:51.935 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/20' 2024-04-12T19:43:51.935 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/12' 2024-04-12T19:43:51.935 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/39' 2024-04-12T19:43:51.935 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/10' 2024-04-12T19:43:51.935 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/34' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/38' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/11' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/16' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/32' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/30' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/14' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/18' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/13' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/33' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/17' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/35' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './131/37' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './131' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/19' 2024-04-12T19:43:51.936 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/15' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/31' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/36' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/20' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/12' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/39' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/10' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/34' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/38' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/11' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/16' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/32' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/30' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/14' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/18' 2024-04-12T19:43:51.937 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/13' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/33' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/17' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/35' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './132/37' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './132' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/19' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/15' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/31' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/36' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/20' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/12' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/39' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/10' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/34' 2024-04-12T19:43:51.938 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/38' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/11' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/16' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/32' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/30' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/14' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/18' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/13' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/33' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/17' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/35' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './133/37' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './133' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/19' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/15' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/31' 2024-04-12T19:43:51.939 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/36' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/20' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/12' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/39' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/10' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/34' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/38' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/11' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/16' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/32' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/30' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/14' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/18' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/13' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/33' 2024-04-12T19:43:51.940 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/17' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/35' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './134/37' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './134' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/19' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/15' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/31' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/36' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/20' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/12' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/39' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/10' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/34' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/38' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/11' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/16' 2024-04-12T19:43:51.941 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/32' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/30' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/14' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/18' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/13' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/33' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/17' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/35' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './135/37' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './135' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/19' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/15' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/31' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/36' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/20' 2024-04-12T19:43:51.942 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/12' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/39' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/10' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/34' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/38' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/11' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/16' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/32' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/30' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/14' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/18' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/13' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/33' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/17' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/35' 2024-04-12T19:43:51.943 INFO:tasks.workunit.client.0.smithi131.stdout:removed './136/37' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './136' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/19' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/15' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/31' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/36' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/20' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/12' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/39' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/10' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/34' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/38' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/11' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/16' 2024-04-12T19:43:51.944 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/32' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/30' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/14' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/18' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/13' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/33' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/17' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/35' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './137/37' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './137' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/19' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/15' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/31' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/36' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/20' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/12' 2024-04-12T19:43:51.945 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/39' 2024-04-12T19:43:51.946 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/10' 2024-04-12T19:43:51.946 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/34' 2024-04-12T19:43:51.946 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/38' 2024-04-12T19:43:51.946 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/11' 2024-04-12T19:43:51.946 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/16' 2024-04-12T19:43:53.445 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/32' 2024-04-12T19:43:53.445 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/30' 2024-04-12T19:43:53.445 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/14' 2024-04-12T19:43:53.445 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/18' 2024-04-12T19:43:53.445 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/13' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/33' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/17' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/35' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './138/37' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './138' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/19' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/15' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/31' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/36' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/20' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/12' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/39' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/10' 2024-04-12T19:43:53.446 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/34' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/38' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/11' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/16' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/32' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/30' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/14' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/18' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/13' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/33' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/17' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/35' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './139/37' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './139' 2024-04-12T19:43:53.447 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/19' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/15' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/31' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/36' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/20' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/12' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/39' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/10' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/34' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/38' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/11' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/16' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/32' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/30' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/14' 2024-04-12T19:43:53.448 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/18' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/13' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/33' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/17' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/35' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './140/37' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './140' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/19' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/15' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/31' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/36' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/20' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/12' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/39' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/10' 2024-04-12T19:43:53.449 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/34' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/38' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/11' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/16' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/32' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/30' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/14' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/18' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/13' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/33' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/17' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/35' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './141/37' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './141' 2024-04-12T19:43:53.450 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/19' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/15' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/31' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/36' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/20' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/12' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/39' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/10' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/34' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/38' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/11' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/16' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/32' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/30' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/14' 2024-04-12T19:43:53.451 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/18' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/13' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/33' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/17' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/35' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './142/37' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './142' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/19' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/15' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/31' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/36' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/20' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/12' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/39' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/10' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/34' 2024-04-12T19:43:53.452 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/38' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/11' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/16' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/32' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/30' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/14' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/18' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/13' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/33' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/17' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/35' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './143/37' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './143' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/19' 2024-04-12T19:43:53.453 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/15' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/31' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/36' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/20' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/12' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/39' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/10' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/34' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/38' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/11' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/16' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/32' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/30' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/14' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/18' 2024-04-12T19:43:53.454 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/13' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/33' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/17' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/35' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './144/37' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './144' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/19' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/15' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/31' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/36' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/20' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/12' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/39' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/10' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/34' 2024-04-12T19:43:53.455 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/38' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/11' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/16' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/32' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/30' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/14' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/18' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/13' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/33' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/17' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/35' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './145/37' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './145' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/19' 2024-04-12T19:43:53.456 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/15' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/31' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/36' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/20' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/12' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/39' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/10' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/34' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/38' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/11' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/16' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/32' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/30' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/14' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/18' 2024-04-12T19:43:53.457 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/13' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/33' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/17' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/35' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './146/37' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './146' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/19' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/15' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/31' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/36' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/20' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/12' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/39' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/10' 2024-04-12T19:43:53.458 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/34' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/38' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/11' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/16' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/32' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/30' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/14' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/18' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/13' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/33' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/17' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/35' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './147/37' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './147' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/19' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/15' 2024-04-12T19:43:53.459 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/31' 2024-04-12T19:43:53.460 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/36' 2024-04-12T19:43:54.948 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/20' 2024-04-12T19:43:54.948 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/12' 2024-04-12T19:43:54.948 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/39' 2024-04-12T19:43:54.948 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/10' 2024-04-12T19:43:54.948 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/34' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/38' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/11' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/16' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/32' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/30' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/14' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/18' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/13' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/33' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/17' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/35' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './148/37' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './148' 2024-04-12T19:43:54.949 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/19' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/15' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/31' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/36' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/20' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/12' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/39' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/10' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/34' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/38' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/11' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/16' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/32' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/30' 2024-04-12T19:43:54.950 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/14' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/18' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/13' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/33' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/17' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/35' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './149/37' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './149' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/19' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/15' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/31' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/36' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/20' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/12' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/39' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/10' 2024-04-12T19:43:54.951 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/34' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/38' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/11' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/16' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/32' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/30' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/14' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/18' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/13' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/33' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/17' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/35' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './150/37' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './150' 2024-04-12T19:43:54.952 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/19' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/15' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/31' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/36' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/20' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/12' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/39' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/10' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/34' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/38' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/11' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/16' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/32' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/30' 2024-04-12T19:43:54.953 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/14' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/18' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/13' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/33' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/17' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/35' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed './151/37' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './151' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/19' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/15' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/31' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/36' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/20' 2024-04-12T19:43:54.954 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/12' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/39' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/10' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/34' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/38' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/11' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/16' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/32' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/30' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/14' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/18' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/13' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/33' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/17' 2024-04-12T19:43:54.955 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/35' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './152/37' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './152' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/19' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/15' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/31' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/36' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/20' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/12' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/39' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/10' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/34' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/38' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/11' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/16' 2024-04-12T19:43:54.956 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/32' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/30' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/14' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/18' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/13' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/33' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/17' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/35' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './153/37' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './153' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/19' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/15' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/31' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/36' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/20' 2024-04-12T19:43:54.957 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/12' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/39' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/10' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/34' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/38' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/11' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/16' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/32' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/30' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/14' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/18' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/13' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/33' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/17' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/35' 2024-04-12T19:43:54.958 INFO:tasks.workunit.client.0.smithi131.stdout:removed './154/37' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './154' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/19' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/15' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/31' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/36' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/20' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/12' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/39' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/10' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/34' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/38' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/11' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/16' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/32' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/30' 2024-04-12T19:43:54.959 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/14' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/18' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/13' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/33' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/17' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/35' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './155/37' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './155' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/19' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/15' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/31' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/36' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/20' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/12' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/39' 2024-04-12T19:43:54.960 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/10' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/34' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/38' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/11' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/16' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/32' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/30' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/14' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/18' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/13' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/33' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/17' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/35' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './156/37' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './156' 2024-04-12T19:43:54.961 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/19' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/15' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/31' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/36' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/20' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/12' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/39' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/10' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/34' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/38' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/11' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/16' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/32' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/30' 2024-04-12T19:43:54.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/14' 2024-04-12T19:43:54.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/18' 2024-04-12T19:43:54.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/13' 2024-04-12T19:43:54.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/33' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/17' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/35' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed './157/37' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './157' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/19' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/15' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/31' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/36' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/20' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/12' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/39' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/10' 2024-04-12T19:43:56.585 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/34' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/38' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/11' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/16' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/32' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/30' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/14' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/18' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/13' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/33' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/17' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/35' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './158/37' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './158' 2024-04-12T19:43:56.586 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/19' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/15' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/31' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/36' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/20' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/12' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/39' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/10' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/34' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/38' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/11' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/16' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/32' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/30' 2024-04-12T19:43:56.587 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/14' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/18' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/13' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/33' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/17' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/35' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './159/37' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './159' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/19' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/15' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/31' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/36' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/20' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/12' 2024-04-12T19:43:56.588 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/39' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/10' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/34' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/38' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/11' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/16' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/32' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/30' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/14' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/18' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/13' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/33' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/17' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/35' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './160/37' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './160' 2024-04-12T19:43:56.589 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/19' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/15' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/31' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/36' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/20' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/12' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/39' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/10' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/34' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/38' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/11' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/16' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/32' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/30' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/14' 2024-04-12T19:43:56.590 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/18' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/13' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/33' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/17' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/35' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed './161/37' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './161' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/19' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/15' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/31' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/36' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/20' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/12' 2024-04-12T19:43:56.591 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/39' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/10' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/34' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/38' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/11' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/16' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/32' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/30' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/14' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/18' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/13' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/33' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/17' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/35' 2024-04-12T19:43:56.592 INFO:tasks.workunit.client.0.smithi131.stdout:removed './162/37' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './162' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/19' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/15' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/31' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/36' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/20' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/12' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/39' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/10' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/34' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/38' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/11' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/16' 2024-04-12T19:43:56.593 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/32' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/30' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/14' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/18' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/13' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/33' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/17' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/35' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed './163/37' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './163' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/19' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/15' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/31' 2024-04-12T19:43:56.594 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/36' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/20' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/12' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/39' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/10' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/34' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/38' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/11' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/16' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/32' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/30' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/14' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/18' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/13' 2024-04-12T19:43:56.595 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/33' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/17' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/35' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './164/37' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './164' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/19' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/15' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/31' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/36' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/20' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/12' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/39' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/10' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/34' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/38' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/11' 2024-04-12T19:43:56.596 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/16' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/32' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/30' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/14' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/18' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/13' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/33' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/17' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/35' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './165/37' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './165' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/19' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/15' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/31' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/36' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/20' 2024-04-12T19:43:56.597 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/12' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/39' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/10' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/34' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/38' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/11' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/16' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/32' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/30' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/14' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/18' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/13' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/33' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/17' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/35' 2024-04-12T19:43:56.598 INFO:tasks.workunit.client.0.smithi131.stdout:removed './166/37' 2024-04-12T19:43:56.599 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './166' 2024-04-12T19:43:56.599 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/19' 2024-04-12T19:43:56.599 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/15' 2024-04-12T19:43:56.599 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/31' 2024-04-12T19:43:56.599 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/36' 2024-04-12T19:43:56.599 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/20' 2024-04-12T19:43:56.599 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/12' 2024-04-12T19:43:56.599 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/39' 2024-04-12T19:43:56.599 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/10' 2024-04-12T19:43:56.599 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/34' 2024-04-12T19:43:56.599 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/38' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/11' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/16' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/32' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/30' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/14' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/18' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/13' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/33' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/17' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/35' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './167/37' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './167' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/19' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/15' 2024-04-12T19:43:58.245 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/31' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/36' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/20' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/12' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/39' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/10' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/34' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/38' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/11' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/16' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/32' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/30' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/14' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/18' 2024-04-12T19:43:58.246 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/13' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/33' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/17' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/35' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './168/37' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './168' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/19' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/15' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/31' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/36' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/20' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/12' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/39' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/10' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/34' 2024-04-12T19:43:58.247 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/38' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/11' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/16' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/32' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/30' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/14' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/18' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/13' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/33' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/17' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/35' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './169/37' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './169' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/19' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/15' 2024-04-12T19:43:58.248 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/31' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/36' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/20' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/12' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/39' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/10' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/34' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/38' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/11' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/16' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/32' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/30' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/14' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/18' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/13' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/33' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/17' 2024-04-12T19:43:58.249 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/35' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './170/37' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './170' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/19' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/15' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/31' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/36' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/20' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/12' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/39' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/10' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/34' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/38' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/11' 2024-04-12T19:43:58.250 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/16' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/32' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/30' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/14' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/18' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/13' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/33' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/17' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/35' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './171/37' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './171' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/19' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/15' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/31' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/36' 2024-04-12T19:43:58.251 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/20' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/12' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/39' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/10' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/34' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/38' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/11' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/16' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/32' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/30' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/14' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/18' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/13' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/33' 2024-04-12T19:43:58.252 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/17' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/35' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './172/37' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './172' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/19' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/15' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/31' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/36' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/20' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/12' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/39' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/10' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/34' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/38' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/11' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/16' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/32' 2024-04-12T19:43:58.253 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/30' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/14' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/18' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/13' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/33' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/17' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/35' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './173/37' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './173' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/19' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/15' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/31' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/36' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/20' 2024-04-12T19:43:58.254 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/12' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/39' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/10' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/34' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/38' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/11' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/16' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/32' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/30' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/14' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/18' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/13' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/33' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/17' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/35' 2024-04-12T19:43:58.255 INFO:tasks.workunit.client.0.smithi131.stdout:removed './174/37' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './174' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/19' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/15' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/31' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/36' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/20' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/12' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/39' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/10' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/34' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/38' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/11' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/16' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/32' 2024-04-12T19:43:58.256 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/30' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/14' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/18' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/13' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/33' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/17' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/35' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './175/37' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './175' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/19' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/15' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/31' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/36' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/20' 2024-04-12T19:43:58.257 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/12' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/39' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/10' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/34' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/38' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/11' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/16' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/32' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/30' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/14' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/18' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/13' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/33' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/17' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/35' 2024-04-12T19:43:58.258 INFO:tasks.workunit.client.0.smithi131.stdout:removed './176/37' 2024-04-12T19:43:58.259 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './176' 2024-04-12T19:43:58.259 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/19' 2024-04-12T19:43:58.259 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/15' 2024-04-12T19:43:59.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/31' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/36' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/20' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/12' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/39' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/10' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/34' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/38' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/11' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/16' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/32' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/30' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/14' 2024-04-12T19:43:59.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/18' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/13' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/33' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/17' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/35' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed './177/37' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './177' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/19' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/15' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/31' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/36' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/20' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/12' 2024-04-12T19:43:59.659 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/39' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/10' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/34' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/38' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/11' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/16' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/32' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/30' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/14' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/18' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/13' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/33' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/17' 2024-04-12T19:43:59.660 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/35' 2024-04-12T19:43:59.661 INFO:tasks.workunit.client.0.smithi131.stdout:removed './178/37' 2024-04-12T19:43:59.661 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './178' 2024-04-12T19:43:59.661 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/19' 2024-04-12T19:43:59.661 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/15' 2024-04-12T19:43:59.661 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/31' 2024-04-12T19:43:59.661 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/36' 2024-04-12T19:43:59.661 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/20' 2024-04-12T19:43:59.661 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/12' 2024-04-12T19:43:59.661 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/39' 2024-04-12T19:43:59.661 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/10' 2024-04-12T19:43:59.661 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/34' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/38' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/11' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/16' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/32' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/30' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/14' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/18' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/13' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/33' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/17' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/35' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './179/37' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './179' 2024-04-12T19:43:59.662 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/19' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/15' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/31' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/36' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/20' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/12' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/39' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/10' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/34' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/38' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/11' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/16' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/32' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/30' 2024-04-12T19:43:59.663 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/14' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/18' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/13' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/33' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/17' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/35' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './180/37' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './180' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/19' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/15' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/31' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/36' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/20' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/12' 2024-04-12T19:43:59.664 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/39' 2024-04-12T19:43:59.665 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/10' 2024-04-12T19:43:59.665 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/34' 2024-04-12T19:43:59.665 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/38' 2024-04-12T19:43:59.665 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/11' 2024-04-12T19:43:59.665 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/16' 2024-04-12T19:43:59.665 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/32' 2024-04-12T19:43:59.665 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/30' 2024-04-12T19:43:59.665 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/14' 2024-04-12T19:43:59.665 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/18' 2024-04-12T19:43:59.665 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/13' 2024-04-12T19:43:59.665 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/33' 2024-04-12T19:43:59.666 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/17' 2024-04-12T19:43:59.666 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/35' 2024-04-12T19:43:59.666 INFO:tasks.workunit.client.0.smithi131.stdout:removed './181/37' 2024-04-12T19:43:59.666 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './181' 2024-04-12T19:43:59.666 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/19' 2024-04-12T19:43:59.666 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/15' 2024-04-12T19:43:59.666 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/31' 2024-04-12T19:43:59.666 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/36' 2024-04-12T19:43:59.666 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/20' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/12' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/39' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/10' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/34' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/38' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/11' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/16' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/32' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/30' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/14' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/18' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/13' 2024-04-12T19:43:59.667 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/33' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/17' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/35' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './182/37' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './182' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/19' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/15' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/31' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/36' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/20' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/12' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/39' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/10' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/34' 2024-04-12T19:43:59.668 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/38' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/11' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/16' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/32' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/30' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/14' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/18' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/13' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/33' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/17' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/35' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed './183/37' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './183' 2024-04-12T19:43:59.669 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/19' 2024-04-12T19:43:59.670 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/15' 2024-04-12T19:43:59.670 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/31' 2024-04-12T19:43:59.670 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/36' 2024-04-12T19:43:59.670 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/20' 2024-04-12T19:43:59.670 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/12' 2024-04-12T19:43:59.670 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/39' 2024-04-12T19:43:59.670 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/10' 2024-04-12T19:43:59.670 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/34' 2024-04-12T19:43:59.670 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/38' 2024-04-12T19:43:59.670 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/11' 2024-04-12T19:43:59.670 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/16' 2024-04-12T19:43:59.670 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/32' 2024-04-12T19:43:59.671 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/30' 2024-04-12T19:43:59.671 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/14' 2024-04-12T19:43:59.671 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/18' 2024-04-12T19:43:59.671 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/13' 2024-04-12T19:43:59.671 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/33' 2024-04-12T19:43:59.671 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/17' 2024-04-12T19:43:59.672 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/35' 2024-04-12T19:43:59.672 INFO:tasks.workunit.client.0.smithi131.stdout:removed './184/37' 2024-04-12T19:43:59.672 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './184' 2024-04-12T19:43:59.672 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/19' 2024-04-12T19:43:59.672 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/15' 2024-04-12T19:43:59.672 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/31' 2024-04-12T19:43:59.673 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/36' 2024-04-12T19:43:59.673 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/20' 2024-04-12T19:43:59.673 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/12' 2024-04-12T19:43:59.673 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/39' 2024-04-12T19:43:59.673 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/10' 2024-04-12T19:43:59.673 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/34' 2024-04-12T19:43:59.674 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/38' 2024-04-12T19:43:59.674 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/11' 2024-04-12T19:43:59.674 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/16' 2024-04-12T19:43:59.674 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/32' 2024-04-12T19:43:59.674 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/30' 2024-04-12T19:43:59.675 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/14' 2024-04-12T19:43:59.675 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/18' 2024-04-12T19:43:59.675 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/13' 2024-04-12T19:43:59.675 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/33' 2024-04-12T19:43:59.675 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/17' 2024-04-12T19:43:59.675 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/35' 2024-04-12T19:43:59.675 INFO:tasks.workunit.client.0.smithi131.stdout:removed './185/37' 2024-04-12T19:43:59.676 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './185' 2024-04-12T19:43:59.676 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/19' 2024-04-12T19:43:59.676 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/15' 2024-04-12T19:43:59.676 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/31' 2024-04-12T19:43:59.676 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/36' 2024-04-12T19:43:59.676 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/20' 2024-04-12T19:43:59.677 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/12' 2024-04-12T19:43:59.677 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/39' 2024-04-12T19:43:59.677 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/10' 2024-04-12T19:43:59.677 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/34' 2024-04-12T19:43:59.677 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/38' 2024-04-12T19:43:59.677 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/11' 2024-04-12T19:43:59.678 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/16' 2024-04-12T19:43:59.678 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/32' 2024-04-12T19:43:59.678 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/30' 2024-04-12T19:43:59.678 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/14' 2024-04-12T19:43:59.678 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/18' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/13' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/33' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/17' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/35' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './186/37' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './186' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/19' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/15' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/31' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/36' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/20' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/12' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/39' 2024-04-12T19:44:01.360 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/10' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/34' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/38' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/11' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/16' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/32' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/30' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/14' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/18' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/13' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/33' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/17' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/35' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './187/37' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './187' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/19' 2024-04-12T19:44:01.361 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/15' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/31' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/36' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/20' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/12' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/39' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/10' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/34' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/38' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/11' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/16' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/32' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/30' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/14' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/18' 2024-04-12T19:44:01.362 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/13' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/33' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/17' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/35' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './188/37' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './188' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/19' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/15' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/31' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/36' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/20' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/12' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/39' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/10' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/34' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/38' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/11' 2024-04-12T19:44:01.363 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/16' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/32' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/30' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/14' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/18' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/13' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/33' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/17' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/35' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './189/37' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './189' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/19' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/15' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/31' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/36' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/20' 2024-04-12T19:44:01.364 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/12' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/39' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/10' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/34' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/38' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/11' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/16' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/32' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/30' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/14' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/18' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/13' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/33' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/17' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/35' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed './190/37' 2024-04-12T19:44:01.365 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './190' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/19' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/15' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/31' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/36' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/20' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/12' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/39' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/10' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/34' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/38' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/11' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/16' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/32' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/30' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/14' 2024-04-12T19:44:01.366 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/18' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/13' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/33' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/17' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/35' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './191/37' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './191' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/19' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/15' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/31' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/36' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/20' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/12' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/39' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/10' 2024-04-12T19:44:01.367 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/34' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/38' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/11' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/16' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/32' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/30' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/14' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/18' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/13' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/33' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/17' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/35' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './192/37' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './192' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/19' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/15' 2024-04-12T19:44:01.368 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/31' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/36' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/20' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/12' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/39' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/10' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/34' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/38' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/11' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/16' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/32' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/30' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/14' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/18' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/13' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/33' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/17' 2024-04-12T19:44:01.369 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/35' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './193/37' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './193' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/19' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/15' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/31' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/36' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/20' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/12' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/39' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/10' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/34' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/38' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/11' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/16' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/32' 2024-04-12T19:44:01.370 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/30' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/14' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/18' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/13' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/33' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/17' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/35' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './194/37' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './194' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/19' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/15' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/31' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/36' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/20' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/12' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/39' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/10' 2024-04-12T19:44:01.371 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/34' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/38' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/11' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/16' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/32' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/30' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/14' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/18' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/13' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/33' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/17' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/35' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './195/37' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './195' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/19' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/15' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/31' 2024-04-12T19:44:01.372 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/36' 2024-04-12T19:44:01.373 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/20' 2024-04-12T19:44:01.373 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/12' 2024-04-12T19:44:01.373 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/39' 2024-04-12T19:44:01.373 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/10' 2024-04-12T19:44:02.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/34' 2024-04-12T19:44:02.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/38' 2024-04-12T19:44:02.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/11' 2024-04-12T19:44:02.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/16' 2024-04-12T19:44:02.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/32' 2024-04-12T19:44:02.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/30' 2024-04-12T19:44:02.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/14' 2024-04-12T19:44:02.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/18' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/13' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/33' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/17' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/35' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './196/37' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './196' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/19' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/15' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/31' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/36' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/20' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/12' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/39' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/10' 2024-04-12T19:44:02.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/34' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/38' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/11' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/16' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/32' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/30' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/14' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/18' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/13' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/33' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/17' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/35' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './197/37' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './197' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/19' 2024-04-12T19:44:02.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/15' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/31' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/36' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/20' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/12' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/39' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/10' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/34' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/38' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/11' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/16' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/32' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/30' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/14' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/18' 2024-04-12T19:44:02.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/13' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/33' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/17' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/35' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './198/37' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './198' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/19' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/15' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/31' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/36' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/20' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/12' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/39' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/10' 2024-04-12T19:44:02.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/34' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/38' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/11' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/16' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/32' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/30' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/14' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/18' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/13' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/33' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/17' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/35' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './199/37' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './199' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/21' 2024-04-12T19:44:02.838 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/27' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/31' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/36' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/20' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/39' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/34' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/38' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/28' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/24' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/29' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/32' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/22' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/25' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/30' 2024-04-12T19:44:02.839 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/33' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/23' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/35' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/26' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './200/37' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './200' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/21' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/27' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/31' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/36' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/20' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/39' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/34' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/38' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/28' 2024-04-12T19:44:02.840 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/24' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/29' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/32' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/22' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/25' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/30' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/33' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/23' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/35' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/26' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './201/37' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './201' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/21' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/27' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/31' 2024-04-12T19:44:02.841 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/36' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/20' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/39' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/34' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/38' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/28' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/24' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/29' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/32' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/22' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/25' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/30' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/33' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/23' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/35' 2024-04-12T19:44:02.842 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/26' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './202/37' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './202' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/21' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/27' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/31' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/36' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/20' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/39' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/34' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/38' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/28' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/24' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/29' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/32' 2024-04-12T19:44:02.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/22' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/25' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/30' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/33' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/23' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/35' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/26' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './203/37' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './203' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/21' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/27' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/31' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/36' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/20' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/39' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/34' 2024-04-12T19:44:02.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/38' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/28' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/24' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/29' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/32' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/22' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/25' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/30' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/33' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/23' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/35' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/26' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './204/37' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './204' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/21' 2024-04-12T19:44:02.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/27' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/31' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/36' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/20' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/39' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/34' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/38' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/28' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/24' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/29' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/32' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/22' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/25' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/30' 2024-04-12T19:44:02.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/33' 2024-04-12T19:44:02.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/23' 2024-04-12T19:44:02.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/35' 2024-04-12T19:44:02.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/26' 2024-04-12T19:44:02.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './205/37' 2024-04-12T19:44:02.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './205' 2024-04-12T19:44:02.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/21' 2024-04-12T19:44:02.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/27' 2024-04-12T19:44:02.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/31' 2024-04-12T19:44:02.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/36' 2024-04-12T19:44:02.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/20' 2024-04-12T19:44:02.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/39' 2024-04-12T19:44:04.385 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/34' 2024-04-12T19:44:04.386 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/38' 2024-04-12T19:44:04.386 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/28' 2024-04-12T19:44:04.386 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/24' 2024-04-12T19:44:04.386 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/29' 2024-04-12T19:44:04.386 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/32' 2024-04-12T19:44:04.386 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/22' 2024-04-12T19:44:04.386 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/25' 2024-04-12T19:44:04.386 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/30' 2024-04-12T19:44:04.386 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/33' 2024-04-12T19:44:04.386 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/23' 2024-04-12T19:44:04.386 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/35' 2024-04-12T19:44:04.386 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/26' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './206/37' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './206' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/21' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/27' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/31' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/36' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/20' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/39' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/34' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/38' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/28' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/24' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/29' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/32' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/22' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/25' 2024-04-12T19:44:04.387 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/30' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/33' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/23' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/35' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/26' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './207/37' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './207' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/21' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/27' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/31' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/36' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/20' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/39' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/34' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/38' 2024-04-12T19:44:04.388 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/28' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/24' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/29' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/32' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/22' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/25' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/30' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/33' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/23' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/35' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/26' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './208/37' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './208' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/21' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/27' 2024-04-12T19:44:04.389 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/31' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/36' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/20' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/39' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/34' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/38' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/28' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/24' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/29' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/32' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/22' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/25' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/30' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/33' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/23' 2024-04-12T19:44:04.390 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/35' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/26' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './209/37' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './209' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/21' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/27' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/31' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/36' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/20' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/39' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/34' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/38' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/28' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/24' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/29' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/32' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/22' 2024-04-12T19:44:04.391 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/25' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/30' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/33' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/23' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/35' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/26' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './210/37' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './210' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/21' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/27' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/31' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/36' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/20' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/39' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/34' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/38' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/28' 2024-04-12T19:44:04.392 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/24' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/29' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/32' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/22' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/25' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/30' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/33' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/23' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/35' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/26' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './211/37' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './211' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/21' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/27' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/31' 2024-04-12T19:44:04.393 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/36' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/20' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/39' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/34' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/38' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/28' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/24' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/29' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/32' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/22' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/25' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/30' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/33' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/23' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/35' 2024-04-12T19:44:04.394 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/26' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './212/37' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './212' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/21' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/27' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/31' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/36' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/20' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/39' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/34' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/38' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/28' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/24' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/29' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/32' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/22' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/25' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/30' 2024-04-12T19:44:04.395 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/33' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/23' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/35' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/26' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './213/37' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './213' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/21' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/27' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/31' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/36' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/20' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/39' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/34' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/38' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/28' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/24' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/29' 2024-04-12T19:44:04.396 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/32' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/22' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/25' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/30' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/33' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/23' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/35' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/26' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './214/37' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './214' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/21' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/27' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/31' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/36' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/20' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/39' 2024-04-12T19:44:04.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/34' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/38' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/28' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/24' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/29' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/32' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/22' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/25' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/30' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/33' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/23' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/35' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/26' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './215/37' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './215' 2024-04-12T19:44:04.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/21' 2024-04-12T19:44:04.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/27' 2024-04-12T19:44:04.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/31' 2024-04-12T19:44:04.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/36' 2024-04-12T19:44:04.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/20' 2024-04-12T19:44:04.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/39' 2024-04-12T19:44:04.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/34' 2024-04-12T19:44:04.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/38' 2024-04-12T19:44:05.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/28' 2024-04-12T19:44:05.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/24' 2024-04-12T19:44:05.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/29' 2024-04-12T19:44:05.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/32' 2024-04-12T19:44:05.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/22' 2024-04-12T19:44:05.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/25' 2024-04-12T19:44:05.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/30' 2024-04-12T19:44:05.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/33' 2024-04-12T19:44:05.843 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/23' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/35' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/26' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './216/37' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './216' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/21' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/27' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/31' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/36' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/20' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/39' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/34' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/38' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/28' 2024-04-12T19:44:05.844 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/24' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/29' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/32' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/22' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/25' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/30' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/33' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/23' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/35' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/26' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './217/37' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './217' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/21' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/27' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/31' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/36' 2024-04-12T19:44:05.845 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/20' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/39' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/34' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/38' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/28' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/24' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/29' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/32' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/22' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/25' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/30' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/33' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/23' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/35' 2024-04-12T19:44:05.846 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/26' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './218/37' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './218' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/21' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/27' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/31' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/36' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/20' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/39' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/34' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/38' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/28' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/24' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/29' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/32' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/22' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/25' 2024-04-12T19:44:05.847 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/30' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/33' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/23' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/35' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/26' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './219/37' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './219' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/21' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/27' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/31' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/36' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/20' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/39' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/34' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/38' 2024-04-12T19:44:05.848 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/28' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/24' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/29' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/32' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/22' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/25' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/30' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/33' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/23' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/35' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/26' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './220/37' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './220' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/21' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/27' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/31' 2024-04-12T19:44:05.849 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/36' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/20' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/39' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/34' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/38' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/28' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/24' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/29' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/32' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/22' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/25' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/30' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/33' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/23' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/35' 2024-04-12T19:44:05.850 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/26' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './221/37' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './221' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/21' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/27' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/31' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/36' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/20' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/39' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/34' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/38' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/28' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/24' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/29' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/32' 2024-04-12T19:44:05.851 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/22' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/25' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/30' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/33' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/23' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/35' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/26' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './222/37' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './222' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/21' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/27' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/31' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/36' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/20' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/39' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/34' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/38' 2024-04-12T19:44:05.852 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/28' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/24' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/29' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/32' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/22' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/25' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/30' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/33' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/23' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/35' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/26' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './223/37' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './223' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/21' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/27' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/31' 2024-04-12T19:44:05.853 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/36' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/20' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/39' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/34' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/38' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/28' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/24' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/29' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/32' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/22' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/25' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/30' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/33' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/23' 2024-04-12T19:44:05.854 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/35' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/26' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './224/37' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './224' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/21' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/27' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/31' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/36' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/20' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/39' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/34' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/38' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/28' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/24' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/29' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/32' 2024-04-12T19:44:05.855 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/22' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/25' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/30' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/33' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/23' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/35' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/26' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './225/37' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './225' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/21' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/27' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/31' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/36' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/20' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/39' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/34' 2024-04-12T19:44:05.856 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/38' 2024-04-12T19:44:05.857 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/28' 2024-04-12T19:44:05.857 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/24' 2024-04-12T19:44:07.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/29' 2024-04-12T19:44:07.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/32' 2024-04-12T19:44:07.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/22' 2024-04-12T19:44:07.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/25' 2024-04-12T19:44:07.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/30' 2024-04-12T19:44:07.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/33' 2024-04-12T19:44:07.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/23' 2024-04-12T19:44:07.397 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/35' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/26' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './226/37' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './226' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/21' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/27' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/31' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/36' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/20' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/39' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/34' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/38' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/28' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/24' 2024-04-12T19:44:07.398 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/29' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/32' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/22' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/25' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/30' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/33' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/23' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/35' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/26' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './227/37' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './227' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/21' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/27' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/31' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/36' 2024-04-12T19:44:07.399 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/20' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/39' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/34' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/38' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/28' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/24' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/29' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/32' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/22' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/25' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/30' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/33' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/23' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/35' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/26' 2024-04-12T19:44:07.400 INFO:tasks.workunit.client.0.smithi131.stdout:removed './228/37' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './228' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/21' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/27' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/31' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/36' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/20' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/39' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/34' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/38' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/28' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/24' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/29' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/32' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/22' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/25' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/30' 2024-04-12T19:44:07.401 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/33' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/23' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/35' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/26' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './229/37' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './229' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/21' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/27' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/31' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/36' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/20' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/39' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/34' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/38' 2024-04-12T19:44:07.402 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/28' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/24' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/29' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/32' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/22' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/25' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/30' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/33' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/23' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/35' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/26' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './230/37' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './230' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/21' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/27' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/31' 2024-04-12T19:44:07.403 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/36' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/20' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/39' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/34' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/38' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/28' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/24' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/29' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/32' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/22' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/25' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/30' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/33' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/23' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/35' 2024-04-12T19:44:07.404 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/26' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './231/37' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './231' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/21' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/27' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/31' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/36' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/20' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/39' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/34' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/38' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/28' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/24' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/29' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/32' 2024-04-12T19:44:07.405 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/22' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/25' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/30' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/33' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/23' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/35' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/26' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './232/37' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './232' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/21' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/27' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/31' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/36' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/20' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/39' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/34' 2024-04-12T19:44:07.406 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/38' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/28' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/24' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/29' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/32' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/22' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/25' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/30' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/33' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/23' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/35' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/26' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './233/37' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './233' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/21' 2024-04-12T19:44:07.407 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/27' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/31' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/36' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/20' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/39' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/34' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/38' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/28' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/24' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/29' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/32' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/22' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/25' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/30' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/33' 2024-04-12T19:44:07.408 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/23' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/35' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/26' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './234/37' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './234' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/21' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/27' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/31' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/36' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/20' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/39' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/34' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/38' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/28' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/24' 2024-04-12T19:44:07.409 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/29' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/32' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/22' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/25' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/30' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/33' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/23' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/35' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/26' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './235/37' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './235' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/21' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/27' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/31' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/36' 2024-04-12T19:44:07.410 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/20' 2024-04-12T19:44:07.411 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/39' 2024-04-12T19:44:07.411 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/34' 2024-04-12T19:44:07.411 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/38' 2024-04-12T19:44:07.411 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/28' 2024-04-12T19:44:07.411 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/24' 2024-04-12T19:44:07.411 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/29' 2024-04-12T19:44:07.411 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/32' 2024-04-12T19:44:08.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/22' 2024-04-12T19:44:08.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/25' 2024-04-12T19:44:08.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/30' 2024-04-12T19:44:08.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/33' 2024-04-12T19:44:08.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/23' 2024-04-12T19:44:08.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/35' 2024-04-12T19:44:08.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/26' 2024-04-12T19:44:08.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './236/37' 2024-04-12T19:44:08.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './236' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/21' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/27' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/31' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/36' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/20' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/39' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/34' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/38' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/28' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/24' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/29' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/32' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/22' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/25' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/30' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/33' 2024-04-12T19:44:08.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/23' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/35' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/26' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './237/37' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './237' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/21' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/27' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/31' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/36' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/20' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/39' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/34' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/38' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/28' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/24' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/29' 2024-04-12T19:44:08.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/32' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/22' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/25' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/30' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/33' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/23' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/35' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/26' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './238/37' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './238' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/21' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/27' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/31' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/36' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/20' 2024-04-12T19:44:08.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/39' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/34' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/38' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/28' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/24' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/29' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/32' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/22' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/25' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/30' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/33' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/23' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/35' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/26' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './239/37' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './239' 2024-04-12T19:44:08.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/21' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/27' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/31' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/36' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/20' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/39' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/34' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/38' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/28' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/24' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/29' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/32' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/22' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/25' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/30' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/33' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/23' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/35' 2024-04-12T19:44:08.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/26' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './240/37' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './240' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/21' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/27' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/31' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/36' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/20' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/39' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/34' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/38' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/28' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/24' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/29' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/32' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/22' 2024-04-12T19:44:08.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/25' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/30' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/33' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/23' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/35' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/26' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './241/37' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './241' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/21' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/27' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/31' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/36' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/20' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/39' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/34' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/38' 2024-04-12T19:44:08.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/28' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/24' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/29' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/32' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/22' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/25' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/30' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/33' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/23' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/35' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/26' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './242/37' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './242' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/21' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/27' 2024-04-12T19:44:08.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/31' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/36' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/20' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/39' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/34' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/38' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/28' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/24' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/29' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/32' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/22' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/25' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/30' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/33' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/23' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/35' 2024-04-12T19:44:08.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/26' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './243/37' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './243' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/21' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/27' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/31' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/36' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/20' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/39' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/34' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/38' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/28' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/24' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/29' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/32' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/22' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/25' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/30' 2024-04-12T19:44:08.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/33' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/23' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/35' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/26' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './244/37' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './244' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/21' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/27' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/31' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/36' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/20' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/39' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/34' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/38' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/28' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/24' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/29' 2024-04-12T19:44:08.921 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/32' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/22' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/25' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/30' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/33' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/23' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/35' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/26' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './245/37' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './245' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/21' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/27' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/31' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/36' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/20' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/39' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/34' 2024-04-12T19:44:08.922 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/38' 2024-04-12T19:44:08.923 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/28' 2024-04-12T19:44:08.923 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/24' 2024-04-12T19:44:08.923 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/29' 2024-04-12T19:44:08.923 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/32' 2024-04-12T19:44:08.923 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/22' 2024-04-12T19:44:10.467 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/25' 2024-04-12T19:44:10.467 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/30' 2024-04-12T19:44:10.467 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/33' 2024-04-12T19:44:10.467 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/23' 2024-04-12T19:44:10.467 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/35' 2024-04-12T19:44:10.467 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/26' 2024-04-12T19:44:10.467 INFO:tasks.workunit.client.0.smithi131.stdout:removed './246/37' 2024-04-12T19:44:10.467 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './246' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/21' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/27' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/31' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/36' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/20' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/39' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/34' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/38' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/28' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/24' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/29' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/32' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/22' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/25' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/30' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/33' 2024-04-12T19:44:10.468 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/23' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/35' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/26' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './247/37' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './247' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/21' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/27' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/31' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/36' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/20' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/39' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/34' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/38' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/28' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/24' 2024-04-12T19:44:10.469 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/29' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/32' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/22' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/25' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/30' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/33' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/23' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/35' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/26' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './248/37' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './248' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/21' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/27' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/31' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/36' 2024-04-12T19:44:10.470 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/20' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/39' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/34' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/38' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/28' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/24' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/29' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/32' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/22' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/25' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/30' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/33' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/23' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/35' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/26' 2024-04-12T19:44:10.471 INFO:tasks.workunit.client.0.smithi131.stdout:removed './249/37' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './249' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/21' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/27' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/31' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/36' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/20' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/39' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/34' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/38' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/28' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/24' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/29' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/32' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/22' 2024-04-12T19:44:10.472 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/25' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/30' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/33' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/23' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/35' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/26' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './250/37' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './250' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/21' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/27' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/31' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/36' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/20' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/39' 2024-04-12T19:44:10.473 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/34' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/38' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/28' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/24' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/29' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/32' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/22' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/25' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/30' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/33' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/23' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/35' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/26' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './251/37' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './251' 2024-04-12T19:44:10.474 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/21' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/27' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/31' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/36' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/20' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/39' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/34' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/38' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/28' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/24' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/29' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/32' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/22' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/25' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/30' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/33' 2024-04-12T19:44:10.475 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/23' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/35' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/26' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './252/37' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './252' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/21' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/27' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/31' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/36' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/20' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/39' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/34' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/38' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/28' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/24' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/29' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/32' 2024-04-12T19:44:10.476 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/22' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/25' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/30' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/33' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/23' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/35' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/26' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './253/37' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './253' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/21' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/27' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/31' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/36' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/20' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/39' 2024-04-12T19:44:10.477 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/34' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/38' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/28' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/24' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/29' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/32' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/22' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/25' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/30' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/33' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/23' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/35' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/26' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './254/37' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './254' 2024-04-12T19:44:10.478 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/21' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/27' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/31' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/36' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/20' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/39' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/34' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/38' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/28' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/24' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/29' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/32' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/22' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/25' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/30' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/33' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/23' 2024-04-12T19:44:10.479 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/35' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/26' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './255/37' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './255' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/21' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/27' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/31' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/36' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/20' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/39' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/34' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/38' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/28' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/24' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/29' 2024-04-12T19:44:10.480 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/32' 2024-04-12T19:44:10.481 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/22' 2024-04-12T19:44:10.481 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/25' 2024-04-12T19:44:10.481 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/30' 2024-04-12T19:44:10.485 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:44:10.491 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:44:11.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/33' 2024-04-12T19:44:11.905 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/23' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/35' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/26' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './256/37' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './256' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/21' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/27' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/31' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/36' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/20' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/39' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/34' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/38' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/28' 2024-04-12T19:44:11.906 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/24' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/29' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/32' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/22' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/25' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/30' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/33' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/23' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/35' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/26' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './257/37' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './257' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/21' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/27' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/31' 2024-04-12T19:44:11.907 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/36' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/20' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/39' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/34' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/38' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/28' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/24' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/29' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/32' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/22' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/25' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/30' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/33' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/23' 2024-04-12T19:44:11.908 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/35' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/26' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './258/37' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './258' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/21' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/27' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/31' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/36' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/20' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/39' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/34' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/38' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/28' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/24' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/29' 2024-04-12T19:44:11.909 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/32' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/22' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/25' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/30' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/33' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/23' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/35' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/26' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './259/37' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './259' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/21' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/27' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/31' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/36' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/20' 2024-04-12T19:44:11.910 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/39' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/34' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/38' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/28' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/24' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/29' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/32' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/22' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/25' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/30' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/33' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/23' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/35' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/26' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './260/37' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './260' 2024-04-12T19:44:11.911 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/21' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/27' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/31' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/36' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/20' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/39' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/34' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/38' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/28' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/24' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/29' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/32' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/22' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/25' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/30' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/33' 2024-04-12T19:44:11.912 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/23' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/35' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/26' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './261/37' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './261' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/21' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/27' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/31' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/36' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/20' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/39' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/34' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/38' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/28' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/24' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/29' 2024-04-12T19:44:11.913 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/32' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/22' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/25' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/30' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/33' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/23' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/35' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/26' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './262/37' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './262' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/21' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/27' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/31' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/36' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/20' 2024-04-12T19:44:11.914 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/39' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/34' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/38' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/28' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/24' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/29' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/32' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/22' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/25' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/30' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/33' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/23' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/35' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/26' 2024-04-12T19:44:11.915 INFO:tasks.workunit.client.0.smithi131.stdout:removed './263/37' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './263' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/21' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/27' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/31' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/36' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/20' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/39' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/34' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/38' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/28' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/24' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/29' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/32' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/22' 2024-04-12T19:44:11.916 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/25' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/30' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/33' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/23' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/35' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/26' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './264/37' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './264' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/21' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/27' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/31' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/36' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/20' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/39' 2024-04-12T19:44:11.917 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/34' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/38' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/28' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/24' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/29' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/32' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/22' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/25' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/30' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/33' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/23' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/35' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/26' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed './265/37' 2024-04-12T19:44:11.918 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './265' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/21' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/27' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/31' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/36' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/20' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/39' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/34' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/38' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/28' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/24' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/29' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/32' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/22' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/25' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/30' 2024-04-12T19:44:11.919 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/33' 2024-04-12T19:44:11.920 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/23' 2024-04-12T19:44:13.508 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/35' 2024-04-12T19:44:13.508 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/26' 2024-04-12T19:44:13.508 INFO:tasks.workunit.client.0.smithi131.stdout:removed './266/37' 2024-04-12T19:44:13.508 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './266' 2024-04-12T19:44:13.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/21' 2024-04-12T19:44:13.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/27' 2024-04-12T19:44:13.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/31' 2024-04-12T19:44:13.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/36' 2024-04-12T19:44:13.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/20' 2024-04-12T19:44:13.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/39' 2024-04-12T19:44:13.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/34' 2024-04-12T19:44:13.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/38' 2024-04-12T19:44:13.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/28' 2024-04-12T19:44:13.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/24' 2024-04-12T19:44:13.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/29' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/32' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/22' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/25' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/30' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/33' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/23' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/35' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/26' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './267/37' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './267' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/21' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/27' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/31' 2024-04-12T19:44:13.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/36' 2024-04-12T19:44:13.511 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/20' 2024-04-12T19:44:13.511 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/39' 2024-04-12T19:44:13.511 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/34' 2024-04-12T19:44:13.511 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/38' 2024-04-12T19:44:13.511 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/28' 2024-04-12T19:44:13.511 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/24' 2024-04-12T19:44:13.511 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/29' 2024-04-12T19:44:13.511 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/32' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/22' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/25' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/30' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/33' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/23' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/35' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/26' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './268/37' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './268' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/21' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/27' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/31' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/36' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/20' 2024-04-12T19:44:13.512 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/39' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/34' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/38' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/28' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/24' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/29' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/32' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/22' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/25' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/30' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/33' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/23' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/35' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/26' 2024-04-12T19:44:13.513 INFO:tasks.workunit.client.0.smithi131.stdout:removed './269/37' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './269' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/21' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/27' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/31' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/36' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/20' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/39' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/34' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/38' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/28' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/24' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/29' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/32' 2024-04-12T19:44:13.514 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/22' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/25' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/30' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/33' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/23' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/35' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/26' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './270/37' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './270' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/21' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/27' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/31' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/36' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/20' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/39' 2024-04-12T19:44:13.515 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/34' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/38' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/28' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/24' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/29' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/32' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/22' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/25' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/30' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/33' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/23' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/35' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/26' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed './271/37' 2024-04-12T19:44:13.516 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './271' 2024-04-12T19:44:13.517 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/21' 2024-04-12T19:44:13.517 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/27' 2024-04-12T19:44:13.517 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/31' 2024-04-12T19:44:13.517 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/36' 2024-04-12T19:44:13.517 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/20' 2024-04-12T19:44:13.517 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/39' 2024-04-12T19:44:13.517 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/34' 2024-04-12T19:44:13.517 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/38' 2024-04-12T19:44:13.517 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/28' 2024-04-12T19:44:13.517 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/24' 2024-04-12T19:44:13.517 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/29' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/32' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/22' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/25' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/30' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/33' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/23' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/35' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/26' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './272/37' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './272' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/21' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/27' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/31' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/36' 2024-04-12T19:44:13.518 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/20' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/39' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/34' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/38' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/28' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/24' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/29' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/32' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/22' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/25' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/30' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/33' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/23' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/35' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/26' 2024-04-12T19:44:13.519 INFO:tasks.workunit.client.0.smithi131.stdout:removed './273/37' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './273' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/21' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/27' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/31' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/36' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/20' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/39' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/34' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/38' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/28' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/24' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/29' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/32' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/22' 2024-04-12T19:44:13.520 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/25' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/30' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/33' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/23' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/35' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/26' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './274/37' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './274' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/21' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/27' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/31' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/36' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/20' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/39' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/34' 2024-04-12T19:44:13.521 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/38' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/28' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/24' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/29' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/32' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/22' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/25' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/30' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/33' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/23' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/35' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/26' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './275/37' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './275' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/21' 2024-04-12T19:44:13.522 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/27' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/31' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/36' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/20' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/39' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/34' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/38' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/28' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/24' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/29' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/32' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/22' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/25' 2024-04-12T19:44:13.523 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/30' 2024-04-12T19:44:13.524 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/33' 2024-04-12T19:44:13.524 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/23' 2024-04-12T19:44:13.524 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/35' 2024-04-12T19:44:13.524 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/26' 2024-04-12T19:44:15.213 INFO:tasks.workunit.client.0.smithi131.stdout:removed './276/37' 2024-04-12T19:44:15.213 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './276' 2024-04-12T19:44:15.213 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/21' 2024-04-12T19:44:15.213 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/27' 2024-04-12T19:44:15.213 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/31' 2024-04-12T19:44:15.213 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/36' 2024-04-12T19:44:15.213 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/20' 2024-04-12T19:44:15.213 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/39' 2024-04-12T19:44:15.213 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/34' 2024-04-12T19:44:15.213 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/38' 2024-04-12T19:44:15.213 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/28' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/24' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/29' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/32' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/22' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/25' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/30' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/33' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/23' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/35' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/26' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './277/37' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './277' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/21' 2024-04-12T19:44:15.214 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/27' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/31' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/36' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/20' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/39' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/34' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/38' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/28' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/24' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/29' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/32' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/22' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/25' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/30' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/33' 2024-04-12T19:44:15.215 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/23' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/35' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/26' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './278/37' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './278' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/21' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/27' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/31' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/36' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/20' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/39' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/34' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/38' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/28' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/24' 2024-04-12T19:44:15.216 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/29' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/32' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/22' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/25' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/30' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/33' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/23' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/35' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/26' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './279/37' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './279' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/21' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/27' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/31' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/36' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/20' 2024-04-12T19:44:15.217 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/39' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/34' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/38' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/28' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/24' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/29' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/32' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/22' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/25' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/30' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/33' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/23' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/35' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/26' 2024-04-12T19:44:15.218 INFO:tasks.workunit.client.0.smithi131.stdout:removed './280/37' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './280' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/21' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/27' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/31' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/36' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/20' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/39' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/34' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/38' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/28' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/24' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/29' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/32' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/22' 2024-04-12T19:44:15.219 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/25' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/30' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/33' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/23' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/35' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/26' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './281/37' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './281' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/21' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/27' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/31' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/36' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/20' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/39' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/34' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/38' 2024-04-12T19:44:15.220 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/28' 2024-04-12T19:44:15.221 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/24' 2024-04-12T19:44:15.221 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/29' 2024-04-12T19:44:15.221 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/32' 2024-04-12T19:44:15.221 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/22' 2024-04-12T19:44:15.221 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/25' 2024-04-12T19:44:15.221 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/30' 2024-04-12T19:44:15.221 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/33' 2024-04-12T19:44:15.221 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/23' 2024-04-12T19:44:15.221 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/35' 2024-04-12T19:44:15.221 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/26' 2024-04-12T19:44:15.221 INFO:tasks.workunit.client.0.smithi131.stdout:removed './282/37' 2024-04-12T19:44:15.221 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './282' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/21' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/27' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/31' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/36' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/20' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/39' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/34' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/38' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/28' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/24' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/29' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/32' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/22' 2024-04-12T19:44:15.222 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/25' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/30' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/33' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/23' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/35' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/26' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './283/37' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './283' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/21' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/27' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/31' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/36' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/20' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/39' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/34' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/38' 2024-04-12T19:44:15.223 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/28' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/24' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/29' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/32' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/22' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/25' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/30' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/33' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/23' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/35' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/26' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './284/37' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './284' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/21' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/27' 2024-04-12T19:44:15.224 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/31' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/36' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/20' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/39' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/34' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/38' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/28' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/24' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/29' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/32' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/22' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/25' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/30' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/33' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/23' 2024-04-12T19:44:15.225 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/35' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/26' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './285/37' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './285' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/21' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/27' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/31' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/36' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/20' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/39' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/34' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/38' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/28' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/24' 2024-04-12T19:44:15.226 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/29' 2024-04-12T19:44:15.227 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/32' 2024-04-12T19:44:15.227 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/22' 2024-04-12T19:44:15.227 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/25' 2024-04-12T19:44:15.227 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/30' 2024-04-12T19:44:15.227 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/33' 2024-04-12T19:44:15.227 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/23' 2024-04-12T19:44:15.227 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/35' 2024-04-12T19:44:15.227 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/26' 2024-04-12T19:44:15.227 INFO:tasks.workunit.client.0.smithi131.stdout:removed './286/37' 2024-04-12T19:44:15.227 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './286' 2024-04-12T19:44:16.678 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/21' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/27' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/31' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/36' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/20' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/39' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/34' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/38' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/28' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/24' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/29' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/32' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/22' 2024-04-12T19:44:16.679 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/25' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/30' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/33' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/23' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/35' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/26' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './287/37' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './287' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/21' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/27' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/31' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/36' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/20' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/39' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/34' 2024-04-12T19:44:16.680 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/38' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/28' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/24' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/29' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/32' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/22' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/25' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/30' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/33' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/23' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/35' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/26' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './288/37' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './288' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/21' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/27' 2024-04-12T19:44:16.681 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/31' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/36' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/20' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/39' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/34' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/38' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/28' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/24' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/29' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/32' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/22' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/25' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/30' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/33' 2024-04-12T19:44:16.682 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/23' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/35' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/26' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './289/37' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './289' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/21' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/27' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/31' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/36' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/20' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/39' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/34' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/38' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/28' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/24' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/29' 2024-04-12T19:44:16.683 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/32' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/22' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/25' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/30' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/33' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/23' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/35' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/26' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './290/37' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './290' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/21' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/27' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/31' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/36' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/20' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/39' 2024-04-12T19:44:16.684 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/34' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/38' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/28' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/24' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/29' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/32' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/22' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/25' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/30' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/33' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/23' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/35' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/26' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './291/37' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './291' 2024-04-12T19:44:16.685 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/21' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/27' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/31' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/36' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/20' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/39' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/34' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/38' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/28' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/24' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/29' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/32' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/22' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/25' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/30' 2024-04-12T19:44:16.686 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/33' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/23' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/35' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/26' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './292/37' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './292' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/21' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/27' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/31' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/36' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/20' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/39' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/34' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/38' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/28' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/24' 2024-04-12T19:44:16.687 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/29' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/32' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/22' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/25' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/30' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/33' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/23' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/35' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/26' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './293/37' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './293' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/21' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/27' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/31' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/36' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/20' 2024-04-12T19:44:16.688 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/39' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/34' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/38' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/28' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/24' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/29' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/32' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/22' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/25' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/30' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/33' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/23' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/35' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/26' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './294/37' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './294' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/21' 2024-04-12T19:44:16.689 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/27' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/31' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/36' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/20' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/39' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/34' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/38' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/28' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/24' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/29' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/32' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/22' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/25' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/30' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/33' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/23' 2024-04-12T19:44:16.690 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/35' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/26' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './295/37' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './295' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/21' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/27' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/31' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/36' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/20' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/39' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/34' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/38' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/28' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/24' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/29' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/32' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/22' 2024-04-12T19:44:16.691 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/25' 2024-04-12T19:44:16.692 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/30' 2024-04-12T19:44:16.692 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/33' 2024-04-12T19:44:16.692 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/23' 2024-04-12T19:44:16.692 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/35' 2024-04-12T19:44:16.692 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/26' 2024-04-12T19:44:16.692 INFO:tasks.workunit.client.0.smithi131.stdout:removed './296/37' 2024-04-12T19:44:16.692 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './296' 2024-04-12T19:44:16.692 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/21' 2024-04-12T19:44:16.692 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/27' 2024-04-12T19:44:18.102 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/31' 2024-04-12T19:44:18.102 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/36' 2024-04-12T19:44:18.102 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/20' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/39' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/34' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/38' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/28' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/24' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/29' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/32' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/22' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/25' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/30' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/33' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/23' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/35' 2024-04-12T19:44:18.103 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/26' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './297/37' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './297' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/21' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/27' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/31' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/36' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/20' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/39' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/34' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/38' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/28' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/24' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/29' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/32' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/22' 2024-04-12T19:44:18.104 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/25' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/30' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/33' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/23' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/35' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/26' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './298/37' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './298' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/21' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/27' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/31' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/36' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/20' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/39' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/34' 2024-04-12T19:44:18.105 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/38' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/28' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/24' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/29' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/32' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/22' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/25' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/30' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/33' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/23' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/35' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/26' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './299/37' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './299' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/166/19' 2024-04-12T19:44:18.106 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/166/15' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/166/20' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/166/12' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/166/10' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/166/11' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/166/16' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/166/14' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/166/18' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/166/13' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/166/17' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/166' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/147/19' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/147/15' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/147/20' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/147/12' 2024-04-12T19:44:18.107 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/147/10' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/147/11' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/147/16' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/147/14' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/147/18' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/147/13' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/147/17' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/147' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/151/19' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/151/15' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/151/20' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/151/12' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/151/10' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/151/11' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/151/16' 2024-04-12T19:44:18.108 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/151/14' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/151/18' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/151/13' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/151/17' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/151' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/170/19' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/170/15' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/170/20' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/170/12' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/170/10' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/170/11' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/170/16' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/170/14' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/170/18' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/170/13' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/170/17' 2024-04-12T19:44:18.109 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/170' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/167/19' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/167/15' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/167/20' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/167/12' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/167/10' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/167/11' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/167/16' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/167/14' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/167/18' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/167/13' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/167/17' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/167' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/140/19' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/140/15' 2024-04-12T19:44:18.110 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/140/20' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/140/12' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/140/10' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/140/11' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/140/16' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/140/14' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/140/18' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/140/13' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/140/17' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/140' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/142/19' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/142/15' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/142/20' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/142/12' 2024-04-12T19:44:18.111 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/142/10' 2024-04-12T19:44:18.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/142/11' 2024-04-12T19:44:18.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/142/16' 2024-04-12T19:44:18.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/142/14' 2024-04-12T19:44:18.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/142/18' 2024-04-12T19:44:18.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/142/13' 2024-04-12T19:44:18.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/142/17' 2024-04-12T19:44:18.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/142' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/150/19' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/150/15' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/150/20' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/150/12' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/150/10' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/150/11' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/150/16' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/150/14' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/150/18' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/150/13' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/150/17' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/150' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/105/19' 2024-04-12T19:44:18.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/105/15' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/105/20' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/105/12' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/105/10' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/105/11' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/105/16' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/105/14' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/105/18' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/105/13' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/105/17' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/105' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/149/19' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/149/15' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/149/20' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/149/12' 2024-04-12T19:44:18.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/149/10' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/149/11' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/149/16' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/149/14' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/149/18' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/149/13' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/149/17' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/149' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/109/19' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/109/15' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/109/20' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/109/12' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/109/10' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/109/11' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/109/16' 2024-04-12T19:44:18.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/109/14' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/109/18' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/109/13' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/109/17' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/109' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/158/19' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/158/15' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/158/20' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/158/12' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/158/10' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/158/11' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/158/16' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/158/14' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/158/18' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/158/13' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/158/17' 2024-04-12T19:44:18.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/158' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/106/19' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/106/15' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/106/20' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/106/12' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/106/10' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/106/11' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/106/16' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/106/14' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/106/18' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/106/13' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/106/17' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/106' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/189/19' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/189/15' 2024-04-12T19:44:18.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/189/20' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/189/12' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/189/10' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/189/11' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/189/16' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/189/14' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/189/18' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/189/13' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/189/17' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/189' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/133/19' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/133/15' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/133/20' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/133/12' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/133/10' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/133/11' 2024-04-12T19:44:18.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/133/16' 2024-04-12T19:44:18.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/133/14' 2024-04-12T19:44:18.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/133/18' 2024-04-12T19:44:18.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/133/13' 2024-04-12T19:44:18.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/133/17' 2024-04-12T19:44:18.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/133' 2024-04-12T19:44:18.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/173/19' 2024-04-12T19:44:18.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/173/15' 2024-04-12T19:44:18.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/173/20' 2024-04-12T19:44:18.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/173/12' 2024-04-12T19:44:18.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/173/10' 2024-04-12T19:44:18.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/173/11' 2024-04-12T19:44:19.806 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/173/16' 2024-04-12T19:44:19.806 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/173/14' 2024-04-12T19:44:19.807 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/173/18' 2024-04-12T19:44:19.807 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/173/13' 2024-04-12T19:44:19.807 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/173/17' 2024-04-12T19:44:19.807 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/173' 2024-04-12T19:44:19.807 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/174/19' 2024-04-12T19:44:19.807 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/174/15' 2024-04-12T19:44:19.807 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/174/20' 2024-04-12T19:44:19.807 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/174/12' 2024-04-12T19:44:19.807 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/174/10' 2024-04-12T19:44:19.807 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/174/11' 2024-04-12T19:44:19.807 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/174/16' 2024-04-12T19:44:19.807 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/174/14' 2024-04-12T19:44:19.808 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/174/18' 2024-04-12T19:44:19.808 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/174/13' 2024-04-12T19:44:19.808 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/174/17' 2024-04-12T19:44:19.808 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/174' 2024-04-12T19:44:19.808 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/155/19' 2024-04-12T19:44:19.808 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/155/15' 2024-04-12T19:44:19.808 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/155/20' 2024-04-12T19:44:19.808 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/155/12' 2024-04-12T19:44:19.808 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/155/10' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/155/11' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/155/16' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/155/14' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/155/18' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/155/13' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/155/17' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/155' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/114/19' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/114/15' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/114/20' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/114/12' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/114/10' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/114/11' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/114/16' 2024-04-12T19:44:19.809 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/114/14' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/114/18' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/114/13' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/114/17' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/114' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/159/19' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/159/15' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/159/20' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/159/12' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/159/10' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/159/11' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/159/16' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/159/14' 2024-04-12T19:44:19.810 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/159/18' 2024-04-12T19:44:19.811 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/159/13' 2024-04-12T19:44:19.811 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/159/17' 2024-04-12T19:44:19.811 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/159' 2024-04-12T19:44:19.811 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/187/19' 2024-04-12T19:44:19.811 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/187/15' 2024-04-12T19:44:19.811 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/187/20' 2024-04-12T19:44:19.811 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/187/12' 2024-04-12T19:44:19.811 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/187/10' 2024-04-12T19:44:19.811 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/187/11' 2024-04-12T19:44:19.811 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/187/16' 2024-04-12T19:44:19.811 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/187/14' 2024-04-12T19:44:19.811 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/187/18' 2024-04-12T19:44:19.812 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/187/13' 2024-04-12T19:44:19.812 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/187/17' 2024-04-12T19:44:19.812 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/187' 2024-04-12T19:44:19.812 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/185/19' 2024-04-12T19:44:19.812 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/185/15' 2024-04-12T19:44:19.812 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/185/20' 2024-04-12T19:44:19.812 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/185/12' 2024-04-12T19:44:19.812 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/185/10' 2024-04-12T19:44:19.812 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/185/11' 2024-04-12T19:44:19.813 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/185/16' 2024-04-12T19:44:19.813 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/185/14' 2024-04-12T19:44:19.813 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/185/18' 2024-04-12T19:44:19.813 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/185/13' 2024-04-12T19:44:19.813 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/185/17' 2024-04-12T19:44:19.813 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/185' 2024-04-12T19:44:19.813 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/120/19' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/120/15' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/120/20' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/120/12' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/120/10' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/120/11' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/120/16' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/120/14' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/120/18' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/120/13' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/120/17' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/120' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/110/19' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/110/15' 2024-04-12T19:44:19.814 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/110/20' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/110/12' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/110/10' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/110/11' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/110/16' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/110/14' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/110/18' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/110/13' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/110/17' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/110' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/137/19' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/137/15' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/137/20' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/137/12' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/137/10' 2024-04-12T19:44:19.815 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/137/11' 2024-04-12T19:44:19.816 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/137/16' 2024-04-12T19:44:20.651 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/137/14' 2024-04-12T19:44:20.651 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/137/18' 2024-04-12T19:44:20.651 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/137/13' 2024-04-12T19:44:20.651 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/137/17' 2024-04-12T19:44:20.651 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/137' 2024-04-12T19:44:20.651 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/198/19' 2024-04-12T19:44:20.651 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/198/15' 2024-04-12T19:44:20.651 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/198/20' 2024-04-12T19:44:20.651 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/198/12' 2024-04-12T19:44:20.651 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/198/10' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/198/11' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/198/16' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/198/14' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/198/18' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/198/13' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/198/17' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/198' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/136/19' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/136/15' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/136/20' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/136/12' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/136/10' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/136/11' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/136/16' 2024-04-12T19:44:20.652 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/136/14' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/136/18' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/136/13' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/136/17' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/136' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/125/19' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/125/15' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/125/20' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/125/12' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/125/10' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/125/11' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/125/16' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/125/14' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/125/18' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/125/13' 2024-04-12T19:44:20.653 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/125/17' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/125' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/194/19' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/194/15' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/194/20' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/194/12' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/194/10' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/194/11' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/194/16' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/194/14' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/194/18' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/194/13' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/194/17' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/194' 2024-04-12T19:44:20.654 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/119/19' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/119/15' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/119/20' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/119/12' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/119/10' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/119/11' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/119/16' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/119/14' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/119/18' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/119/13' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/119/17' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/119' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/157/19' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/157/15' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/157/20' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/157/12' 2024-04-12T19:44:20.655 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/157/10' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/157/11' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/157/16' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/157/14' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/157/18' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/157/13' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/157/17' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/157' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/172/19' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/172/15' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/172/20' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/172/12' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/172/10' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/172/11' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/172/16' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/172/14' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/172/18' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/172/13' 2024-04-12T19:44:20.656 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/172/17' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/172' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/186/19' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/186/15' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/186/20' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/186/12' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/186/10' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/186/11' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/186/16' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/186/14' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/186/18' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/186/13' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/186/17' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/186' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/190/19' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/190/15' 2024-04-12T19:44:20.657 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/190/20' 2024-04-12T19:44:20.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/190/12' 2024-04-12T19:44:20.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/190/10' 2024-04-12T19:44:20.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/190/11' 2024-04-12T19:44:20.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/190/16' 2024-04-12T19:44:20.658 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/190/14' 2024-04-12T19:44:21.566 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/190/18' 2024-04-12T19:44:21.566 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/190/13' 2024-04-12T19:44:21.566 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/190/17' 2024-04-12T19:44:21.566 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/190' 2024-04-12T19:44:21.566 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/104/19' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/104/15' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/104/20' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/104/12' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/104/10' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/104/11' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/104/16' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/104/14' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/104/18' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/104/13' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/104/17' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/104' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/164/19' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/164/15' 2024-04-12T19:44:21.567 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/164/20' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/164/12' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/164/10' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/164/11' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/164/16' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/164/14' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/164/18' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/164/13' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/164/17' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/164' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/112/19' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/112/15' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/112/20' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/112/12' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/112/10' 2024-04-12T19:44:21.568 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/112/11' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/112/16' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/112/14' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/112/18' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/112/13' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/112/17' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/112' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/100/19' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/100/15' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/100/20' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/100/12' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/100/10' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/100/11' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/100/16' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/100/14' 2024-04-12T19:44:21.569 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/100/18' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/100/13' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/100/17' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/100' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/134/19' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/134/15' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/134/20' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/134/12' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/134/10' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/134/11' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/134/16' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/134/14' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/134/18' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/134/13' 2024-04-12T19:44:21.570 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/134/17' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/134' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/115/19' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/115/15' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/115/20' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/115/12' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/115/10' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/115/11' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/115/16' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/115/14' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/115/18' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/115/13' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/115/17' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/115' 2024-04-12T19:44:21.571 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/116/19' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/116/15' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/116/20' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/116/12' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/116/10' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/116/11' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/116/16' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/116/14' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/116/18' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/116/13' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/116/17' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/116' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/195/19' 2024-04-12T19:44:21.572 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/195/15' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/195/20' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/195/12' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/195/10' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/195/11' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/195/16' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/195/14' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/195/18' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/195/13' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/195/17' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/195' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/138/19' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/138/15' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/138/20' 2024-04-12T19:44:21.573 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/138/12' 2024-04-12T19:44:21.574 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/138/10' 2024-04-12T19:44:21.574 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/138/11' 2024-04-12T19:44:21.574 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/138/16' 2024-04-12T19:44:21.574 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/138/14' 2024-04-12T19:44:21.574 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/138/18' 2024-04-12T19:44:22.498 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/138/13' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/138/17' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/138' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/135/19' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/135/15' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/135/20' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/135/12' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/135/10' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/135/11' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/135/16' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/135/14' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/135/18' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/135/13' 2024-04-12T19:44:22.499 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/135/17' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/135' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/117/19' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/117/15' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/117/20' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/117/12' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/117/10' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/117/11' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/117/16' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/117/14' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/117/18' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/117/13' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/117/17' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/117' 2024-04-12T19:44:22.500 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/143/19' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/143/15' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/143/20' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/143/12' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/143/10' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/143/11' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/143/16' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/143/14' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/143/18' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/143/13' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/143/17' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/143' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/180/19' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/180/15' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/180/20' 2024-04-12T19:44:22.501 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/180/12' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/180/10' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/180/11' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/180/16' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/180/14' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/180/18' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/180/13' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/180/17' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/180' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/126/19' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/126/15' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/126/20' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/126/12' 2024-04-12T19:44:22.502 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/126/10' 2024-04-12T19:44:22.503 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/126/11' 2024-04-12T19:44:22.503 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/126/16' 2024-04-12T19:44:22.503 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/126/14' 2024-04-12T19:44:22.503 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/126/18' 2024-04-12T19:44:22.503 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/126/13' 2024-04-12T19:44:22.503 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/126/17' 2024-04-12T19:44:22.503 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/126' 2024-04-12T19:44:22.504 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/161/19' 2024-04-12T19:44:22.504 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/161/15' 2024-04-12T19:44:22.504 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/161/20' 2024-04-12T19:44:22.504 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/161/12' 2024-04-12T19:44:22.504 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/161/10' 2024-04-12T19:44:22.504 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/161/11' 2024-04-12T19:44:22.504 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/161/16' 2024-04-12T19:44:22.504 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/161/14' 2024-04-12T19:44:22.505 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/161/18' 2024-04-12T19:44:22.505 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/161/13' 2024-04-12T19:44:22.505 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/161/17' 2024-04-12T19:44:22.505 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/161' 2024-04-12T19:44:22.505 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/176/19' 2024-04-12T19:44:22.505 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/176/15' 2024-04-12T19:44:22.505 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/176/20' 2024-04-12T19:44:22.506 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/176/12' 2024-04-12T19:44:22.506 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/176/10' 2024-04-12T19:44:22.506 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/176/11' 2024-04-12T19:44:22.506 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/176/16' 2024-04-12T19:44:22.506 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/176/14' 2024-04-12T19:44:22.506 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/176/18' 2024-04-12T19:44:22.507 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/176/13' 2024-04-12T19:44:22.507 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/176/17' 2024-04-12T19:44:22.507 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/176' 2024-04-12T19:44:22.507 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/111/19' 2024-04-12T19:44:22.507 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/111/15' 2024-04-12T19:44:22.507 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/111/20' 2024-04-12T19:44:22.507 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/111/12' 2024-04-12T19:44:22.508 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/111/10' 2024-04-12T19:44:22.508 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/111/11' 2024-04-12T19:44:22.508 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/111/16' 2024-04-12T19:44:22.508 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/111/14' 2024-04-12T19:44:22.508 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/111/18' 2024-04-12T19:44:22.508 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/111/13' 2024-04-12T19:44:22.508 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/111/17' 2024-04-12T19:44:22.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/111' 2024-04-12T19:44:22.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/191/19' 2024-04-12T19:44:22.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/191/15' 2024-04-12T19:44:22.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/191/20' 2024-04-12T19:44:22.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/191/12' 2024-04-12T19:44:22.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/191/10' 2024-04-12T19:44:22.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/191/11' 2024-04-12T19:44:22.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/191/16' 2024-04-12T19:44:22.509 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/191/14' 2024-04-12T19:44:22.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/191/18' 2024-04-12T19:44:22.510 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/191/13' 2024-04-12T19:44:23.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/191/17' 2024-04-12T19:44:23.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/191' 2024-04-12T19:44:23.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/184/19' 2024-04-12T19:44:23.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/184/15' 2024-04-12T19:44:23.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/184/20' 2024-04-12T19:44:23.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/184/12' 2024-04-12T19:44:23.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/184/10' 2024-04-12T19:44:23.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/184/11' 2024-04-12T19:44:23.330 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/184/16' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/184/14' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/184/18' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/184/13' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/184/17' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/184' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/192/19' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/192/15' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/192/20' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/192/12' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/192/10' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/192/11' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/192/16' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/192/14' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/192/18' 2024-04-12T19:44:23.331 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/192/13' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/192/17' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/192' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/103/19' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/103/15' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/103/20' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/103/12' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/103/10' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/103/11' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/103/16' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/103/14' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/103/18' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/103/13' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/103/17' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/103' 2024-04-12T19:44:23.332 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/128/19' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/128/15' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/128/20' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/128/12' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/128/10' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/128/11' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/128/16' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/128/14' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/128/18' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/128/13' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/128/17' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/128' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/144/19' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/144/15' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/144/20' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/144/12' 2024-04-12T19:44:23.333 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/144/10' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/144/11' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/144/16' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/144/14' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/144/18' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/144/13' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/144/17' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/144' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/146/19' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/146/15' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/146/20' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/146/12' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/146/10' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/146/11' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/146/16' 2024-04-12T19:44:23.334 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/146/14' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/146/18' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/146/13' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/146/17' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/146' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/141/19' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/141/15' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/141/20' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/141/12' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/141/10' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/141/11' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/141/16' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/141/14' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/141/18' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/141/13' 2024-04-12T19:44:23.335 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/141/17' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/141' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/182/19' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/182/15' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/182/20' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/182/12' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/182/10' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/182/11' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/182/16' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/182/14' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/182/18' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/182/13' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/182/17' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/182' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/107/19' 2024-04-12T19:44:23.336 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/107/15' 2024-04-12T19:44:23.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/107/20' 2024-04-12T19:44:23.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/107/12' 2024-04-12T19:44:23.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/107/10' 2024-04-12T19:44:23.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/107/11' 2024-04-12T19:44:23.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/107/16' 2024-04-12T19:44:23.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/107/14' 2024-04-12T19:44:23.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/107/18' 2024-04-12T19:44:23.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/107/13' 2024-04-12T19:44:23.337 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/107/17' 2024-04-12T19:44:24.190 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/107' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/178/19' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/178/15' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/178/20' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/178/12' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/178/10' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/178/11' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/178/16' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/178/14' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/178/18' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/178/13' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/178/17' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/178' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/156/19' 2024-04-12T19:44:24.191 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/156/15' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/156/20' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/156/12' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/156/10' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/156/11' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/156/16' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/156/14' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/156/18' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/156/13' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/156/17' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/156' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/131/19' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/131/15' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/131/20' 2024-04-12T19:44:24.192 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/131/12' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/131/10' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/131/11' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/131/16' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/131/14' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/131/18' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/131/13' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/131/17' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/131' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/123/19' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/123/15' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/123/20' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/123/12' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/123/10' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/123/11' 2024-04-12T19:44:24.193 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/123/16' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/123/14' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/123/18' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/123/13' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/123/17' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/123' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/160/19' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/160/15' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/160/20' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/160/12' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/160/10' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/160/11' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/160/16' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/160/14' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/160/18' 2024-04-12T19:44:24.194 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/160/13' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/160/17' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/160' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/165/19' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/165/15' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/165/20' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/165/12' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/165/10' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/165/11' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/165/16' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/165/14' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/165/18' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/165/13' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/165/17' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/165' 2024-04-12T19:44:24.195 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/101/19' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/101/15' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/101/20' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/101/12' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/101/10' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/101/11' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/101/16' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/101/14' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/101/18' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/101/13' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/101/17' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/101' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/148/19' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/148/15' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/148/20' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/148/12' 2024-04-12T19:44:24.196 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/148/10' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/148/11' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/148/16' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/148/14' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/148/18' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/148/13' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/148/17' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/148' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/168/19' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/168/15' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/168/20' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/168/12' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/168/10' 2024-04-12T19:44:24.197 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/168/11' 2024-04-12T19:44:24.198 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/168/16' 2024-04-12T19:44:24.198 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/168/14' 2024-04-12T19:44:24.198 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/168/18' 2024-04-12T19:44:24.198 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/168/13' 2024-04-12T19:44:24.198 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/168/17' 2024-04-12T19:44:24.198 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/168' 2024-04-12T19:44:25.116 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/179/19' 2024-04-12T19:44:25.116 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/179/15' 2024-04-12T19:44:25.116 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/179/20' 2024-04-12T19:44:25.116 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/179/12' 2024-04-12T19:44:25.116 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/179/10' 2024-04-12T19:44:25.116 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/179/11' 2024-04-12T19:44:25.116 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/179/16' 2024-04-12T19:44:25.116 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/179/14' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/179/18' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/179/13' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/179/17' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/179' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/132/19' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/132/15' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/132/20' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/132/12' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/132/10' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/132/11' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/132/16' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/132/14' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/132/18' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/132/13' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/132/17' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/132' 2024-04-12T19:44:25.117 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/199/19' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/199/15' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/199/20' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/199/12' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/199/10' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/199/11' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/199/16' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/199/14' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/199/18' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/199/13' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/199/17' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/199' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/163/19' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/163/15' 2024-04-12T19:44:25.118 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/163/20' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/163/12' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/163/10' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/163/11' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/163/16' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/163/14' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/163/18' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/163/13' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/163/17' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/163' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/153/19' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/153/15' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/153/20' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/153/12' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/153/10' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/153/11' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/153/16' 2024-04-12T19:44:25.119 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/153/14' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/153/18' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/153/13' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/153/17' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/153' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/122/19' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/122/15' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/122/20' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/122/12' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/122/10' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/122/11' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/122/16' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/122/14' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/122/18' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/122/13' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/122/17' 2024-04-12T19:44:25.120 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/122' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/162/19' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/162/15' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/162/20' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/162/12' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/162/10' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/162/11' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/162/16' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/162/14' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/162/18' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/162/13' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/162/17' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/162' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/197/19' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/197/15' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/197/20' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/197/12' 2024-04-12T19:44:25.121 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/197/10' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/197/11' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/197/16' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/197/14' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/197/18' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/197/13' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/197/17' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/197' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/113/19' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/113/15' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/113/20' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/113/12' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/113/10' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/113/11' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/113/16' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/113/14' 2024-04-12T19:44:25.122 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/113/18' 2024-04-12T19:44:25.123 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/113/13' 2024-04-12T19:44:25.123 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/113/17' 2024-04-12T19:44:25.123 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/113' 2024-04-12T19:44:25.123 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/152/19' 2024-04-12T19:44:25.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/152/15' 2024-04-12T19:44:25.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/152/20' 2024-04-12T19:44:25.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/152/12' 2024-04-12T19:44:25.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/152/10' 2024-04-12T19:44:25.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/152/11' 2024-04-12T19:44:25.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/152/16' 2024-04-12T19:44:25.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/152/14' 2024-04-12T19:44:25.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/152/18' 2024-04-12T19:44:25.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/152/13' 2024-04-12T19:44:25.962 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/152/17' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/152' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/121/19' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/121/15' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/121/20' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/121/12' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/121/10' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/121/11' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/121/16' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/121/14' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/121/18' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/121/13' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/121/17' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/121' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/118/19' 2024-04-12T19:44:25.963 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/118/15' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/118/20' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/118/12' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/118/10' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/118/11' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/118/16' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/118/14' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/118/18' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/118/13' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/118/17' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/118' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/196/19' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/196/15' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/196/20' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/196/12' 2024-04-12T19:44:25.964 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/196/10' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/196/11' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/196/16' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/196/14' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/196/18' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/196/13' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/196/17' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/196' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/124/19' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/124/15' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/124/20' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/124/12' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/124/10' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/124/11' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/124/16' 2024-04-12T19:44:25.965 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/124/14' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/124/18' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/124/13' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/124/17' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/124' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/188/19' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/188/15' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/188/20' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/188/12' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/188/10' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/188/11' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/188/16' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/188/14' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/188/18' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/188/13' 2024-04-12T19:44:25.966 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/188/17' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/188' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/145/19' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/145/15' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/145/20' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/145/12' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/145/10' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/145/11' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/145/16' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/145/14' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/145/18' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/145/13' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/145/17' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/145' 2024-04-12T19:44:25.967 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/130/19' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/130/15' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/130/20' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/130/12' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/130/10' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/130/11' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/130/16' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/130/14' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/130/18' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/130/13' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/130/17' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/130' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/193/19' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/193/15' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/193/20' 2024-04-12T19:44:25.968 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/193/12' 2024-04-12T19:44:25.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/193/10' 2024-04-12T19:44:25.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/193/11' 2024-04-12T19:44:25.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/193/16' 2024-04-12T19:44:25.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/193/14' 2024-04-12T19:44:25.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/193/18' 2024-04-12T19:44:25.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/193/13' 2024-04-12T19:44:25.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/193/17' 2024-04-12T19:44:25.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/193' 2024-04-12T19:44:25.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/175/19' 2024-04-12T19:44:25.969 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/175/15' 2024-04-12T19:44:26.829 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/175/20' 2024-04-12T19:44:26.829 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/175/12' 2024-04-12T19:44:26.829 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/175/10' 2024-04-12T19:44:26.829 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/175/11' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/175/16' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/175/14' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/175/18' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/175/13' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/175/17' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/175' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/181/19' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/181/15' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/181/20' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/181/12' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/181/10' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/181/11' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/181/16' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/181/14' 2024-04-12T19:44:26.830 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/181/18' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/181/13' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/181/17' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/181' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/127/19' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/127/15' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/127/20' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/127/12' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/127/10' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/127/11' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/127/16' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/127/14' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/127/18' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/127/13' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/127/17' 2024-04-12T19:44:26.831 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/127' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/108/19' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/108/15' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/108/20' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/108/12' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/108/10' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/108/11' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/108/16' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/108/14' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/108/18' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/108/13' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/108/17' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/108' 2024-04-12T19:44:26.832 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/183/19' 2024-04-12T19:44:26.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/183/15' 2024-04-12T19:44:26.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/183/20' 2024-04-12T19:44:26.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/183/12' 2024-04-12T19:44:26.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/183/10' 2024-04-12T19:44:26.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/183/11' 2024-04-12T19:44:26.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/183/16' 2024-04-12T19:44:26.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/183/14' 2024-04-12T19:44:26.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/183/18' 2024-04-12T19:44:26.833 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/183/13' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/183/17' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/183' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/177/19' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/177/15' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/177/20' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/177/12' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/177/10' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/177/11' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/177/16' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/177/14' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/177/18' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/177/13' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/177/17' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/177' 2024-04-12T19:44:26.834 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/169/19' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/169/15' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/169/20' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/169/12' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/169/10' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/169/11' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/169/16' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/169/14' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/169/18' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/169/13' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/169/17' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/169' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/154/19' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/154/15' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/154/20' 2024-04-12T19:44:26.835 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/154/12' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/154/10' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/154/11' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/154/16' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/154/14' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/154/18' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/154/13' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/154/17' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/154' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/171/19' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/171/15' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/171/20' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/171/12' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/171/10' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/171/11' 2024-04-12T19:44:26.836 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/171/16' 2024-04-12T19:44:26.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/171/14' 2024-04-12T19:44:26.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/171/18' 2024-04-12T19:44:26.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/171/13' 2024-04-12T19:44:26.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/171/17' 2024-04-12T19:44:26.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/171' 2024-04-12T19:44:26.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/139/19' 2024-04-12T19:44:26.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/139/15' 2024-04-12T19:44:26.837 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/139/20' 2024-04-12T19:44:27.149 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/139/12' 2024-04-12T19:44:27.149 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/139/10' 2024-04-12T19:44:27.149 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/139/11' 2024-04-12T19:44:27.149 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/139/16' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/139/14' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/139/18' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/139/13' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/139/17' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/139' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/102/19' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/102/15' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/102/20' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/102/12' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/102/10' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/102/11' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/102/16' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/102/14' 2024-04-12T19:44:27.150 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/102/18' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/102/13' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/102/17' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/102' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/129/19' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/129/15' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/129/20' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/129/12' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/129/10' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/129/11' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/129/16' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/129/14' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/129/18' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/129/13' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed './copyofsnap1/test1/129/17' 2024-04-12T19:44:27.151 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1/129' 2024-04-12T19:44:27.152 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1/test1' 2024-04-12T19:44:27.152 INFO:tasks.workunit.client.0.smithi131.stdout:removed directory './copyofsnap1' 2024-04-12T19:44:27.153 INFO:tasks.workunit.client.0.smithi131.stdout:OK 2024-04-12T19:44:27.153 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-12T19:44:27.153 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-12T19:44:27.280 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-authwb.sh... 2024-04-12T19:44:27.280 DEBUG:teuthology.orchestra.run.smithi131:workunit test fs/snaps/snaptest-authwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=324baf8ddb91dea46cac50cb535c306115791355 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-authwb.sh 2024-04-12T19:44:27.376 INFO:tasks.workunit.client.0.smithi131.stderr:+ set -e 2024-04-12T19:44:27.376 INFO:tasks.workunit.client.0.smithi131.stderr:+ touch foo 2024-04-12T19:44:27.384 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod +x foo 2024-04-12T19:44:27.390 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/s 2024-04-12T19:44:27.425 INFO:tasks.workunit.client.0.smithi131.stderr:+ find .snap/s/foo -executable 2024-04-12T19:44:27.426 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep foo 2024-04-12T19:44:27.445 INFO:tasks.workunit.client.0.smithi131.stdout:.snap/s/foo 2024-04-12T19:44:27.446 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir .snap/s 2024-04-12T19:44:27.523 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm foo 2024-04-12T19:44:27.536 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo OK 2024-04-12T19:44:27.537 INFO:tasks.workunit.client.0.smithi131.stdout:OK 2024-04-12T19:44:27.538 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-12T19:44:27.538 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-12T19:44:27.636 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-capwb.sh... 2024-04-12T19:44:27.637 DEBUG:teuthology.orchestra.run.smithi131:workunit test fs/snaps/snaptest-capwb.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=324baf8ddb91dea46cac50cb535c306115791355 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-capwb.sh 2024-04-12T19:44:27.696 INFO:tasks.workunit.client.0.smithi131.stderr:+ set -e 2024-04-12T19:44:27.697 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir foo 2024-04-12T19:44:27.703 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo x 2024-04-12T19:44:27.707 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:30.165 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir foo/.snap/ss 2024-04-12T19:44:30.213 INFO:tasks.workunit.client.0.smithi131.stderr:+ ln foo/x foo/xx 2024-04-12T19:44:30.222 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat foo/.snap/ss/x 2024-04-12T19:44:30.240 INFO:tasks.workunit.client.0.smithi131.stdout:x 2024-04-12T19:44:30.241 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir foo/.snap/ss 2024-04-12T19:44:30.262 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo a 2024-04-12T19:44:30.267 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo b 2024-04-12T19:44:30.273 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir foo/.snap/s 2024-04-12T19:44:30.305 INFO:tasks.workunit.client.0.smithi131.stderr:++ cat foo/.snap/s/a 2024-04-12T19:44:30.331 INFO:tasks.workunit.client.0.smithi131.stderr:+ r=a 2024-04-12T19:44:30.331 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' -z a ']' 2024-04-12T19:44:30.331 INFO:tasks.workunit.client.0.smithi131.stderr:+ ln foo/b foo/b2 2024-04-12T19:44:30.343 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat foo/.snap/s/b 2024-04-12T19:44:30.365 INFO:tasks.workunit.client.0.smithi131.stdout:b 2024-04-12T19:44:30.366 INFO:tasks.workunit.client.0.smithi131.stdout:this used to hang: 2024-04-12T19:44:30.366 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo 'this used to hang:' 2024-04-12T19:44:30.367 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo more 2024-04-12T19:44:30.376 INFO:tasks.workunit.client.0.smithi131.stdout:oh, it didn't hang! good job. 2024-04-12T19:44:30.377 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo 'oh, it didn'\''t hang! good job.' 2024-04-12T19:44:30.377 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat foo/b 2024-04-12T19:44:30.383 INFO:tasks.workunit.client.0.smithi131.stdout:b 2024-04-12T19:44:30.383 INFO:tasks.workunit.client.0.smithi131.stdout:more 2024-04-12T19:44:30.384 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir foo/.snap/s 2024-04-12T19:44:30.411 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm -r foo 2024-04-12T19:44:30.484 INFO:tasks.workunit.client.0.smithi131.stdout:OK 2024-04-12T19:44:30.485 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo OK 2024-04-12T19:44:30.486 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-12T19:44:30.486 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-12T19:44:30.593 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-dir-rename.sh... 2024-04-12T19:44:30.593 DEBUG:teuthology.orchestra.run.smithi131:workunit test fs/snaps/snaptest-dir-rename.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=324baf8ddb91dea46cac50cb535c306115791355 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-dir-rename.sh 2024-04-12T19:44:30.685 INFO:tasks.workunit.client.0.smithi131.stderr:+ set -e 2024-04-12T19:44:30.685 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:30.692 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/bar 2024-04-12T19:44:30.983 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/foo 2024-04-12T19:44:31.007 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/foo 2024-04-12T19:44:31.033 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:31.044 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/bar/a 2024-04-12T19:44:31.066 INFO:tasks.workunit.client.0.smithi131.stdout: File: .snap/bar/a 2024-04-12T19:44:31.066 INFO:tasks.workunit.client.0.smithi131.stdout: Size: 0 Blocks: 1 IO Block: 4096 directory 2024-04-12T19:44:31.066 INFO:tasks.workunit.client.0.smithi131.stdout:Device: 2bh/43d Inode: 845524441765765 Links: 2 2024-04-12T19:44:31.066 INFO:tasks.workunit.client.0.smithi131.stdout:Access: (0755/drwxr-xr-x) Uid: ( 1000/ ubuntu) Gid: ( 1301/ ubuntu) 2024-04-12T19:44:31.067 INFO:tasks.workunit.client.0.smithi131.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-12T19:44:31.067 INFO:tasks.workunit.client.0.smithi131.stdout:Access: 2024-04-12 19:44:30.689867331 +0000 2024-04-12T19:44:31.067 INFO:tasks.workunit.client.0.smithi131.stdout:Modify: 2024-04-12 19:44:30.689867331 +0000 2024-04-12T19:44:31.067 INFO:tasks.workunit.client.0.smithi131.stdout:Change: 2024-04-12 19:44:30.689867331 +0000 2024-04-12T19:44:31.067 INFO:tasks.workunit.client.0.smithi131.stdout: Birth: - 2024-04-12T19:44:31.067 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir .snap/bar 2024-04-12T19:44:31.090 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo OK 2024-04-12T19:44:31.090 INFO:tasks.workunit.client.0.smithi131.stdout:OK 2024-04-12T19:44:31.091 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-12T19:44:31.091 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-12T19:44:31.208 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-double-null.sh... 2024-04-12T19:44:31.208 DEBUG:teuthology.orchestra.run.smithi131:workunit test fs/snaps/snaptest-double-null.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=324baf8ddb91dea46cac50cb535c306115791355 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-double-null.sh 2024-04-12T19:44:31.297 INFO:tasks.workunit.client.0.smithi131.stderr:+ set -e 2024-04-12T19:44:31.298 INFO:tasks.workunit.client.0.smithi131.stderr:++ seq 1 20 2024-04-12T19:44:31.300 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:31.300 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:31.308 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:31.308 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:31.341 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:31.364 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:31.369 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:31.549 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:31.580 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:31.580 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:31.580 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:31.580 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:31.580 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:31.580 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:31.580 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:31.580 INFO:tasks.workunit.client.0.smithi131.stdout: 47958 ? 00:00:00 ps 2024-04-12T19:44:31.591 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:31.640 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:31.651 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:31.665 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:31.665 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:31.673 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:31.674 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:31.706 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:31.730 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:31.738 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:31.798 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:31.820 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:31.821 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:31.821 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:31.821 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:31.821 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:31.821 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:31.821 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:31.821 INFO:tasks.workunit.client.0.smithi131.stdout: 47968 ? 00:00:00 ps 2024-04-12T19:44:31.831 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:31.882 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:31.893 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:31.907 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:31.907 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:31.915 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:31.916 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:31.947 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:31.969 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:31.975 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:32.048 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:32.070 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:32.070 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:32.070 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:32.070 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:32.070 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:32.070 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:32.070 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:32.070 INFO:tasks.workunit.client.0.smithi131.stdout: 47978 ? 00:00:00 ps 2024-04-12T19:44:32.082 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:32.132 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:32.143 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:32.161 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:32.161 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:32.170 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:32.170 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:32.204 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:32.229 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:32.236 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:32.315 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:32.337 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:32.337 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:32.337 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:32.337 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:32.337 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:32.337 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:32.337 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:32.337 INFO:tasks.workunit.client.0.smithi131.stdout: 47988 ? 00:00:00 ps 2024-04-12T19:44:32.347 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:32.397 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:32.409 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:32.423 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:32.424 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:32.432 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:32.432 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:32.465 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:32.489 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:32.498 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:32.596 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:32.618 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:32.618 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:32.618 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:32.618 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:32.618 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:32.618 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:32.618 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:32.618 INFO:tasks.workunit.client.0.smithi131.stdout: 47998 ? 00:00:00 ps 2024-04-12T19:44:32.629 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:32.679 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:32.690 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:32.706 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:32.706 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:32.716 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:32.716 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:32.750 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:32.776 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:32.783 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:32.866 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:32.888 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:32.888 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:32.888 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:32.888 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:32.888 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:32.888 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:32.888 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:32.889 INFO:tasks.workunit.client.0.smithi131.stdout: 48008 ? 00:00:00 ps 2024-04-12T19:44:32.898 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:32.946 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:32.956 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:32.971 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:32.971 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:32.979 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:32.979 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:33.011 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:33.033 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:33.037 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:33.100 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:33.121 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:33.121 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:33.121 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:33.121 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:33.121 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:33.121 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:33.121 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:33.121 INFO:tasks.workunit.client.0.smithi131.stdout: 48018 ? 00:00:00 ps 2024-04-12T19:44:33.130 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:33.180 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:33.191 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:33.205 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:33.205 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:33.216 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:33.216 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:33.255 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:33.279 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:33.286 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:33.340 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:33.362 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:33.363 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:33.363 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:33.363 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:33.363 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:33.363 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:33.363 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:33.363 INFO:tasks.workunit.client.0.smithi131.stdout: 48028 ? 00:00:00 ps 2024-04-12T19:44:33.372 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:33.425 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:33.437 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:33.450 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:33.451 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:33.460 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:33.460 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:33.499 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:33.527 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:33.533 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:33.599 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:33.620 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:33.621 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:33.621 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:33.621 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:33.621 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:33.621 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:33.622 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:33.622 INFO:tasks.workunit.client.0.smithi131.stdout: 48038 ? 00:00:00 ps 2024-04-12T19:44:33.634 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:33.686 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:33.699 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:33.717 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:33.718 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:33.728 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:33.728 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:33.769 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:33.794 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:33.800 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:33.858 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:33.881 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:33.881 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:33.881 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:33.881 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:33.881 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:33.881 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:33.881 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:33.881 INFO:tasks.workunit.client.0.smithi131.stdout: 48048 ? 00:00:00 ps 2024-04-12T19:44:33.892 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:33.943 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:33.953 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:33.968 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:33.968 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:33.977 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:33.978 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:34.017 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:34.042 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:34.048 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:34.117 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:34.139 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:34.140 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:34.140 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:34.140 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:34.140 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:34.140 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:34.140 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:34.140 INFO:tasks.workunit.client.0.smithi131.stdout: 48058 ? 00:00:00 ps 2024-04-12T19:44:34.151 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:34.205 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:34.216 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:34.231 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:34.231 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:34.240 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:34.240 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:34.295 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:34.320 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:34.325 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:34.393 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:34.414 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:34.415 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:34.415 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:34.415 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:34.415 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:34.415 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:34.415 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:34.415 INFO:tasks.workunit.client.0.smithi131.stdout: 48068 ? 00:00:00 ps 2024-04-12T19:44:34.425 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:34.475 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:34.487 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:34.506 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:34.506 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:34.516 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:34.516 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:34.557 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:34.582 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:34.587 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:34.642 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:34.664 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:34.664 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:34.664 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:34.664 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:34.664 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:34.664 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:34.665 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:34.665 INFO:tasks.workunit.client.0.smithi131.stdout: 48078 ? 00:00:00 ps 2024-04-12T19:44:34.675 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:34.723 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:34.734 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:34.749 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:34.749 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:34.758 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:34.758 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:34.803 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:34.850 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:34.856 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:34.994 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:35.022 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:35.022 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:35.022 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:35.022 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:35.022 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:35.022 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:35.023 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:35.023 INFO:tasks.workunit.client.0.smithi131.stdout: 48088 ? 00:00:00 ps 2024-04-12T19:44:35.032 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:35.150 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:35.158 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:35.173 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:35.173 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:35.179 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:35.179 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:35.207 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:35.220 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:35.223 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:35.657 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:35.685 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:35.685 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:35.685 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:35.685 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:35.685 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:35.685 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:35.685 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:35.685 INFO:tasks.workunit.client.0.smithi131.stdout: 48098 ? 00:00:00 ps 2024-04-12T19:44:35.693 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:35.740 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:35.749 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:35.762 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:35.762 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:35.770 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:35.770 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:35.796 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:35.833 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:35.836 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:36.194 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:36.217 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:36.217 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:36.217 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:36.217 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:36.217 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:36.217 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:36.217 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:36.218 INFO:tasks.workunit.client.0.smithi131.stdout: 48108 ? 00:00:00 ps 2024-04-12T19:44:36.227 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:36.283 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:36.293 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:36.308 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:36.308 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:36.317 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:36.318 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:36.356 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:36.379 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:36.386 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:36.533 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:36.564 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:36.564 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:36.564 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:36.564 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:36.565 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:36.565 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:36.565 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:36.565 INFO:tasks.workunit.client.0.smithi131.stdout: 48118 ? 00:00:00 ps 2024-04-12T19:44:36.573 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:36.597 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:36.602 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:36.609 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:36.609 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:36.614 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:36.614 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:36.634 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:36.655 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:36.661 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:36.828 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:36.849 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:36.850 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:36.850 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:36.850 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:36.850 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:36.850 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:36.850 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:36.850 INFO:tasks.workunit.client.0.smithi131.stdout: 48128 ? 00:00:00 ps 2024-04-12T19:44:36.867 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:36.907 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:36.914 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:36.923 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:36.924 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:36.930 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:36.930 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:36.957 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:36.981 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:36.987 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:37.111 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:37.133 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:37.133 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:37.133 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:37.133 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:37.134 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:37.134 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:37.134 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:37.134 INFO:tasks.workunit.client.0.smithi131.stdout: 48138 ? 00:00:00 ps 2024-04-12T19:44:37.144 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:37.216 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:37.225 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:37.234 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 20` 2024-04-12T19:44:37.234 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a 2024-04-12T19:44:37.239 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/one 2024-04-12T19:44:37.240 INFO:tasks.workunit.client.0.smithi131.stderr:+ cat 2024-04-12T19:44:37.257 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir a/.snap/two 2024-04-12T19:44:37.274 INFO:tasks.workunit.client.0.smithi131.stderr:+ chmod 777 a/foo 2024-04-12T19:44:37.279 INFO:tasks.workunit.client.0.smithi131.stderr:+ sync 2024-04-12T19:44:37.378 INFO:tasks.workunit.client.0.smithi131.stderr:+ ps 2024-04-12T19:44:37.399 INFO:tasks.workunit.client.0.smithi131.stdout: PID TTY TIME CMD 2024-04-12T19:44:37.400 INFO:tasks.workunit.client.0.smithi131.stdout: 4293 ? 00:00:00 systemd 2024-04-12T19:44:37.400 INFO:tasks.workunit.client.0.smithi131.stdout: 4295 ? 00:00:00 (sd-pam) 2024-04-12T19:44:37.400 INFO:tasks.workunit.client.0.smithi131.stdout: 22983 ? 00:00:02 sshd 2024-04-12T19:44:37.400 INFO:tasks.workunit.client.0.smithi131.stdout: 45524 ? 00:00:00 bash 2024-04-12T19:44:37.400 INFO:tasks.workunit.client.0.smithi131.stdout: 47932 ? 00:00:00 timeout 2024-04-12T19:44:37.400 INFO:tasks.workunit.client.0.smithi131.stdout: 47950 ? 00:00:00 snaptest-double 2024-04-12T19:44:37.400 INFO:tasks.workunit.client.0.smithi131.stdout: 48148 ? 00:00:00 ps 2024-04-12T19:44:37.410 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a/.snap/one a/.snap/two 2024-04-12T19:44:37.461 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm a/foo 2024-04-12T19:44:37.469 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir a 2024-04-12T19:44:37.484 INFO:tasks.workunit.client.0.smithi131.stdout:OK 2024-04-12T19:44:37.484 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo OK 2024-04-12T19:44:37.486 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-12T19:44:37.486 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-12T19:44:37.606 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-estale.sh... 2024-04-12T19:44:37.607 DEBUG:teuthology.orchestra.run.smithi131:workunit test fs/snaps/snaptest-estale.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=324baf8ddb91dea46cac50cb535c306115791355 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-estale.sh 2024-04-12T19:44:37.702 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/foo 2024-04-12T19:44:37.716 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo 'We want ENOENT, not ESTALE, here.' 2024-04-12T19:44:37.716 INFO:tasks.workunit.client.0.smithi131.stdout:We want ENOENT, not ESTALE, here. 2024-04-12T19:44:37.716 INFO:tasks.workunit.client.0.smithi131.stderr:++ seq 1 100 2024-04-12T19:44:37.719 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.720 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/1 2024-04-12T19:44:37.720 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.726 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/1': No such file or directory 2024-04-12T19:44:37.727 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.727 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/2 2024-04-12T19:44:37.728 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.734 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/2': No such file or directory 2024-04-12T19:44:37.735 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.736 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/3 2024-04-12T19:44:37.736 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.742 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/3': No such file or directory 2024-04-12T19:44:37.743 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.744 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/4 2024-04-12T19:44:37.744 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.750 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/4': No such file or directory 2024-04-12T19:44:37.751 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.751 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/5 2024-04-12T19:44:37.752 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.758 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/5': No such file or directory 2024-04-12T19:44:37.758 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.759 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/6 2024-04-12T19:44:37.759 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.766 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/6': No such file or directory 2024-04-12T19:44:37.766 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.767 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/7 2024-04-12T19:44:37.768 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.774 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/7': No such file or directory 2024-04-12T19:44:37.775 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.775 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/8 2024-04-12T19:44:37.776 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.783 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/8': No such file or directory 2024-04-12T19:44:37.783 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.784 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/9 2024-04-12T19:44:37.784 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.790 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/9': No such file or directory 2024-04-12T19:44:37.791 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.792 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/10 2024-04-12T19:44:37.792 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.799 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/10': No such file or directory 2024-04-12T19:44:37.800 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.800 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/11 2024-04-12T19:44:37.801 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.808 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/11': No such file or directory 2024-04-12T19:44:37.809 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.809 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/12 2024-04-12T19:44:37.810 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.818 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/12': No such file or directory 2024-04-12T19:44:37.818 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.819 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/13 2024-04-12T19:44:37.819 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.827 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/13': No such file or directory 2024-04-12T19:44:37.827 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.828 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/14 2024-04-12T19:44:37.829 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.836 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/14': No such file or directory 2024-04-12T19:44:37.836 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.837 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/15 2024-04-12T19:44:37.837 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.847 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/15': No such file or directory 2024-04-12T19:44:37.848 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.849 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.849 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/16 2024-04-12T19:44:37.861 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/16': No such file or directory 2024-04-12T19:44:37.861 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.862 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/17 2024-04-12T19:44:37.863 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.876 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/17': No such file or directory 2024-04-12T19:44:37.877 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.878 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.878 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/18 2024-04-12T19:44:37.888 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/18': No such file or directory 2024-04-12T19:44:37.889 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.890 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/19 2024-04-12T19:44:37.891 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.900 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/19': No such file or directory 2024-04-12T19:44:37.901 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.903 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/20 2024-04-12T19:44:37.903 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.917 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/20': No such file or directory 2024-04-12T19:44:37.919 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.922 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/21 2024-04-12T19:44:37.922 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.930 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/21': No such file or directory 2024-04-12T19:44:37.931 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.932 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/22 2024-04-12T19:44:37.932 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.939 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/22': No such file or directory 2024-04-12T19:44:37.940 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.940 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/23 2024-04-12T19:44:37.941 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.948 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/23': No such file or directory 2024-04-12T19:44:37.948 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.949 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/24 2024-04-12T19:44:37.950 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.955 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/24': No such file or directory 2024-04-12T19:44:37.955 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.956 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/25 2024-04-12T19:44:37.956 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.962 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/25': No such file or directory 2024-04-12T19:44:37.962 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.963 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/26 2024-04-12T19:44:37.963 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.968 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/26': No such file or directory 2024-04-12T19:44:37.969 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.969 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/27 2024-04-12T19:44:37.970 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.975 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/27': No such file or directory 2024-04-12T19:44:37.976 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.976 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/28 2024-04-12T19:44:37.977 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.982 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/28': No such file or directory 2024-04-12T19:44:37.982 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.983 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/29 2024-04-12T19:44:37.983 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.989 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/29': No such file or directory 2024-04-12T19:44:37.990 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.990 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/30 2024-04-12T19:44:37.990 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:37.997 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/30': No such file or directory 2024-04-12T19:44:37.997 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:37.998 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/31 2024-04-12T19:44:37.998 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.004 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/31': No such file or directory 2024-04-12T19:44:38.005 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.005 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/32 2024-04-12T19:44:38.005 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.012 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/32': No such file or directory 2024-04-12T19:44:38.013 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.013 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/33 2024-04-12T19:44:38.013 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.021 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/33': No such file or directory 2024-04-12T19:44:38.021 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.022 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/34 2024-04-12T19:44:38.022 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.029 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/34': No such file or directory 2024-04-12T19:44:38.029 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.030 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/35 2024-04-12T19:44:38.030 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.036 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/35': No such file or directory 2024-04-12T19:44:38.037 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.037 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/36 2024-04-12T19:44:38.038 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.045 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/36': No such file or directory 2024-04-12T19:44:38.045 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.046 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/37 2024-04-12T19:44:38.046 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.055 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/37': No such file or directory 2024-04-12T19:44:38.055 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.056 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/38 2024-04-12T19:44:38.057 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.065 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/38': No such file or directory 2024-04-12T19:44:38.065 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.066 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/39 2024-04-12T19:44:38.067 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.075 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/39': No such file or directory 2024-04-12T19:44:38.075 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.076 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/40 2024-04-12T19:44:38.077 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.086 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/40': No such file or directory 2024-04-12T19:44:38.086 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.087 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/41 2024-04-12T19:44:38.088 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.097 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/41': No such file or directory 2024-04-12T19:44:38.098 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.099 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/42 2024-04-12T19:44:38.100 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.108 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/42': No such file or directory 2024-04-12T19:44:38.109 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.110 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/43 2024-04-12T19:44:38.110 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.117 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/43': No such file or directory 2024-04-12T19:44:38.118 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.118 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/44 2024-04-12T19:44:38.119 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.128 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/44': No such file or directory 2024-04-12T19:44:38.128 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.129 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/45 2024-04-12T19:44:38.129 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.137 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/45': No such file or directory 2024-04-12T19:44:38.138 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.138 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/46 2024-04-12T19:44:38.139 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.146 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/46': No such file or directory 2024-04-12T19:44:38.147 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.147 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/47 2024-04-12T19:44:38.148 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.156 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/47': No such file or directory 2024-04-12T19:44:38.156 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.157 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/48 2024-04-12T19:44:38.158 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.164 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/48': No such file or directory 2024-04-12T19:44:38.165 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.165 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/49 2024-04-12T19:44:38.166 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.172 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/49': No such file or directory 2024-04-12T19:44:38.173 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.174 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/50 2024-04-12T19:44:38.174 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.181 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/50': No such file or directory 2024-04-12T19:44:38.182 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.184 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/51 2024-04-12T19:44:38.184 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.191 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/51': No such file or directory 2024-04-12T19:44:38.191 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.192 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/52 2024-04-12T19:44:38.192 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.200 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/52': No such file or directory 2024-04-12T19:44:38.201 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.201 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/53 2024-04-12T19:44:38.202 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.210 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/53': No such file or directory 2024-04-12T19:44:38.210 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.211 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.211 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/54 2024-04-12T19:44:38.220 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/54': No such file or directory 2024-04-12T19:44:38.221 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.223 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/55 2024-04-12T19:44:38.223 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.231 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/55': No such file or directory 2024-04-12T19:44:38.231 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.232 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/56 2024-04-12T19:44:38.232 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.241 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/56': No such file or directory 2024-04-12T19:44:38.241 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.242 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/57 2024-04-12T19:44:38.244 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.251 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/57': No such file or directory 2024-04-12T19:44:38.251 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.253 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/58 2024-04-12T19:44:38.254 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.260 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/58': No such file or directory 2024-04-12T19:44:38.261 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.261 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/59 2024-04-12T19:44:38.262 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.269 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/59': No such file or directory 2024-04-12T19:44:38.269 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.270 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/60 2024-04-12T19:44:38.270 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.278 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/60': No such file or directory 2024-04-12T19:44:38.279 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.280 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/61 2024-04-12T19:44:38.280 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.288 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/61': No such file or directory 2024-04-12T19:44:38.289 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.289 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/62 2024-04-12T19:44:38.290 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.297 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/62': No such file or directory 2024-04-12T19:44:38.298 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.298 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/63 2024-04-12T19:44:38.299 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.307 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/63': No such file or directory 2024-04-12T19:44:38.307 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.308 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/64 2024-04-12T19:44:38.308 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.317 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/64': No such file or directory 2024-04-12T19:44:38.317 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.319 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/65 2024-04-12T19:44:38.319 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.330 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/65': No such file or directory 2024-04-12T19:44:38.330 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.330 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/66 2024-04-12T19:44:38.332 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.344 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/66': No such file or directory 2024-04-12T19:44:38.344 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.345 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/67 2024-04-12T19:44:38.346 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.356 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/67': No such file or directory 2024-04-12T19:44:38.357 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.357 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/68 2024-04-12T19:44:38.358 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.367 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/68': No such file or directory 2024-04-12T19:44:38.367 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.368 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/69 2024-04-12T19:44:38.370 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.376 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/69': No such file or directory 2024-04-12T19:44:38.376 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.377 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/70 2024-04-12T19:44:38.377 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.385 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/70': No such file or directory 2024-04-12T19:44:38.385 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.386 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/71 2024-04-12T19:44:38.387 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.395 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/71': No such file or directory 2024-04-12T19:44:38.396 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.397 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/72 2024-04-12T19:44:38.398 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.404 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/72': No such file or directory 2024-04-12T19:44:38.405 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.406 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/73 2024-04-12T19:44:38.407 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.414 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/73': No such file or directory 2024-04-12T19:44:38.414 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.415 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/74 2024-04-12T19:44:38.416 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.423 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/74': No such file or directory 2024-04-12T19:44:38.424 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.424 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/75 2024-04-12T19:44:38.424 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.431 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/75': No such file or directory 2024-04-12T19:44:38.432 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.432 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/76 2024-04-12T19:44:38.433 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.440 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/76': No such file or directory 2024-04-12T19:44:38.440 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.441 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/77 2024-04-12T19:44:38.441 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.449 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/77': No such file or directory 2024-04-12T19:44:38.449 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.450 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/78 2024-04-12T19:44:38.450 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.458 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/78': No such file or directory 2024-04-12T19:44:38.458 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.459 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/79 2024-04-12T19:44:38.461 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.468 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/79': No such file or directory 2024-04-12T19:44:38.469 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.470 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/80 2024-04-12T19:44:38.470 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.479 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/80': No such file or directory 2024-04-12T19:44:38.481 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.482 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/81 2024-04-12T19:44:38.482 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.489 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/81': No such file or directory 2024-04-12T19:44:38.490 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.491 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/82 2024-04-12T19:44:38.492 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.499 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/82': No such file or directory 2024-04-12T19:44:38.500 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.500 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/83 2024-04-12T19:44:38.501 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.511 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/83': No such file or directory 2024-04-12T19:44:38.512 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.513 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/84 2024-04-12T19:44:38.513 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.520 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/84': No such file or directory 2024-04-12T19:44:38.521 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.521 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/85 2024-04-12T19:44:38.522 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.529 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/85': No such file or directory 2024-04-12T19:44:38.529 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.530 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/86 2024-04-12T19:44:38.530 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.537 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/86': No such file or directory 2024-04-12T19:44:38.537 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.538 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.538 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/87 2024-04-12T19:44:38.546 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/87': No such file or directory 2024-04-12T19:44:38.546 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.548 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/88 2024-04-12T19:44:38.548 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.556 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/88': No such file or directory 2024-04-12T19:44:38.557 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.558 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/89 2024-04-12T19:44:38.559 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.566 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/89': No such file or directory 2024-04-12T19:44:38.567 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.568 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/90 2024-04-12T19:44:38.569 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.576 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/90': No such file or directory 2024-04-12T19:44:38.576 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.577 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/91 2024-04-12T19:44:38.577 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.585 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/91': No such file or directory 2024-04-12T19:44:38.585 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.586 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/92 2024-04-12T19:44:38.586 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.594 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/92': No such file or directory 2024-04-12T19:44:38.595 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.595 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/93 2024-04-12T19:44:38.596 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.602 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/93': No such file or directory 2024-04-12T19:44:38.603 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.603 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/94 2024-04-12T19:44:38.604 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.611 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/94': No such file or directory 2024-04-12T19:44:38.612 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.612 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/95 2024-04-12T19:44:38.613 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.620 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/95': No such file or directory 2024-04-12T19:44:38.620 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.621 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/96 2024-04-12T19:44:38.621 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.630 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/96': No such file or directory 2024-04-12T19:44:38.631 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.632 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/97 2024-04-12T19:44:38.632 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.639 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/97': No such file or directory 2024-04-12T19:44:38.640 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.640 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/98 2024-04-12T19:44:38.641 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.650 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/98': No such file or directory 2024-04-12T19:44:38.650 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.652 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/99 2024-04-12T19:44:38.652 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.659 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/99': No such file or directory 2024-04-12T19:44:38.660 INFO:tasks.workunit.client.0.smithi131.stderr:+ for f in `seq 1 100` 2024-04-12T19:44:38.660 INFO:tasks.workunit.client.0.smithi131.stderr:+ stat .snap/foo/100 2024-04-12T19:44:38.662 INFO:tasks.workunit.client.0.smithi131.stderr:+ grep 'No such file' 2024-04-12T19:44:38.677 INFO:tasks.workunit.client.0.smithi131.stdout:stat: cannot statx '.snap/foo/100': No such file or directory 2024-04-12T19:44:38.679 INFO:tasks.workunit.client.0.smithi131.stderr:+ rmdir .snap/foo 2024-04-12T19:44:38.730 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo OK 2024-04-12T19:44:38.731 INFO:tasks.workunit.client.0.smithi131.stdout:OK 2024-04-12T19:44:38.734 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-12T19:44:38.734 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-12T19:44:38.821 INFO:tasks.workunit:Running workunit fs/snaps/snaptest-git-ceph.sh... 2024-04-12T19:44:38.821 DEBUG:teuthology.orchestra.run.smithi131:workunit test fs/snaps/snaptest-git-ceph.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=324baf8ddb91dea46cac50cb535c306115791355 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh 2024-04-12T19:44:38.885 INFO:tasks.workunit.client.0.smithi131.stderr:+ set -e 2024-04-12T19:44:38.885 INFO:tasks.workunit.client.0.smithi131.stderr:+ sudo git config --global http.sslVerify false 2024-04-12T19:44:38.942 INFO:tasks.workunit.client.0.smithi131.stderr:+ sudo git config --global http.postBuffer 1048576000 2024-04-12T19:44:39.010 INFO:tasks.workunit.client.0.smithi131.stderr:+ retried=false 2024-04-12T19:44:39.010 INFO:tasks.workunit.client.0.smithi131.stderr:+ trap -- retry EXIT 2024-04-12T19:44:39.010 INFO:tasks.workunit.client.0.smithi131.stderr:+ rm -rf ceph 2024-04-12T19:44:39.020 INFO:tasks.workunit.client.0.smithi131.stderr:+ timeout 1800 git clone https://git.ceph.com/ceph.git 2024-04-12T19:44:39.028 INFO:tasks.workunit.client.0.smithi131.stderr:Cloning into 'ceph'... 2024-04-12T19:44:40.614 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:44:40.624 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:45:10.762 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:45:10.771 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:45:40.899 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:45:40.908 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:46:11.031 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:46:11.041 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:46:41.167 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:46:41.176 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:47:11.302 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:47:11.310 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:47:41.449 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:47:41.457 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:48:11.590 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:48:11.598 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:48:41.728 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:48:41.738 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:49:11.866 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:49:11.875 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:49:41.997 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:49:42.006 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:50:12.137 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:50:12.146 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:50:42.295 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:50:42.305 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:51:12.457 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:51:12.466 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:51:42.594 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:51:42.606 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:52:12.727 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:52:12.736 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:52:42.881 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:52:42.891 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:53:13.021 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:53:13.033 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:53:43.912 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:53:43.918 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:54:14.046 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:54:14.056 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:54:44.179 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:54:44.185 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:55:14.309 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:55:14.318 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:55:44.449 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:55:44.455 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:56:14.584 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:56:14.592 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:56:44.719 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:56:44.727 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:57:14.845 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:57:14.856 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:57:45.387 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:57:45.396 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:57:52.986 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 0% (101/12473) Updating files: 1% (125/12473) Updating files: 1% (214/12473) Updating files: 2% (250/12473) Updating files: 2% (300/12473) Updating files: 3% (375/12473) Updating files: 3% (386/12473) Updating files: 3% (454/12473) Updating files: 4% (499/12473) Updating files: 4% (531/12473) Updating files: 4% (596/12473) Updating files: 5% (624/12473) Updating files: 5% (660/12473) Updating files: 5% (734/12473) Updating files: 6% (749/12473) Updating files: 6% (783/12473) Updating files: 6% (866/12473) Updating files: 7% (874/12473) Updating files: 7% (935/12473) Updating files: 7% (996/12473) Updating files: 8% (998/12473) Updating files: 8% (1053/12473) Updating files: 8% (1113/12473) Updating files: 9% (1123/12473) Updating files: 9% (1175/12473) Updating files: 9% (1233/12473) Updating files: 10% (1248/12473) Updating files: 10% (1311/12473) Updating files: 11% (1373/12473) Updating files: 11% (1393/12473) Updating files: 11% (1475/12473) Updating files: 12% (1497/12473) Updating files: 12% (1544/12473) Updating files: 12% (1594/12473) Updating files: 13% (1622/12473) Updating files: 13% (1645/12473) Updating files: 13% (1696/12473) Updating files: 13% (1735/12473) Updating files: 14% (1747/12473) Updating files: 14% (1790/12473) Updating files: 14% (1842/12473) Updating files: 15% (1871/12473) Updating files: 15% (1903/12473) Updating files: 15% (1959/12473) Updating files: 16% (1996/12473) Updating files: 16% (2013/12473) Updating files: 16% (2071/12473) Updating files: 17% (2121/12473) Updating files: 17% (2127/12473) Updating files: 17% (2179/12473) Updating files: 17% (2227/12473) Updating files: 18% (2246/12473) Updating files: 18% (2274/12473) Updating files: 18% (2322/12473) Updating files: 19% (2370/12473) Updating files: 19% (2373/12473) Updating files: 19% (2421/12473) Updating files: 19% (2474/12473) Updating files: 20% (2495/12473) Updating files: 20% (2525/12473) Updating files: 20% (2576/12473) Updating files: 21% (2620/12473) Updating files: 21% (2626/12473) Updating files: 21% (2679/12473) Updating files: 21% (2737/12473) Updating files: 22% (2745/12473) Updating files: 22% (2791/12473) Updating files: 22% (2845/12473) Updating files: 23% (2869/12473) Updating files: 23% (2902/12473) Updating files: 23% (2956/12473) Updating files: 24% (2994/12473) Updating files: 24% (3003/12473) Updating files: 24% (3055/12473) Updating files: 24% (3116/12473) Updating files: 25% (3119/12473) Updating files: 25% (3178/12473) Updating files: 25% (3239/12473) Updating files: 26% (3243/12473) Updating files: 26% (3301/12473) Updating files: 27% (3368/12473) Updating files: 27% (3373/12473) Updating files: 27% (3435/12473) Updating files: 28% (3493/12473) Updating files: 28% (3556/12473) Updating files: 28% (3610/12473) Updating files: 29% (3618/12473) Updating files: 29% (3668/12473) Updating files: 29% (3724/12473) Updating files: 30% (3742/12473) Updating files: 30% (3783/12473) Updating files: 30% (3839/12473) Updating files: 31% (3867/12473) Updating files: 31% (3892/12473) Updating files: 31% (3947/12473) Updating files: 32% (3992/12473) Updating files: 32% (4011/12473) Updating files: 32% (4071/12473) Updating files: 33% (4117/12473) Updating files: 33% (4135/12473) Updating files: 33% (4196/12473) Updating files: 34% (4241/12473) Updating files: 34% (4251/12473) Updating files: 34% (4309/12473) Updating files: 35% (4366/12473) Updating files: 35% (4420/12473) Updating files: 35% (4473/12473) Updating files: 36% (4491/12473) Updating files: 36% (4532/12473) Updating files: 36% (4595/12473) Updating files: 37% (4616/12473) Updating files: 37% (4679/12473) Updating files: 38% (4740/12473) Updating files: 38% (4767/12473) Updating files: 38% (4847/12473) Updating files: 39% (4865/12473) Updating files: 39% (4943/12473) Updating files: 40% (4990/12473) Updating files: 40% (5028/12473) Updating files: 40% (5070/12473) Updating files: 41% (5114/12473) Updating files: 41% (5153/12473) Updating files: 41% (5225/12473) Updating files: 42% (5239/12473) Updating files: 42% (5295/12473) Updating files: 42% (5331/12473) Updating files: 43% (5364/12473) Updating files: 43% (5367/12473) Updating files: 43% (5418/12473) Updating files: 43% (5488/12473) Updating files: 44% (5489/12473) Updating files: 44% (5526/12473) Updating files: 44% (5604/12473) Updating files: 45% (5613/12473) Updating files: 45% (5673/12473) Updating files: 46% (5738/12473) Updating files: 46% (5763/12473) Updating files: 46% (5851/12473) Updating files: 47% (5863/12473) Updating files: 47% (5987/12473) Updating files: 48% (5988/12473) Updating files: 48% (6071/12473) Updating files: 49% (6112/12473) Updating files: 49% (6147/12473) Updating files: 49% (6210/12473) Updating files: 50% (6237/12473) Updating files: 50% (6261/12473) Updating files: 50% (6326/12473) Updating files: 51% (6362/12473) Updating files: 51% (6399/12473) Updating files: 51% (6473/12473) Updating files: 52% (6486/12473) Updating files: 52% (6548/12473) Updating files: 53% (6611/12473) Updating files: 53% (6630/12473) Updating files: 53% (6691/12473) Updating files: 54% (6736/12473) Updating files: 54% (6758/12473) Updating files: 54% (6841/12473) Updating files: 55% (6861/12473) Updating files: 55% (6916/12473) Updating files: 56% (6985/12473) Updating files: 56% (6991/12473) Updating files: 56% (7095/12473) Updating files: 57% (7110/12473) Updating files: 57% (7176/12473) Updating files: 58% (7235/12473) Updating files: 58% (7251/12473) Updating files: 58% (7327/12473) Updating files: 59% (7360/12473) Updating files: 59% (7408/12473) Updating files: 60% (7484/12473) Updating files: 60% (7528/12473) Updating files: 61% (7609/12473) Updating files: 61% (7624/12473) Updating files: 61% (7713/12473) Updating files: 62% (7734/12473) Updating files: 62% (7791/12473) Updating files: 63% (7858/12473) Updating files: 63% (7872/12473) Updating files: 63% (7940/12473) Updating files: 64% (7983/12473) Updating files: 64% (8011/12473) Updating files: 64% (8080/12473) Updating files: 65% (8108/12473) Updating files: 65% (8129/12473) Updating files: 65% (8186/12473) Updating files: 65% (8218/12473) Updating files: 66% (8233/12473) Updating files: 66% (8273/12473) Updating files: 66% (8316/12473) Updating files: 67% (8357/12473) Updating files: 67% (8358/12473) Updating files: 67% (8394/12473) Updating files: 67% (8427/12473) Updating files: 67% (8468/12473) Updating files: 68% (8482/12473) Updating files: 68% (8504/12473) Updating files: 68% (8541/12473) Updating files: 68% (8577/12473) Updating files: 69% (8607/12473) Updating files: 69% (8612/12473) Updating files: 69% (8649/12473) Updating files: 69% (8685/12473) Updating files: 69% (8719/12473) Updating files: 70% (8732/12473) Updating files: 70% (8754/12473) Updating files: 70% (8791/12473) Updating files: 70% (8830/12473) Updating files: 71% (8856/12473) Updating files: 71% (8866/12473) Updating files: 71% (8905/12473) Updating files: 71% (8942/12473) Updating files: 71% (8977/12473) Updating files: 72% (8981/12473) Updating files: 72% (9015/12473) Updating files: 72% (9053/12473) Updating files: 72% (9089/12473) Updating files: 73% (9106/12473) Updating files: 73% (9129/12473) Updating files: 73% (9180/12473) Updating files: 73% (9227/12473) Updating files: 74% (9231/12473) Updating files: 74% (9266/12473) Updating files: 74% (9303/12473) Updating files: 74% (9342/12473) Updating files: 75% (9355/12473) Updating files: 75% (9377/12473) Updating files: 75% (9417/12473) Updating files: 75% (9462/12473) Updating files: 76% (9480/12473) Updating files: 76% (9500/12473) Updating files: 76% (9550/12473) Updating files: 76% (9602/12473) Updating files: 77% (9605/12473) Updating files: 77% (9652/12473) Updating files: 77% (9705/12473) Updating files: 78% (9729/12473) Updating files: 78% (9742/12473) Updating files: 78% (9799/12473) Updating files: 79% (9854/12473) Updating files: 79% (9855/12473) Updating files: 79% (9883/12473) Updating files: 79% (9909/12473) Updating files: 79% (9929/12473) Updating files: 79% (9931/12473) Updating files: 80% (9979/12473) Updating files: 80% (10037/12473) Updating files: 80% (10084/12473) Updating files: 81% (10104/12473) Updating files: 81% (10137/12473) Updating files: 81% (10216/12473) Updating files: 82% (10228/12473) Updating files: 82% (10275/12473) Updating files: 82% (10340/12473) Updating files: 83% (10353/12473) Updating files: 83% (10410/12473) Updating files: 84% (10478/12473) Updating files: 84% (10510/12473) Updating files: 84% (10599/12473) Updating files: 85% (10603/12473) Updating files: 85% (10681/12473) Updating files: 86% (10727/12473) Updating files: 86% (10765/12473) Updating files: 86% (10848/12473) Updating files: 87% (10852/12473) Updating files: 87% (10914/12473) Updating files: 87% (10970/12473) Updating files: 88% (10977/12473) Updating files: 88% (11030/12473) Updating files: 88% (11093/12473) Updating files: 89% (11101/12473) Updating files: 89% (11137/12473) Updating files: 89% (11175/12473) Updating files: 90% (11226/12473) Updating files: 90% (11239/12473) Updating files: 90% (11301/12473) Updating files: 91% (11351/12473) Updating files: 91% (11376/12473) Updating files: 91% (11448/12473) Updating files: 92% (11476/12473) Updating files: 92% (11524/12473) Updating files: 92% (11585/12473) Updating files: 93% (11600/12473) Updating files: 93% (11650/12473) Updating files: 94% (11725/12473) Updating files: 94% (11726/12473) Updating files: 94% (11792/12473) Updating files: 94% (11846/12473) Updating files: 95% (11850/12473) Updating files: 95% (11936/12473) Updating files: 96% (11975/12473) Updating files: 96% (12026/12473) Updating files: 97% (12099/12473) Updating files: 97% (12101/12473) Updating files: 97% (12177/12473) Updating files: 98% (12224/12473) Updating files: 98% (12280/12473) Updating files: 98% (12348/12473) Updating files: 99% (12349/12473) Updating files: 99% (12413/12473) Updating files: 100% (12473/12473) Updating files: 100% (12473/12473), done. 2024-04-12T19:57:53.168 INFO:tasks.workunit.client.0.smithi131.stderr:+ trap - EXIT 2024-04-12T19:57:53.168 INFO:tasks.workunit.client.0.smithi131.stderr:+ cd ceph 2024-04-12T19:57:53.176 INFO:tasks.workunit.client.0.smithi131.stderr:++ seq 1 90 2024-04-12T19:57:53.179 INFO:tasks.workunit.client.0.smithi131.stderr:+ versions='1 2024-04-12T19:57:53.179 INFO:tasks.workunit.client.0.smithi131.stderr:2 2024-04-12T19:57:53.179 INFO:tasks.workunit.client.0.smithi131.stderr:3 2024-04-12T19:57:53.179 INFO:tasks.workunit.client.0.smithi131.stderr:4 2024-04-12T19:57:53.179 INFO:tasks.workunit.client.0.smithi131.stderr:5 2024-04-12T19:57:53.179 INFO:tasks.workunit.client.0.smithi131.stderr:6 2024-04-12T19:57:53.179 INFO:tasks.workunit.client.0.smithi131.stderr:7 2024-04-12T19:57:53.179 INFO:tasks.workunit.client.0.smithi131.stderr:8 2024-04-12T19:57:53.179 INFO:tasks.workunit.client.0.smithi131.stderr:9 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:10 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:11 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:12 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:13 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:14 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:15 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:16 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:17 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:18 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:19 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:20 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:21 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:22 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:23 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:24 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:25 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:26 2024-04-12T19:57:53.180 INFO:tasks.workunit.client.0.smithi131.stderr:27 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:28 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:29 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:30 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:31 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:32 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:33 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:34 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:35 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:36 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:37 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:38 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:39 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:40 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:41 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:42 2024-04-12T19:57:53.181 INFO:tasks.workunit.client.0.smithi131.stderr:43 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:44 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:45 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:46 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:47 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:48 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:49 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:50 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:51 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:52 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:53 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:54 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:55 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:56 2024-04-12T19:57:53.182 INFO:tasks.workunit.client.0.smithi131.stderr:57 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:58 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:59 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:60 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:61 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:62 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:63 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:64 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:65 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:66 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:67 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:68 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:69 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:70 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:71 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:72 2024-04-12T19:57:53.183 INFO:tasks.workunit.client.0.smithi131.stderr:73 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:74 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:75 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:76 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:77 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:78 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:79 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:80 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:81 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:82 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:83 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:84 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:85 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:86 2024-04-12T19:57:53.184 INFO:tasks.workunit.client.0.smithi131.stderr:87 2024-04-12T19:57:53.185 INFO:tasks.workunit.client.0.smithi131.stderr:88 2024-04-12T19:57:53.185 INFO:tasks.workunit.client.0.smithi131.stderr:89 2024-04-12T19:57:53.185 INFO:tasks.workunit.client.0.smithi131.stderr:90' 2024-04-12T19:57:53.185 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T19:57:53.185 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 1 -eq 48 ']' 2024-04-12T19:57:53.185 INFO:tasks.workunit.client.0.smithi131.stdout:v0.1 2024-04-12T19:57:53.185 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.1 2024-04-12T19:57:53.185 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.1 2024-04-12T19:57:53.185 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.1 2024-04-12T19:58:15.539 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:58:15.547 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:58:45.691 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:58:45.700 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:59:15.836 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:59:15.841 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:59:49.717 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T19:59:49.725 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:00:19.869 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:00:19.879 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:00:46.145 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 0% (131/13263) Updating files: 1% (133/13263) Updating files: 1% (239/13263) Updating files: 2% (266/13263) Updating files: 2% (325/13263) Updating files: 3% (398/13263) Updating files: 3% (454/13263) Updating files: 4% (531/13263) Updating files: 4% (560/13263) Updating files: 5% (664/13263) Updating files: 5% (685/13263) Updating files: 5% (791/13263) Updating files: 6% (796/13263) Updating files: 6% (912/13263) Updating files: 7% (929/13263) Updating files: 7% (990/13263) Updating files: 8% (1062/13263) Updating files: 8% (1076/13263) Updating files: 8% (1161/13263) Updating files: 9% (1194/13263) Updating files: 9% (1226/13263) Updating files: 10% (1327/13263) Updating files: 10% (1330/13263) Updating files: 10% (1412/13263) Updating files: 11% (1459/13263) Updating files: 11% (1502/13263) Updating files: 11% (1571/13263) Updating files: 12% (1592/13263) Updating files: 12% (1626/13263) Updating files: 12% (1696/13263) Updating files: 13% (1725/13263) Updating files: 13% (1756/13263) Updating files: 13% (1806/13263) Updating files: 14% (1857/13263) Updating files: 14% (1872/13263) Updating files: 14% (1948/13263) Updating files: 15% (1990/13263) Updating files: 15% (2004/13263) Updating files: 15% (2069/13263) Updating files: 16% (2123/13263) Updating files: 16% (2127/13263) Updating files: 16% (2189/13263) Updating files: 16% (2242/13263) Updating files: 17% (2255/13263) Updating files: 17% (2299/13263) Updating files: 17% (2352/13263) Updating files: 18% (2388/13263) Updating files: 18% (2400/13263) Updating files: 18% (2461/13263) Updating files: 18% (2519/13263) Updating files: 19% (2520/13263) Updating files: 19% (2555/13263) Updating files: 19% (2609/13263) Updating files: 20% (2653/13263) Updating files: 20% (2660/13263) Updating files: 20% (2723/13263) Updating files: 20% (2783/13263) Updating files: 21% (2786/13263) Updating files: 21% (2841/13263) Updating files: 22% (2918/13263) Updating files: 22% (2919/13263) Updating files: 22% (2983/13263) Updating files: 23% (3051/13263) Updating files: 23% (3125/13263) Updating files: 23% (3174/13263) Updating files: 24% (3184/13263) Updating files: 24% (3264/13263) Updating files: 25% (3316/13263) Updating files: 25% (3338/13263) Updating files: 25% (3422/13263) Updating files: 26% (3449/13263) Updating files: 26% (3485/13263) Updating files: 26% (3560/13263) Updating files: 27% (3582/13263) Updating files: 27% (3628/13263) Updating files: 27% (3695/13263) Updating files: 28% (3714/13263) Updating files: 28% (3758/13263) Updating files: 28% (3821/13263) Updating files: 29% (3847/13263) Updating files: 29% (3889/13263) Updating files: 29% (3959/13263) Updating files: 30% (3979/13263) Updating files: 30% (4030/13263) Updating files: 30% (4099/13263) Updating files: 31% (4112/13263) Updating files: 31% (4177/13263) Updating files: 31% (4243/13263) Updating files: 32% (4245/13263) Updating files: 32% (4309/13263) Updating files: 32% (4373/13263) Updating files: 33% (4377/13263) Updating files: 33% (4427/13263) Updating files: 33% (4499/13263) Updating files: 34% (4510/13263) Updating files: 34% (4562/13263) Updating files: 35% (4643/13263) Updating files: 35% (4681/13263) Updating files: 36% (4775/13263) Updating files: 36% (4805/13263) Updating files: 36% (4894/13263) Updating files: 37% (4908/13263) Updating files: 37% (4989/13263) Updating files: 38% (5040/13263) Updating files: 38% (5077/13263) Updating files: 39% (5173/13263) Updating files: 39% (5259/13263) Updating files: 40% (5306/13263) Updating files: 40% (5317/13263) Updating files: 40% (5360/13263) Updating files: 40% (5425/13263) Updating files: 41% (5438/13263) Updating files: 41% (5512/13263) Updating files: 42% (5571/13263) Updating files: 42% (5606/13263) Updating files: 42% (5687/13263) Updating files: 43% (5704/13263) Updating files: 44% (5836/13263) Updating files: 44% (5848/13263) Updating files: 45% (5969/13263) Updating files: 45% (5989/13263) Updating files: 45% (6094/13263) Updating files: 46% (6101/13263) Updating files: 46% (6169/13263) Updating files: 47% (6234/13263) Updating files: 47% (6254/13263) Updating files: 48% (6367/13263) Updating files: 48% (6368/13263) Updating files: 48% (6424/13263) Updating files: 48% (6477/13263) Updating files: 49% (6499/13263) Updating files: 49% (6579/13263) Updating files: 50% (6632/13263) Updating files: 50% (6664/13263) Updating files: 51% (6765/13263) Updating files: 51% (6774/13263) Updating files: 51% (6892/13263) Updating files: 52% (6897/13263) Updating files: 52% (7008/13263) Updating files: 53% (7030/13263) Updating files: 53% (7127/13263) Updating files: 54% (7163/13263) Updating files: 54% (7231/13263) Updating files: 55% (7295/13263) Updating files: 55% (7352/13263) Updating files: 56% (7428/13263) Updating files: 56% (7527/13263) Updating files: 57% (7560/13263) Updating files: 57% (7656/13263) Updating files: 58% (7693/13263) Updating files: 58% (7742/13263) Updating files: 59% (7826/13263) Updating files: 59% (7856/13263) Updating files: 59% (7938/13263) Updating files: 60% (7958/13263) Updating files: 60% (8027/13263) Updating files: 61% (8091/13263) Updating files: 61% (8099/13263) Updating files: 61% (8158/13263) Updating files: 61% (8202/13263) Updating files: 62% (8224/13263) Updating files: 62% (8239/13263) Updating files: 62% (8282/13263) Updating files: 62% (8320/13263) Updating files: 63% (8356/13263) Updating files: 63% (8357/13263) Updating files: 63% (8396/13263) Updating files: 63% (8437/13263) Updating files: 63% (8474/13263) Updating files: 64% (8489/13263) Updating files: 64% (8514/13263) Updating files: 64% (8549/13263) Updating files: 64% (8589/13263) Updating files: 65% (8621/13263) Updating files: 65% (8630/13263) Updating files: 65% (8664/13263) Updating files: 65% (8707/13263) Updating files: 65% (8745/13263) Updating files: 66% (8754/13263) Updating files: 66% (8782/13263) Updating files: 66% (8828/13263) Updating files: 66% (8859/13263) Updating files: 67% (8887/13263) Updating files: 67% (8900/13263) Updating files: 67% (8953/13263) Updating files: 68% (9019/13263) Updating files: 68% (9027/13263) Updating files: 68% (9070/13263) Updating files: 68% (9103/13263) Updating files: 68% (9147/13263) Updating files: 69% (9152/13263) Updating files: 69% (9185/13263) Updating files: 69% (9224/13263) Updating files: 70% (9285/13263) Updating files: 70% (9286/13263) Updating files: 70% (9351/13263) Updating files: 71% (9417/13263) Updating files: 71% (9428/13263) Updating files: 71% (9512/13263) Updating files: 72% (9550/13263) Updating files: 72% (9569/13263) Updating files: 72% (9664/13263) Updating files: 73% (9682/13263) Updating files: 73% (9749/13263) Updating files: 73% (9814/13263) Updating files: 74% (9815/13263) Updating files: 74% (9882/13263) Updating files: 75% (9948/13263) Updating files: 75% (9956/13263) Updating files: 75% (10047/13263) Updating files: 76% (10080/13263) Updating files: 76% (10152/13263) Updating files: 77% (10213/13263) Updating files: 77% (10281/13263) Updating files: 78% (10346/13263) Updating files: 78% (10454/13263) Updating files: 79% (10478/13263) Updating files: 79% (10584/13263) Updating files: 80% (10611/13263) Updating files: 80% (10653/13263) Updating files: 80% (10742/13263) Updating files: 81% (10744/13263) Updating files: 81% (10835/13263) Updating files: 82% (10876/13263) Updating files: 82% (10907/13263) Updating files: 82% (10980/13263) Updating files: 83% (11009/13263) Updating files: 83% (11089/13263) Updating files: 84% (11141/13263) Updating files: 84% (11182/13263) Updating files: 85% (11274/13263) Updating files: 85% (11288/13263) Updating files: 85% (11364/13263) Updating files: 86% (11407/13263) Updating files: 86% (11451/13263) Updating files: 87% (11539/13263) Updating files: 87% (11559/13263) Updating files: 87% (11639/13263) Updating files: 88% (11672/13263) Updating files: 88% (11754/13263) Updating files: 89% (11805/13263) Updating files: 89% (11888/13263) Updating files: 90% (11937/13263) Updating files: 90% (11985/13263) Updating files: 91% (12070/13263) Updating files: 91% (12100/13263) Updating files: 91% (12188/13263) Updating files: 92% (12202/13263) Updating files: 92% (12290/13263) Updating files: 93% (12335/13263) Updating files: 93% (12372/13263) Updating files: 93% (12457/13263) Updating files: 94% (12468/13263) Updating files: 94% (12554/13263) Updating files: 95% (12600/13263) Updating files: 95% (12631/13263) Updating files: 95% (12698/13263) Updating files: 96% (12733/13263) Updating files: 96% (12765/13263) Updating files: 96% (12834/13263) Updating files: 97% (12866/13263) Updating files: 97% (12888/13263) Updating files: 97% (12956/13263) Updating files: 98% (12998/13263) Updating files: 98% (13031/13263) Updating files: 98% (13084/13263) Updating files: 99% (13131/13263) Updating files: 99% (13144/13263) Updating files: 99% (13208/13263) Updating files: 100% (13263/13263) Updating files: 100% (13263/13263), done. 2024-04-12T20:00:46.428 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 204c175eea3 msg: blobhash on entity_name_t causes strange badness... should look into that, but avoid for now 2024-04-12T20:00:46.456 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.1 2024-04-12T20:00:46.562 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:00:46.562 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 2 -eq 48 ']' 2024-04-12T20:00:46.562 INFO:tasks.workunit.client.0.smithi131.stdout:v0.2 2024-04-12T20:00:46.562 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.2 2024-04-12T20:00:46.562 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.2 2024-04-12T20:00:46.562 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.2 2024-04-12T20:00:50.024 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:00:50.033 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:00:53.303 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 20% (46/222) Updating files: 21% (47/222) Updating files: 22% (49/222) Updating files: 23% (52/222) Updating files: 24% (54/222) Updating files: 25% (56/222) Updating files: 26% (58/222) Updating files: 27% (60/222) Updating files: 28% (63/222) Updating files: 29% (65/222) Updating files: 30% (67/222) Updating files: 31% (69/222) Updating files: 32% (72/222) Updating files: 33% (74/222) Updating files: 34% (76/222) Updating files: 35% (78/222) Updating files: 36% (80/222) Updating files: 37% (83/222) Updating files: 38% (85/222) Updating files: 39% (87/222) Updating files: 40% (89/222) Updating files: 41% (92/222) Updating files: 42% (94/222) Updating files: 43% (96/222) Updating files: 44% (98/222) Updating files: 45% (100/222) Updating files: 46% (103/222) Updating files: 47% (105/222) Updating files: 48% (107/222) Updating files: 49% (109/222) Updating files: 50% (111/222) Updating files: 51% (114/222) Updating files: 52% (116/222) Updating files: 53% (118/222) Updating files: 54% (120/222) Updating files: 55% (123/222) Updating files: 56% (125/222) Updating files: 57% (127/222) Updating files: 58% (129/222) Updating files: 59% (131/222) Updating files: 60% (134/222) Updating files: 61% (136/222) Updating files: 62% (138/222) Updating files: 63% (140/222) Updating files: 64% (143/222) Updating files: 65% (145/222) Updating files: 66% (147/222) Updating files: 67% (149/222) Updating files: 68% (151/222) Updating files: 69% (154/222) Updating files: 70% (156/222) Updating files: 70% (157/222) Updating files: 71% (158/222) Updating files: 72% (160/222) Updating files: 73% (163/222) Updating files: 74% (165/222) Updating files: 75% (167/222) Updating files: 76% (169/222) Updating files: 77% (171/222) Updating files: 78% (174/222) Updating files: 79% (176/222) Updating files: 80% (178/222) Updating files: 81% (180/222) Updating files: 82% (183/222) Updating files: 83% (185/222) Updating files: 84% (187/222) Updating files: 85% (189/222) Updating files: 86% (191/222) Updating files: 87% (194/222) Updating files: 88% (196/222) Updating files: 89% (198/222) Updating files: 90% (200/222) Updating files: 91% (203/222) Updating files: 92% (205/222) Updating files: 93% (207/222) Updating files: 94% (209/222) Updating files: 95% (211/222) Updating files: 96% (214/222) Updating files: 97% (216/222) Updating files: 98% (218/222) Updating files: 99% (220/222) Updating files: 100% (222/222) Updating files: 100% (222/222), done. 2024-04-12T20:00:53.627 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 2b5f76f48e9 readme 2024-04-12T20:00:53.649 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.2 2024-04-12T20:00:53.708 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:00:53.708 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 3 -eq 48 ']' 2024-04-12T20:00:53.708 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.3 2024-04-12T20:00:53.708 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.3 2024-04-12T20:00:53.709 INFO:tasks.workunit.client.0.smithi131.stdout:v0.3 2024-04-12T20:00:53.709 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.3 2024-04-12T20:01:02.018 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 21% (63/295) Updating files: 22% (65/295) Updating files: 23% (68/295) Updating files: 24% (71/295) Updating files: 25% (74/295) Updating files: 26% (77/295) Updating files: 27% (80/295) Updating files: 28% (83/295) Updating files: 29% (86/295) Updating files: 30% (89/295) Updating files: 31% (92/295) Updating files: 32% (95/295) Updating files: 33% (98/295) Updating files: 34% (101/295) Updating files: 35% (104/295) Updating files: 36% (107/295) Updating files: 37% (110/295) Updating files: 38% (113/295) Updating files: 39% (116/295) Updating files: 40% (118/295) Updating files: 41% (121/295) Updating files: 42% (124/295) Updating files: 43% (127/295) Updating files: 44% (130/295) Updating files: 45% (133/295) Updating files: 46% (136/295) Updating files: 47% (139/295) Updating files: 48% (142/295) Updating files: 49% (145/295) Updating files: 50% (148/295) Updating files: 51% (151/295) Updating files: 52% (154/295) Updating files: 52% (156/295) Updating files: 53% (157/295) Updating files: 54% (160/295) Updating files: 55% (163/295) Updating files: 56% (166/295) Updating files: 57% (169/295) Updating files: 58% (172/295) Updating files: 59% (175/295) Updating files: 60% (177/295) Updating files: 61% (180/295) Updating files: 62% (183/295) Updating files: 63% (186/295) Updating files: 64% (189/295) Updating files: 65% (192/295) Updating files: 66% (195/295) Updating files: 67% (198/295) Updating files: 68% (201/295) Updating files: 69% (204/295) Updating files: 70% (207/295) Updating files: 71% (210/295) Updating files: 71% (211/295) Updating files: 72% (213/295) Updating files: 73% (216/295) Updating files: 74% (219/295) Updating files: 75% (222/295) Updating files: 76% (225/295) Updating files: 77% (228/295) Updating files: 78% (231/295) Updating files: 79% (234/295) Updating files: 80% (236/295) Updating files: 81% (239/295) Updating files: 82% (242/295) Updating files: 83% (245/295) Updating files: 84% (248/295) Updating files: 85% (251/295) Updating files: 85% (252/295) Updating files: 86% (254/295) Updating files: 87% (257/295) Updating files: 88% (260/295) Updating files: 89% (263/295) Updating files: 90% (266/295) Updating files: 91% (269/295) Updating files: 92% (272/295) Updating files: 93% (275/295) Updating files: 94% (278/295) Updating files: 95% (281/295) Updating files: 96% (284/295) Updating files: 97% (287/295) Updating files: 98% (290/295) Updating files: 99% (293/295) Updating files: 100% (295/295) Updating files: 100% (295/295), done. 2024-04-12T20:01:02.254 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 2e986fe9ddf include ceph.spec in configure.ac 2024-04-12T20:01:02.270 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.3 2024-04-12T20:01:02.328 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:01:02.328 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 4 -eq 48 ']' 2024-04-12T20:01:02.329 INFO:tasks.workunit.client.0.smithi131.stdout:v0.4 2024-04-12T20:01:02.329 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.4 2024-04-12T20:01:02.329 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.4 2024-04-12T20:01:02.329 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.4 2024-04-12T20:01:09.068 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 33% (82/247) Updating files: 34% (84/247) Updating files: 35% (87/247) Updating files: 36% (89/247) Updating files: 37% (92/247) Updating files: 38% (94/247) Updating files: 39% (97/247) Updating files: 40% (99/247) Updating files: 41% (102/247) Updating files: 42% (104/247) Updating files: 43% (107/247) Updating files: 44% (109/247) Updating files: 45% (112/247) Updating files: 46% (114/247) Updating files: 47% (117/247) Updating files: 48% (119/247) Updating files: 49% (122/247) Updating files: 50% (124/247) Updating files: 51% (126/247) Updating files: 52% (129/247) Updating files: 53% (131/247) Updating files: 53% (133/247) Updating files: 54% (134/247) Updating files: 55% (136/247) Updating files: 56% (139/247) Updating files: 57% (141/247) Updating files: 58% (144/247) Updating files: 59% (146/247) Updating files: 60% (149/247) Updating files: 61% (151/247) Updating files: 62% (154/247) Updating files: 63% (156/247) Updating files: 64% (159/247) Updating files: 65% (161/247) Updating files: 66% (164/247) Updating files: 67% (166/247) Updating files: 68% (168/247) Updating files: 69% (171/247) Updating files: 70% (173/247) Updating files: 71% (176/247) Updating files: 72% (178/247) Updating files: 73% (181/247) Updating files: 74% (183/247) Updating files: 74% (185/247) Updating files: 75% (186/247) Updating files: 76% (188/247) Updating files: 77% (191/247) Updating files: 78% (193/247) Updating files: 79% (196/247) Updating files: 80% (198/247) Updating files: 81% (201/247) Updating files: 82% (203/247) Updating files: 83% (206/247) Updating files: 84% (208/247) Updating files: 85% (210/247) Updating files: 86% (213/247) Updating files: 87% (215/247) Updating files: 88% (218/247) Updating files: 89% (220/247) Updating files: 90% (223/247) Updating files: 91% (225/247) Updating files: 92% (228/247) Updating files: 93% (230/247) Updating files: 94% (233/247) Updating files: 95% (235/247) Updating files: 96% (238/247) Updating files: 97% (240/247) Updating files: 98% (243/247) Updating files: 99% (245/247) Updating files: 100% (247/247) Updating files: 100% (247/247), done. 2024-04-12T20:01:09.178 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 13b1bf7c492 kclient: initializing kaddr (merge fix) 2024-04-12T20:01:09.190 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.4 2024-04-12T20:01:09.430 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:01:09.431 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 5 -eq 48 ']' 2024-04-12T20:01:09.431 INFO:tasks.workunit.client.0.smithi131.stdout:v0.5 2024-04-12T20:01:09.431 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.5 2024-04-12T20:01:09.431 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.5 2024-04-12T20:01:09.431 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.5 2024-04-12T20:01:16.607 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 26% (66/245) Updating files: 27% (67/245) Updating files: 28% (69/245) Updating files: 29% (72/245) Updating files: 30% (74/245) Updating files: 31% (76/245) Updating files: 32% (79/245) Updating files: 33% (81/245) Updating files: 34% (84/245) Updating files: 35% (86/245) Updating files: 36% (89/245) Updating files: 37% (91/245) Updating files: 38% (94/245) Updating files: 39% (96/245) Updating files: 40% (98/245) Updating files: 41% (101/245) Updating files: 42% (103/245) Updating files: 43% (106/245) Updating files: 44% (108/245) Updating files: 45% (111/245) Updating files: 46% (113/245) Updating files: 47% (116/245) Updating files: 47% (117/245) Updating files: 48% (118/245) Updating files: 49% (121/245) Updating files: 50% (123/245) Updating files: 51% (125/245) Updating files: 52% (128/245) Updating files: 53% (130/245) Updating files: 54% (133/245) Updating files: 55% (135/245) Updating files: 56% (138/245) Updating files: 57% (140/245) Updating files: 58% (143/245) Updating files: 59% (145/245) Updating files: 60% (147/245) Updating files: 61% (150/245) Updating files: 62% (152/245) Updating files: 63% (155/245) Updating files: 64% (157/245) Updating files: 65% (160/245) Updating files: 66% (162/245) Updating files: 67% (165/245) Updating files: 68% (167/245) Updating files: 69% (170/245) Updating files: 70% (172/245) Updating files: 71% (174/245) Updating files: 72% (177/245) Updating files: 73% (179/245) Updating files: 74% (182/245) Updating files: 75% (184/245) Updating files: 76% (187/245) Updating files: 77% (189/245) Updating files: 78% (192/245) Updating files: 79% (194/245) Updating files: 80% (196/245) Updating files: 81% (199/245) Updating files: 82% (201/245) Updating files: 83% (204/245) Updating files: 84% (206/245) Updating files: 85% (209/245) Updating files: 86% (211/245) Updating files: 87% (214/245) Updating files: 88% (216/245) Updating files: 89% (219/245) Updating files: 90% (221/245) Updating files: 90% (222/245) Updating files: 91% (223/245) Updating files: 92% (226/245) Updating files: 93% (228/245) Updating files: 94% (231/245) Updating files: 95% (233/245) Updating files: 96% (236/245) Updating files: 97% (238/245) Updating files: 98% (241/245) Updating files: 99% (243/245) Updating files: 100% (245/245) Updating files: 100% (245/245), done. 2024-04-12T20:01:16.883 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 1dd420957f9 journal: detect size of raw block devices properly 2024-04-12T20:01:16.909 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.5 2024-04-12T20:01:17.195 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:01:17.195 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 6 -eq 48 ']' 2024-04-12T20:01:17.195 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.6 2024-04-12T20:01:17.195 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.6 2024-04-12T20:01:17.195 INFO:tasks.workunit.client.0.smithi131.stdout:v0.6 2024-04-12T20:01:17.195 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.6 2024-04-12T20:01:20.199 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:01:20.207 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:01:24.142 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 26% (60/227) Updating files: 27% (62/227) Updating files: 28% (64/227) Updating files: 29% (66/227) Updating files: 30% (69/227) Updating files: 31% (71/227) Updating files: 32% (73/227) Updating files: 33% (75/227) Updating files: 34% (78/227) Updating files: 35% (80/227) Updating files: 36% (82/227) Updating files: 37% (84/227) Updating files: 38% (87/227) Updating files: 39% (89/227) Updating files: 40% (91/227) Updating files: 41% (94/227) Updating files: 42% (96/227) Updating files: 43% (98/227) Updating files: 44% (100/227) Updating files: 45% (103/227) Updating files: 46% (105/227) Updating files: 47% (107/227) Updating files: 48% (109/227) Updating files: 49% (112/227) Updating files: 50% (114/227) Updating files: 51% (116/227) Updating files: 52% (119/227) Updating files: 53% (121/227) Updating files: 54% (123/227) Updating files: 55% (125/227) Updating files: 56% (128/227) Updating files: 57% (130/227) Updating files: 58% (132/227) Updating files: 59% (134/227) Updating files: 60% (137/227) Updating files: 61% (139/227) Updating files: 62% (141/227) Updating files: 63% (144/227) Updating files: 64% (146/227) Updating files: 65% (148/227) Updating files: 66% (150/227) Updating files: 67% (153/227) Updating files: 68% (155/227) Updating files: 69% (157/227) Updating files: 70% (159/227) Updating files: 71% (162/227) Updating files: 72% (164/227) Updating files: 73% (166/227) Updating files: 74% (168/227) Updating files: 75% (171/227) Updating files: 76% (173/227) Updating files: 77% (175/227) Updating files: 78% (178/227) Updating files: 79% (180/227) Updating files: 80% (182/227) Updating files: 81% (184/227) Updating files: 82% (187/227) Updating files: 83% (189/227) Updating files: 84% (191/227) Updating files: 85% (193/227) Updating files: 86% (196/227) Updating files: 87% (198/227) Updating files: 88% (200/227) Updating files: 89% (203/227) Updating files: 90% (205/227) Updating files: 91% (207/227) Updating files: 92% (209/227) Updating files: 93% (212/227) Updating files: 94% (214/227) Updating files: 95% (216/227) Updating files: 96% (218/227) Updating files: 97% (221/227) Updating files: 98% (223/227) Updating files: 99% (225/227) Updating files: 100% (227/227) Updating files: 100% (227/227), done. 2024-04-12T20:01:24.753 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at a4c752df713 v0.6 2024-04-12T20:01:24.771 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.6 2024-04-12T20:01:24.848 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:01:24.848 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 7 -eq 48 ']' 2024-04-12T20:01:24.849 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.7 2024-04-12T20:01:24.849 INFO:tasks.workunit.client.0.smithi131.stdout:v0.7 2024-04-12T20:01:24.849 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.7 2024-04-12T20:01:24.849 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.7 2024-04-12T20:01:31.430 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 35% (71/201) Updating files: 36% (73/201) Updating files: 37% (75/201) Updating files: 38% (77/201) Updating files: 39% (79/201) Updating files: 40% (81/201) Updating files: 41% (83/201) Updating files: 42% (85/201) Updating files: 43% (87/201) Updating files: 44% (89/201) Updating files: 45% (91/201) Updating files: 46% (93/201) Updating files: 47% (95/201) Updating files: 48% (97/201) Updating files: 49% (99/201) Updating files: 50% (101/201) Updating files: 51% (103/201) Updating files: 52% (105/201) Updating files: 53% (107/201) Updating files: 54% (109/201) Updating files: 55% (111/201) Updating files: 56% (113/201) Updating files: 57% (115/201) Updating files: 57% (116/201) Updating files: 58% (117/201) Updating files: 59% (119/201) Updating files: 60% (121/201) Updating files: 61% (123/201) Updating files: 62% (125/201) Updating files: 63% (127/201) Updating files: 64% (129/201) Updating files: 65% (131/201) Updating files: 66% (133/201) Updating files: 67% (135/201) Updating files: 68% (137/201) Updating files: 69% (139/201) Updating files: 70% (141/201) Updating files: 71% (143/201) Updating files: 72% (145/201) Updating files: 73% (147/201) Updating files: 74% (149/201) Updating files: 75% (151/201) Updating files: 76% (153/201) Updating files: 77% (155/201) Updating files: 77% (156/201) Updating files: 78% (157/201) Updating files: 79% (159/201) Updating files: 80% (161/201) Updating files: 81% (163/201) Updating files: 82% (165/201) Updating files: 83% (167/201) Updating files: 84% (169/201) Updating files: 85% (171/201) Updating files: 86% (173/201) Updating files: 87% (175/201) Updating files: 88% (177/201) Updating files: 89% (179/201) Updating files: 90% (181/201) Updating files: 91% (183/201) Updating files: 92% (185/201) Updating files: 93% (187/201) Updating files: 94% (189/201) Updating files: 95% (191/201) Updating files: 96% (193/201) Updating files: 97% (195/201) Updating files: 98% (197/201) Updating files: 99% (199/201) Updating files: 100% (201/201) Updating files: 100% (201/201), done. 2024-04-12T20:01:31.681 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at c46e1b320c6 mkcephfs: btrfsctl -a between mkfs and mount 2024-04-12T20:01:31.702 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.7 2024-04-12T20:01:31.847 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:01:31.847 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 8 -eq 48 ']' 2024-04-12T20:01:31.847 INFO:tasks.workunit.client.0.smithi131.stdout:v0.8 2024-04-12T20:01:31.847 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.8 2024-04-12T20:01:31.848 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.8 2024-04-12T20:01:31.848 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.8 2024-04-12T20:01:38.481 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 30% (69/225) Updating files: 31% (70/225) Updating files: 32% (72/225) Updating files: 33% (75/225) Updating files: 34% (77/225) Updating files: 35% (79/225) Updating files: 36% (81/225) Updating files: 37% (84/225) Updating files: 38% (86/225) Updating files: 39% (88/225) Updating files: 40% (90/225) Updating files: 41% (93/225) Updating files: 42% (95/225) Updating files: 43% (97/225) Updating files: 44% (99/225) Updating files: 45% (102/225) Updating files: 45% (103/225) Updating files: 46% (104/225) Updating files: 47% (106/225) Updating files: 48% (108/225) Updating files: 49% (111/225) Updating files: 50% (113/225) Updating files: 51% (115/225) Updating files: 52% (117/225) Updating files: 53% (120/225) Updating files: 54% (122/225) Updating files: 55% (124/225) Updating files: 56% (126/225) Updating files: 57% (129/225) Updating files: 58% (131/225) Updating files: 59% (133/225) Updating files: 60% (135/225) Updating files: 61% (138/225) Updating files: 62% (140/225) Updating files: 63% (142/225) Updating files: 64% (144/225) Updating files: 65% (147/225) Updating files: 66% (149/225) Updating files: 67% (151/225) Updating files: 68% (153/225) Updating files: 69% (156/225) Updating files: 70% (158/225) Updating files: 71% (160/225) Updating files: 72% (162/225) Updating files: 73% (165/225) Updating files: 74% (167/225) Updating files: 75% (169/225) Updating files: 76% (171/225) Updating files: 77% (174/225) Updating files: 78% (176/225) Updating files: 79% (178/225) Updating files: 80% (180/225) Updating files: 81% (183/225) Updating files: 82% (185/225) Updating files: 83% (187/225) Updating files: 84% (189/225) Updating files: 85% (192/225) Updating files: 86% (194/225) Updating files: 87% (196/225) Updating files: 88% (198/225) Updating files: 89% (201/225) Updating files: 90% (203/225) Updating files: 91% (205/225) Updating files: 92% (207/225) Updating files: 93% (210/225) Updating files: 94% (212/225) Updating files: 94% (213/225) Updating files: 95% (214/225) Updating files: 96% (216/225) Updating files: 97% (219/225) Updating files: 98% (221/225) Updating files: 99% (223/225) Updating files: 100% (225/225) Updating files: 100% (225/225), done. 2024-04-12T20:01:38.709 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 284161c00ab kclient: kill dput/d_drop debug cruft 2024-04-12T20:01:38.727 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.8 2024-04-12T20:01:38.985 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:01:38.985 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 9 -eq 48 ']' 2024-04-12T20:01:38.985 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.9 2024-04-12T20:01:38.985 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.9 2024-04-12T20:01:38.985 INFO:tasks.workunit.client.0.smithi131.stdout:v0.9 2024-04-12T20:01:38.986 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.9 2024-04-12T20:01:45.541 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 29% (56/193) Updating files: 30% (58/193) Updating files: 31% (60/193) Updating files: 32% (62/193) Updating files: 33% (64/193) Updating files: 34% (66/193) Updating files: 35% (68/193) Updating files: 36% (70/193) Updating files: 37% (72/193) Updating files: 38% (74/193) Updating files: 39% (76/193) Updating files: 40% (78/193) Updating files: 41% (80/193) Updating files: 42% (82/193) Updating files: 43% (83/193) Updating files: 44% (85/193) Updating files: 45% (87/193) Updating files: 46% (89/193) Updating files: 47% (91/193) Updating files: 48% (93/193) Updating files: 49% (95/193) Updating files: 50% (97/193) Updating files: 51% (99/193) Updating files: 52% (101/193) Updating files: 52% (102/193) Updating files: 53% (103/193) Updating files: 54% (105/193) Updating files: 55% (107/193) Updating files: 56% (109/193) Updating files: 57% (111/193) Updating files: 58% (112/193) Updating files: 59% (114/193) Updating files: 60% (116/193) Updating files: 61% (118/193) Updating files: 62% (120/193) Updating files: 63% (122/193) Updating files: 64% (124/193) Updating files: 65% (126/193) Updating files: 66% (128/193) Updating files: 67% (130/193) Updating files: 68% (132/193) Updating files: 69% (134/193) Updating files: 70% (136/193) Updating files: 71% (138/193) Updating files: 72% (139/193) Updating files: 73% (141/193) Updating files: 74% (143/193) Updating files: 75% (145/193) Updating files: 76% (147/193) Updating files: 77% (149/193) Updating files: 78% (151/193) Updating files: 79% (153/193) Updating files: 80% (155/193) Updating files: 80% (156/193) Updating files: 81% (157/193) Updating files: 82% (159/193) Updating files: 83% (161/193) Updating files: 84% (163/193) Updating files: 85% (165/193) Updating files: 86% (166/193) Updating files: 87% (168/193) Updating files: 88% (170/193) Updating files: 89% (172/193) Updating files: 90% (174/193) Updating files: 91% (176/193) Updating files: 92% (178/193) Updating files: 93% (180/193) Updating files: 94% (182/193) Updating files: 95% (184/193) Updating files: 96% (186/193) Updating files: 97% (188/193) Updating files: 98% (190/193) Updating files: 99% (192/193) Updating files: 100% (193/193) Updating files: 100% (193/193), done. 2024-04-12T20:01:45.897 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 41481853924 kclient: strip out kernel version compatibility cruft 2024-04-12T20:01:45.917 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.9 2024-04-12T20:01:46.000 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:01:46.000 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 10 -eq 48 ']' 2024-04-12T20:01:46.000 INFO:tasks.workunit.client.0.smithi131.stdout:v0.10 2024-04-12T20:01:46.000 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.10 2024-04-12T20:01:46.000 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.10 2024-04-12T20:01:46.001 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.10 2024-04-12T20:01:50.345 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:01:50.355 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:01:52.315 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 23% (39/164) Updating files: 24% (40/164) Updating files: 25% (41/164) Updating files: 26% (43/164) Updating files: 27% (45/164) Updating files: 28% (46/164) Updating files: 29% (48/164) Updating files: 30% (50/164) Updating files: 31% (51/164) Updating files: 32% (53/164) Updating files: 33% (55/164) Updating files: 34% (56/164) Updating files: 35% (58/164) Updating files: 36% (60/164) Updating files: 37% (61/164) Updating files: 38% (63/164) Updating files: 39% (64/164) Updating files: 40% (66/164) Updating files: 41% (68/164) Updating files: 42% (69/164) Updating files: 43% (71/164) Updating files: 44% (73/164) Updating files: 45% (74/164) Updating files: 46% (76/164) Updating files: 47% (78/164) Updating files: 48% (79/164) Updating files: 49% (81/164) Updating files: 50% (82/164) Updating files: 50% (83/164) Updating files: 51% (84/164) Updating files: 52% (86/164) Updating files: 53% (87/164) Updating files: 54% (89/164) Updating files: 55% (91/164) Updating files: 56% (92/164) Updating files: 57% (94/164) Updating files: 58% (96/164) Updating files: 59% (97/164) Updating files: 60% (99/164) Updating files: 61% (101/164) Updating files: 62% (102/164) Updating files: 63% (104/164) Updating files: 64% (105/164) Updating files: 65% (107/164) Updating files: 66% (109/164) Updating files: 67% (110/164) Updating files: 68% (112/164) Updating files: 69% (114/164) Updating files: 70% (115/164) Updating files: 71% (117/164) Updating files: 72% (119/164) Updating files: 73% (120/164) Updating files: 74% (122/164) Updating files: 75% (123/164) Updating files: 76% (125/164) Updating files: 77% (127/164) Updating files: 78% (128/164) Updating files: 79% (130/164) Updating files: 80% (132/164) Updating files: 81% (133/164) Updating files: 82% (135/164) Updating files: 82% (136/164) Updating files: 83% (137/164) Updating files: 84% (138/164) Updating files: 85% (140/164) Updating files: 86% (142/164) Updating files: 87% (143/164) Updating files: 88% (145/164) Updating files: 89% (146/164) Updating files: 90% (148/164) Updating files: 91% (150/164) Updating files: 92% (151/164) Updating files: 93% (153/164) Updating files: 94% (155/164) Updating files: 95% (156/164) Updating files: 96% (158/164) Updating files: 97% (160/164) Updating files: 98% (161/164) Updating files: 99% (163/164) Updating files: 100% (164/164) Updating files: 100% (164/164), done. 2024-04-12T20:01:52.655 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 007313fe844 v0.10 2024-04-12T20:01:52.679 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.10 2024-04-12T20:01:52.865 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:01:52.865 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 11 -eq 48 ']' 2024-04-12T20:01:52.866 INFO:tasks.workunit.client.0.smithi131.stdout:v0.11 2024-04-12T20:01:52.866 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.11 2024-04-12T20:01:52.866 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.11 2024-04-12T20:01:52.867 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.11 2024-04-12T20:01:57.313 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 72% (50/69) Updating files: 73% (51/69) Updating files: 75% (52/69) Updating files: 76% (53/69) Updating files: 78% (54/69) Updating files: 79% (55/69) Updating files: 81% (56/69) Updating files: 82% (57/69) Updating files: 84% (58/69) Updating files: 85% (59/69) Updating files: 86% (60/69) Updating files: 88% (61/69) Updating files: 89% (62/69) Updating files: 91% (63/69) Updating files: 92% (64/69) Updating files: 94% (65/69) Updating files: 95% (66/69) Updating files: 97% (67/69) Updating files: 98% (68/69) Updating files: 100% (69/69) Updating files: 100% (69/69), done. 2024-04-12T20:01:57.702 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 9fa6f5e7d09 v0.11 2024-04-12T20:01:57.715 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.11 2024-04-12T20:01:57.973 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:01:57.974 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 12 -eq 48 ']' 2024-04-12T20:01:57.974 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.12 2024-04-12T20:01:57.974 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.12 2024-04-12T20:01:57.974 INFO:tasks.workunit.client.0.smithi131.stdout:v0.12 2024-04-12T20:01:57.974 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.12 2024-04-12T20:02:02.866 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 61% (46/75) Updating files: 62% (47/75) Updating files: 64% (48/75) Updating files: 65% (49/75) Updating files: 66% (50/75) Updating files: 68% (51/75) Updating files: 69% (52/75) Updating files: 70% (53/75) Updating files: 72% (54/75) Updating files: 73% (55/75) Updating files: 74% (56/75) Updating files: 76% (57/75) Updating files: 77% (58/75) Updating files: 78% (59/75) Updating files: 80% (60/75) Updating files: 81% (61/75) Updating files: 82% (62/75) Updating files: 84% (63/75) Updating files: 85% (64/75) Updating files: 86% (65/75) Updating files: 88% (66/75) Updating files: 89% (67/75) Updating files: 90% (68/75) Updating files: 92% (69/75) Updating files: 93% (70/75) Updating files: 94% (71/75) Updating files: 96% (72/75) Updating files: 97% (73/75) Updating files: 98% (74/75) Updating files: 100% (75/75) Updating files: 100% (75/75), done. 2024-04-12T20:02:03.137 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at f524150822a v0.12 2024-04-12T20:02:03.158 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.12 2024-04-12T20:02:03.380 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:02:03.380 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 13 -eq 48 ']' 2024-04-12T20:02:03.380 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.13 2024-04-12T20:02:03.380 INFO:tasks.workunit.client.0.smithi131.stdout:v0.13 2024-04-12T20:02:03.381 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.13 2024-04-12T20:02:03.381 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.13 2024-04-12T20:02:09.187 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 40% (54/133) Updating files: 41% (55/133) Updating files: 42% (56/133) Updating files: 43% (58/133) Updating files: 44% (59/133) Updating files: 45% (60/133) Updating files: 46% (62/133) Updating files: 47% (63/133) Updating files: 48% (64/133) Updating files: 49% (66/133) Updating files: 50% (67/133) Updating files: 51% (68/133) Updating files: 52% (70/133) Updating files: 53% (71/133) Updating files: 54% (72/133) Updating files: 55% (74/133) Updating files: 56% (75/133) Updating files: 57% (76/133) Updating files: 58% (78/133) Updating files: 59% (79/133) Updating files: 60% (80/133) Updating files: 61% (82/133) Updating files: 62% (83/133) Updating files: 63% (84/133) Updating files: 64% (86/133) Updating files: 65% (87/133) Updating files: 66% (88/133) Updating files: 67% (90/133) Updating files: 68% (91/133) Updating files: 69% (92/133) Updating files: 69% (93/133) Updating files: 70% (94/133) Updating files: 71% (95/133) Updating files: 72% (96/133) Updating files: 73% (98/133) Updating files: 74% (99/133) Updating files: 75% (100/133) Updating files: 76% (102/133) Updating files: 77% (103/133) Updating files: 78% (104/133) Updating files: 79% (106/133) Updating files: 80% (107/133) Updating files: 81% (108/133) Updating files: 82% (110/133) Updating files: 83% (111/133) Updating files: 84% (112/133) Updating files: 85% (114/133) Updating files: 86% (115/133) Updating files: 87% (116/133) Updating files: 88% (118/133) Updating files: 89% (119/133) Updating files: 90% (120/133) Updating files: 91% (122/133) Updating files: 92% (123/133) Updating files: 93% (124/133) Updating files: 94% (126/133) Updating files: 95% (127/133) Updating files: 96% (128/133) Updating files: 97% (130/133) Updating files: 98% (131/133) Updating files: 99% (132/133) Updating files: 100% (133/133) Updating files: 100% (133/133), done. 2024-04-12T20:02:09.435 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 2b32297267d v0.13 2024-04-12T20:02:09.452 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.13 2024-04-12T20:02:09.589 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:02:09.589 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 14 -eq 48 ']' 2024-04-12T20:02:09.589 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.14 2024-04-12T20:02:09.590 INFO:tasks.workunit.client.0.smithi131.stdout:v0.14 2024-04-12T20:02:09.590 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.14 2024-04-12T20:02:09.590 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.14 2024-04-12T20:02:15.389 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 37% (56/151) Updating files: 38% (58/151) Updating files: 39% (59/151) Updating files: 40% (61/151) Updating files: 41% (62/151) Updating files: 42% (64/151) Updating files: 43% (65/151) Updating files: 44% (67/151) Updating files: 45% (68/151) Updating files: 46% (70/151) Updating files: 47% (71/151) Updating files: 48% (73/151) Updating files: 49% (74/151) Updating files: 50% (76/151) Updating files: 51% (78/151) Updating files: 52% (79/151) Updating files: 53% (81/151) Updating files: 54% (82/151) Updating files: 55% (84/151) Updating files: 56% (85/151) Updating files: 57% (87/151) Updating files: 58% (88/151) Updating files: 59% (90/151) Updating files: 60% (91/151) Updating files: 61% (93/151) Updating files: 62% (94/151) Updating files: 63% (96/151) Updating files: 64% (97/151) Updating files: 65% (99/151) Updating files: 66% (100/151) Updating files: 67% (102/151) Updating files: 68% (103/151) Updating files: 69% (105/151) Updating files: 70% (106/151) Updating files: 71% (108/151) Updating files: 72% (109/151) Updating files: 73% (111/151) Updating files: 74% (112/151) Updating files: 75% (114/151) Updating files: 76% (115/151) Updating files: 77% (117/151) Updating files: 78% (118/151) Updating files: 79% (120/151) Updating files: 80% (121/151) Updating files: 81% (123/151) Updating files: 82% (124/151) Updating files: 83% (126/151) Updating files: 84% (127/151) Updating files: 85% (129/151) Updating files: 86% (130/151) Updating files: 87% (132/151) Updating files: 88% (133/151) Updating files: 89% (135/151) Updating files: 90% (136/151) Updating files: 91% (138/151) Updating files: 92% (139/151) Updating files: 93% (141/151) Updating files: 94% (142/151) Updating files: 95% (144/151) Updating files: 96% (145/151) Updating files: 97% (147/151) Updating files: 98% (148/151) Updating files: 99% (150/151) Updating files: 100% (151/151) Updating files: 100% (151/151), done. 2024-04-12T20:02:15.746 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 1ec1e8d6fb6 v0.14 2024-04-12T20:02:15.762 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.14 2024-04-12T20:02:15.894 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:02:15.895 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 15 -eq 48 ']' 2024-04-12T20:02:15.895 INFO:tasks.workunit.client.0.smithi131.stdout:v0.15 2024-04-12T20:02:15.895 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.15 2024-04-12T20:02:15.895 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.15 2024-04-12T20:02:15.896 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.15 2024-04-12T20:02:20.484 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:02:20.495 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:02:21.303 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 40% (45/112) Updating files: 41% (46/112) Updating files: 42% (48/112) Updating files: 43% (49/112) Updating files: 44% (50/112) Updating files: 45% (51/112) Updating files: 46% (52/112) Updating files: 47% (53/112) Updating files: 48% (54/112) Updating files: 49% (55/112) Updating files: 50% (56/112) Updating files: 51% (58/112) Updating files: 52% (59/112) Updating files: 53% (60/112) Updating files: 54% (61/112) Updating files: 55% (62/112) Updating files: 56% (63/112) Updating files: 57% (64/112) Updating files: 58% (65/112) Updating files: 59% (67/112) Updating files: 60% (68/112) Updating files: 61% (69/112) Updating files: 62% (70/112) Updating files: 63% (71/112) Updating files: 64% (72/112) Updating files: 65% (73/112) Updating files: 66% (74/112) Updating files: 67% (76/112) Updating files: 68% (77/112) Updating files: 69% (78/112) Updating files: 70% (79/112) Updating files: 71% (80/112) Updating files: 72% (81/112) Updating files: 73% (82/112) Updating files: 74% (83/112) Updating files: 75% (84/112) Updating files: 76% (86/112) Updating files: 77% (87/112) Updating files: 78% (88/112) Updating files: 79% (89/112) Updating files: 80% (90/112) Updating files: 81% (91/112) Updating files: 82% (92/112) Updating files: 83% (93/112) Updating files: 84% (95/112) Updating files: 85% (96/112) Updating files: 86% (97/112) Updating files: 87% (98/112) Updating files: 88% (99/112) Updating files: 89% (100/112) Updating files: 90% (101/112) Updating files: 91% (102/112) Updating files: 92% (104/112) Updating files: 93% (105/112) Updating files: 94% (106/112) Updating files: 95% (107/112) Updating files: 96% (108/112) Updating files: 97% (109/112) Updating files: 98% (110/112) Updating files: 99% (111/112) Updating files: 100% (112/112) Updating files: 100% (112/112), done. 2024-04-12T20:02:21.550 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at ab3c421eb95 v0.15 2024-04-12T20:02:21.566 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.15 2024-04-12T20:02:21.781 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:02:21.781 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 16 -eq 48 ']' 2024-04-12T20:02:21.781 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.16 2024-04-12T20:02:21.781 INFO:tasks.workunit.client.0.smithi131.stdout:v0.16 2024-04-12T20:02:21.782 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.16 2024-04-12T20:02:21.782 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.16 2024-04-12T20:02:27.067 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 48% (52/107) Updating files: 49% (53/107) Updating files: 50% (54/107) Updating files: 51% (55/107) Updating files: 52% (56/107) Updating files: 53% (57/107) Updating files: 54% (58/107) Updating files: 55% (59/107) Updating files: 56% (60/107) Updating files: 57% (61/107) Updating files: 58% (63/107) Updating files: 59% (64/107) Updating files: 60% (65/107) Updating files: 61% (66/107) Updating files: 62% (67/107) Updating files: 63% (68/107) Updating files: 64% (69/107) Updating files: 65% (70/107) Updating files: 66% (71/107) Updating files: 67% (72/107) Updating files: 68% (73/107) Updating files: 69% (74/107) Updating files: 70% (75/107) Updating files: 71% (76/107) Updating files: 72% (78/107) Updating files: 73% (79/107) Updating files: 74% (80/107) Updating files: 75% (81/107) Updating files: 76% (82/107) Updating files: 77% (83/107) Updating files: 78% (84/107) Updating files: 79% (85/107) Updating files: 80% (86/107) Updating files: 81% (87/107) Updating files: 82% (88/107) Updating files: 83% (89/107) Updating files: 84% (90/107) Updating files: 85% (91/107) Updating files: 86% (93/107) Updating files: 87% (94/107) Updating files: 88% (95/107) Updating files: 89% (96/107) Updating files: 90% (97/107) Updating files: 91% (98/107) Updating files: 92% (99/107) Updating files: 93% (100/107) Updating files: 94% (101/107) Updating files: 95% (102/107) Updating files: 96% (103/107) Updating files: 97% (104/107) Updating files: 98% (105/107) Updating files: 99% (106/107) Updating files: 100% (107/107) Updating files: 100% (107/107), done. 2024-04-12T20:02:27.398 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 38dbaa5175c v0.16 2024-04-12T20:02:27.411 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.16 2024-04-12T20:02:27.489 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:02:27.490 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 17 -eq 48 ']' 2024-04-12T20:02:27.490 INFO:tasks.workunit.client.0.smithi131.stdout:v0.17 2024-04-12T20:02:27.490 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.17 2024-04-12T20:02:27.490 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.17 2024-04-12T20:02:27.490 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.17 2024-04-12T20:02:33.631 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 43% (94/217) Updating files: 44% (96/217) Updating files: 45% (98/217) Updating files: 46% (100/217) Updating files: 47% (102/217) Updating files: 48% (105/217) Updating files: 49% (107/217) Updating files: 50% (109/217) Updating files: 51% (111/217) Updating files: 52% (113/217) Updating files: 53% (116/217) Updating files: 54% (118/217) Updating files: 55% (120/217) Updating files: 56% (122/217) Updating files: 57% (124/217) Updating files: 58% (126/217) Updating files: 59% (129/217) Updating files: 60% (131/217) Updating files: 61% (133/217) Updating files: 62% (135/217) Updating files: 63% (137/217) Updating files: 64% (139/217) Updating files: 65% (142/217) Updating files: 66% (144/217) Updating files: 67% (146/217) Updating files: 68% (148/217) Updating files: 69% (150/217) Updating files: 70% (152/217) Updating files: 71% (155/217) Updating files: 72% (157/217) Updating files: 73% (159/217) Updating files: 74% (161/217) Updating files: 75% (163/217) Updating files: 76% (165/217) Updating files: 77% (168/217) Updating files: 78% (170/217) Updating files: 79% (172/217) Updating files: 80% (174/217) Updating files: 81% (176/217) Updating files: 82% (178/217) Updating files: 83% (181/217) Updating files: 84% (183/217) Updating files: 85% (185/217) Updating files: 86% (187/217) Updating files: 87% (189/217) Updating files: 88% (191/217) Updating files: 89% (194/217) Updating files: 90% (196/217) Updating files: 91% (198/217) Updating files: 92% (200/217) Updating files: 93% (202/217) Updating files: 94% (204/217) Updating files: 95% (207/217) Updating files: 96% (209/217) Updating files: 97% (211/217) Updating files: 98% (213/217) Updating files: 99% (215/217) Updating files: 100% (217/217) Updating files: 100% (217/217), done. 2024-04-12T20:02:33.865 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at dac3a8c35fb v0.17 2024-04-12T20:02:33.879 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.17 2024-04-12T20:02:34.037 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:02:34.037 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 18 -eq 48 ']' 2024-04-12T20:02:34.037 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.18 2024-04-12T20:02:34.037 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.18 2024-04-12T20:02:34.038 INFO:tasks.workunit.client.0.smithi131.stdout:v0.18 2024-04-12T20:02:34.038 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.18 2024-04-12T20:02:45.058 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 11% (89/779) Updating files: 12% (94/779) Updating files: 13% (102/779) Updating files: 14% (110/779) Updating files: 15% (117/779) Updating files: 16% (125/779) Updating files: 17% (133/779) Updating files: 18% (141/779) Updating files: 19% (149/779) Updating files: 20% (156/779) Updating files: 21% (164/779) Updating files: 21% (165/779) Updating files: 22% (172/779) Updating files: 23% (180/779) Updating files: 24% (187/779) Updating files: 25% (195/779) Updating files: 26% (203/779) Updating files: 27% (211/779) Updating files: 28% (219/779) Updating files: 29% (226/779) Updating files: 30% (234/779) Updating files: 31% (242/779) Updating files: 32% (250/779) Updating files: 33% (258/779) Updating files: 34% (265/779) Updating files: 35% (273/779) Updating files: 36% (281/779) Updating files: 37% (289/779) Updating files: 38% (297/779) Updating files: 39% (304/779) Updating files: 40% (312/779) Updating files: 41% (320/779) Updating files: 42% (328/779) Updating files: 43% (335/779) Updating files: 44% (343/779) Updating files: 45% (351/779) Updating files: 46% (359/779) Updating files: 47% (367/779) Updating files: 48% (374/779) Updating files: 48% (377/779) Updating files: 49% (382/779) Updating files: 50% (390/779) Updating files: 51% (398/779) Updating files: 52% (406/779) Updating files: 53% (413/779) Updating files: 54% (421/779) Updating files: 55% (429/779) Updating files: 56% (437/779) Updating files: 57% (445/779) Updating files: 58% (452/779) Updating files: 58% (453/779) Updating files: 59% (460/779) Updating files: 60% (468/779) Updating files: 61% (476/779) Updating files: 62% (483/779) Updating files: 63% (491/779) Updating files: 64% (499/779) Updating files: 65% (507/779) Updating files: 66% (515/779) Updating files: 67% (522/779) Updating files: 68% (530/779) Updating files: 69% (538/779) Updating files: 70% (546/779) Updating files: 71% (554/779) Updating files: 72% (561/779) Updating files: 73% (569/779) Updating files: 74% (577/779) Updating files: 75% (585/779) Updating files: 76% (593/779) Updating files: 76% (599/779) Updating files: 77% (600/779) Updating files: 78% (608/779) Updating files: 79% (616/779) Updating files: 80% (624/779) Updating files: 81% (631/779) Updating files: 82% (639/779) Updating files: 83% (647/779) Updating files: 84% (655/779) Updating files: 85% (663/779) Updating files: 85% (665/779) Updating files: 86% (670/779) Updating files: 87% (678/779) Updating files: 88% (686/779) Updating files: 89% (694/779) Updating files: 90% (702/779) Updating files: 91% (709/779) Updating files: 92% (717/779) Updating files: 93% (725/779) Updating files: 93% (730/779) Updating files: 94% (733/779) Updating files: 95% (741/779) Updating files: 96% (748/779) Updating files: 97% (756/779) Updating files: 98% (764/779) Updating files: 99% (772/779) Updating files: 100% (779/779) Updating files: 100% (779/779), done. 2024-04-12T20:02:45.537 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 2f10137986a v0.18 2024-04-12T20:02:45.554 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.18 2024-04-12T20:02:45.813 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:02:45.813 INFO:tasks.workunit.client.0.smithi131.stdout:v0.19 2024-04-12T20:02:45.814 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 19 -eq 48 ']' 2024-04-12T20:02:45.814 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.19 2024-04-12T20:02:45.814 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.19 2024-04-12T20:02:45.814 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.19 2024-04-12T20:02:50.623 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:02:50.632 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:02:50.881 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 29% (63/217) Updating files: 30% (66/217) Updating files: 31% (68/217) Updating files: 32% (70/217) Updating files: 33% (72/217) Updating files: 34% (74/217) Updating files: 35% (76/217) Updating files: 36% (79/217) Updating files: 37% (81/217) Updating files: 38% (83/217) Updating files: 39% (85/217) Updating files: 40% (87/217) Updating files: 41% (89/217) Updating files: 42% (92/217) Updating files: 43% (94/217) Updating files: 44% (96/217) Updating files: 45% (98/217) Updating files: 46% (100/217) Updating files: 47% (102/217) Updating files: 48% (105/217) Updating files: 49% (107/217) Updating files: 50% (109/217) Updating files: 50% (110/217) Updating files: 51% (111/217) Updating files: 52% (113/217) Updating files: 53% (116/217) Updating files: 54% (118/217) Updating files: 55% (120/217) Updating files: 56% (122/217) Updating files: 57% (124/217) Updating files: 58% (126/217) Updating files: 59% (129/217) Updating files: 60% (131/217) Updating files: 61% (133/217) Updating files: 62% (135/217) Updating files: 63% (137/217) Updating files: 64% (139/217) Updating files: 65% (142/217) Updating files: 66% (144/217) Updating files: 67% (146/217) Updating files: 68% (148/217) Updating files: 69% (150/217) Updating files: 70% (152/217) Updating files: 71% (155/217) Updating files: 72% (157/217) Updating files: 73% (159/217) Updating files: 74% (161/217) Updating files: 75% (163/217) Updating files: 76% (165/217) Updating files: 76% (167/217) Updating files: 77% (168/217) Updating files: 78% (170/217) Updating files: 79% (172/217) Updating files: 80% (174/217) Updating files: 81% (176/217) Updating files: 82% (178/217) Updating files: 83% (181/217) Updating files: 84% (183/217) Updating files: 85% (185/217) Updating files: 86% (187/217) Updating files: 87% (189/217) Updating files: 88% (191/217) Updating files: 89% (194/217) Updating files: 90% (196/217) Updating files: 91% (198/217) Updating files: 92% (200/217) Updating files: 93% (202/217) Updating files: 94% (204/217) Updating files: 95% (207/217) Updating files: 96% (209/217) Updating files: 97% (211/217) Updating files: 98% (213/217) Updating files: 99% (215/217) Updating files: 100% (217/217) Updating files: 100% (217/217), done. 2024-04-12T20:02:51.143 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 98f5be53f85 v0.19 2024-04-12T20:02:51.158 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.19 2024-04-12T20:02:51.316 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:02:51.316 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 20 -eq 48 ']' 2024-04-12T20:02:51.316 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.20 2024-04-12T20:02:51.317 INFO:tasks.workunit.client.0.smithi131.stdout:v0.20 2024-04-12T20:02:51.317 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.20 2024-04-12T20:02:51.317 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.20 2024-04-12T20:02:56.879 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 31% (77/245) Updating files: 32% (79/245) Updating files: 33% (81/245) Updating files: 34% (84/245) Updating files: 35% (86/245) Updating files: 36% (89/245) Updating files: 37% (91/245) Updating files: 38% (94/245) Updating files: 39% (96/245) Updating files: 40% (98/245) Updating files: 41% (101/245) Updating files: 42% (103/245) Updating files: 43% (106/245) Updating files: 44% (108/245) Updating files: 45% (111/245) Updating files: 46% (113/245) Updating files: 47% (116/245) Updating files: 48% (118/245) Updating files: 49% (121/245) Updating files: 50% (123/245) Updating files: 51% (125/245) Updating files: 52% (128/245) Updating files: 53% (130/245) Updating files: 54% (133/245) Updating files: 55% (135/245) Updating files: 56% (138/245) Updating files: 57% (140/245) Updating files: 58% (143/245) Updating files: 59% (145/245) Updating files: 60% (147/245) Updating files: 61% (150/245) Updating files: 62% (152/245) Updating files: 63% (155/245) Updating files: 64% (157/245) Updating files: 65% (160/245) Updating files: 66% (162/245) Updating files: 67% (165/245) Updating files: 68% (167/245) Updating files: 69% (170/245) Updating files: 70% (172/245) Updating files: 71% (174/245) Updating files: 71% (175/245) Updating files: 72% (177/245) Updating files: 73% (179/245) Updating files: 74% (182/245) Updating files: 75% (184/245) Updating files: 76% (187/245) Updating files: 77% (189/245) Updating files: 78% (192/245) Updating files: 79% (194/245) Updating files: 80% (196/245) Updating files: 81% (199/245) Updating files: 82% (201/245) Updating files: 83% (204/245) Updating files: 84% (206/245) Updating files: 85% (209/245) Updating files: 86% (211/245) Updating files: 87% (214/245) Updating files: 88% (216/245) Updating files: 89% (219/245) Updating files: 90% (221/245) Updating files: 90% (222/245) Updating files: 91% (223/245) Updating files: 92% (226/245) Updating files: 93% (228/245) Updating files: 94% (231/245) Updating files: 95% (233/245) Updating files: 96% (236/245) Updating files: 97% (238/245) Updating files: 98% (241/245) Updating files: 99% (243/245) Updating files: 100% (245/245) Updating files: 100% (245/245), done. 2024-04-12T20:02:57.095 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 266d2076b6c debian: fix up debian scripts 2024-04-12T20:02:57.107 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.20 2024-04-12T20:02:57.193 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:02:57.193 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 21 -eq 48 ']' 2024-04-12T20:02:57.193 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.21 2024-04-12T20:02:57.193 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.21 2024-04-12T20:02:57.194 INFO:tasks.workunit.client.0.smithi131.stdout:v0.21 2024-04-12T20:02:57.194 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.21 2024-04-12T20:03:06.182 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 18% (102/537) Updating files: 19% (103/537) Updating files: 20% (108/537) Updating files: 21% (113/537) Updating files: 22% (119/537) Updating files: 23% (124/537) Updating files: 24% (129/537) Updating files: 25% (135/537) Updating files: 26% (140/537) Updating files: 27% (145/537) Updating files: 28% (151/537) Updating files: 29% (156/537) Updating files: 30% (162/537) Updating files: 30% (163/537) Updating files: 31% (167/537) Updating files: 32% (172/537) Updating files: 33% (178/537) Updating files: 34% (183/537) Updating files: 35% (188/537) Updating files: 36% (194/537) Updating files: 37% (199/537) Updating files: 38% (205/537) Updating files: 39% (210/537) Updating files: 40% (215/537) Updating files: 41% (221/537) Updating files: 42% (226/537) Updating files: 42% (227/537) Updating files: 43% (231/537) Updating files: 44% (237/537) Updating files: 45% (242/537) Updating files: 46% (248/537) Updating files: 47% (253/537) Updating files: 48% (258/537) Updating files: 49% (264/537) Updating files: 50% (269/537) Updating files: 51% (274/537) Updating files: 52% (280/537) Updating files: 53% (285/537) Updating files: 53% (288/537) Updating files: 54% (290/537) Updating files: 55% (296/537) Updating files: 56% (301/537) Updating files: 57% (307/537) Updating files: 58% (312/537) Updating files: 59% (317/537) Updating files: 60% (323/537) Updating files: 61% (328/537) Updating files: 62% (333/537) Updating files: 63% (339/537) Updating files: 64% (344/537) Updating files: 64% (348/537) Updating files: 65% (350/537) Updating files: 66% (355/537) Updating files: 67% (360/537) Updating files: 68% (366/537) Updating files: 69% (371/537) Updating files: 70% (376/537) Updating files: 71% (382/537) Updating files: 72% (387/537) Updating files: 73% (393/537) Updating files: 74% (398/537) Updating files: 75% (403/537) Updating files: 76% (409/537) Updating files: 77% (414/537) Updating files: 78% (419/537) Updating files: 79% (425/537) Updating files: 80% (430/537) Updating files: 81% (435/537) Updating files: 82% (441/537) Updating files: 83% (446/537) Updating files: 84% (452/537) Updating files: 85% (457/537) Updating files: 86% (462/537) Updating files: 87% (468/537) Updating files: 87% (469/537) Updating files: 88% (473/537) Updating files: 89% (478/537) Updating files: 90% (484/537) Updating files: 91% (489/537) Updating files: 92% (495/537) Updating files: 93% (500/537) Updating files: 94% (505/537) Updating files: 95% (511/537) Updating files: 96% (516/537) Updating files: 97% (521/537) Updating files: 98% (527/537) Updating files: 98% (530/537) Updating files: 99% (532/537) Updating files: 100% (537/537) Updating files: 100% (537/537), done. 2024-04-12T20:03:06.631 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 090436f56ac v0.21 2024-04-12T20:03:06.645 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.21 2024-04-12T20:03:06.740 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:03:06.740 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 22 -eq 48 ']' 2024-04-12T20:03:06.741 INFO:tasks.workunit.client.0.smithi131.stdout:v0.22 2024-04-12T20:03:06.741 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.22 2024-04-12T20:03:06.741 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.22 2024-04-12T20:03:06.741 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.22 2024-04-12T20:03:12.013 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 35% (72/204) Updating files: 36% (74/204) Updating files: 37% (76/204) Updating files: 38% (78/204) Updating files: 39% (80/204) Updating files: 40% (82/204) Updating files: 41% (84/204) Updating files: 42% (86/204) Updating files: 43% (88/204) Updating files: 44% (90/204) Updating files: 45% (92/204) Updating files: 46% (94/204) Updating files: 47% (96/204) Updating files: 48% (98/204) Updating files: 49% (100/204) Updating files: 50% (102/204) Updating files: 51% (105/204) Updating files: 52% (107/204) Updating files: 53% (109/204) Updating files: 54% (111/204) Updating files: 54% (112/204) Updating files: 55% (113/204) Updating files: 56% (115/204) Updating files: 57% (117/204) Updating files: 58% (119/204) Updating files: 59% (121/204) Updating files: 60% (123/204) Updating files: 61% (125/204) Updating files: 62% (127/204) Updating files: 63% (129/204) Updating files: 64% (131/204) Updating files: 65% (133/204) Updating files: 66% (135/204) Updating files: 67% (137/204) Updating files: 68% (139/204) Updating files: 69% (141/204) Updating files: 70% (143/204) Updating files: 71% (145/204) Updating files: 72% (147/204) Updating files: 73% (149/204) Updating files: 74% (151/204) Updating files: 75% (153/204) Updating files: 76% (156/204) Updating files: 77% (158/204) Updating files: 78% (160/204) Updating files: 79% (162/204) Updating files: 80% (164/204) Updating files: 81% (166/204) Updating files: 82% (168/204) Updating files: 83% (170/204) Updating files: 84% (172/204) Updating files: 85% (174/204) Updating files: 86% (176/204) Updating files: 87% (178/204) Updating files: 88% (180/204) Updating files: 89% (182/204) Updating files: 90% (184/204) Updating files: 91% (186/204) Updating files: 92% (188/204) Updating files: 93% (190/204) Updating files: 94% (192/204) Updating files: 95% (194/204) Updating files: 96% (196/204) Updating files: 97% (198/204) Updating files: 98% (200/204) Updating files: 99% (202/204) Updating files: 100% (204/204) Updating files: 100% (204/204), done. 2024-04-12T20:03:12.293 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 8a7c95f60ad v0.22 2024-04-12T20:03:12.314 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.22 2024-04-12T20:03:12.450 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:03:12.450 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 23 -eq 48 ']' 2024-04-12T20:03:12.450 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.23 2024-04-12T20:03:12.451 INFO:tasks.workunit.client.0.smithi131.stdout:v0.23 2024-04-12T20:03:12.451 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.23 2024-04-12T20:03:12.451 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.23 2024-04-12T20:03:17.372 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 34% (56/163) Updating files: 35% (58/163) Updating files: 36% (59/163) Updating files: 37% (61/163) Updating files: 38% (62/163) Updating files: 39% (64/163) Updating files: 40% (66/163) Updating files: 41% (67/163) Updating files: 42% (69/163) Updating files: 43% (71/163) Updating files: 44% (72/163) Updating files: 45% (74/163) Updating files: 46% (75/163) Updating files: 47% (77/163) Updating files: 48% (79/163) Updating files: 49% (80/163) Updating files: 50% (82/163) Updating files: 51% (84/163) Updating files: 52% (85/163) Updating files: 53% (87/163) Updating files: 54% (89/163) Updating files: 55% (90/163) Updating files: 56% (92/163) Updating files: 57% (93/163) Updating files: 58% (95/163) Updating files: 59% (97/163) Updating files: 60% (98/163) Updating files: 61% (100/163) Updating files: 62% (102/163) Updating files: 63% (103/163) Updating files: 64% (105/163) Updating files: 65% (106/163) Updating files: 66% (108/163) Updating files: 67% (110/163) Updating files: 68% (111/163) Updating files: 69% (113/163) Updating files: 70% (115/163) Updating files: 71% (116/163) Updating files: 72% (118/163) Updating files: 73% (119/163) Updating files: 74% (121/163) Updating files: 75% (123/163) Updating files: 76% (124/163) Updating files: 77% (126/163) Updating files: 78% (128/163) Updating files: 79% (129/163) Updating files: 80% (131/163) Updating files: 81% (133/163) Updating files: 82% (134/163) Updating files: 83% (136/163) Updating files: 84% (137/163) Updating files: 85% (139/163) Updating files: 86% (141/163) Updating files: 87% (142/163) Updating files: 88% (144/163) Updating files: 89% (146/163) Updating files: 90% (147/163) Updating files: 91% (149/163) Updating files: 92% (150/163) Updating files: 93% (152/163) Updating files: 94% (154/163) Updating files: 95% (155/163) Updating files: 96% (157/163) Updating files: 97% (159/163) Updating files: 98% (160/163) Updating files: 99% (162/163) Updating files: 100% (163/163) Updating files: 100% (163/163), done. 2024-04-12T20:03:17.611 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 5d1d8d0c460 v0.23 2024-04-12T20:03:17.629 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.23 2024-04-12T20:03:17.826 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:03:17.827 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 24 -eq 48 ']' 2024-04-12T20:03:17.827 INFO:tasks.workunit.client.0.smithi131.stdout:v0.24 2024-04-12T20:03:17.827 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.24 2024-04-12T20:03:17.827 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.24 2024-04-12T20:03:17.827 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.24 2024-04-12T20:03:20.753 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:03:20.763 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:03:22.958 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 36% (67/185) Updating files: 37% (69/185) Updating files: 38% (71/185) Updating files: 39% (73/185) Updating files: 40% (74/185) Updating files: 41% (76/185) Updating files: 42% (78/185) Updating files: 43% (80/185) Updating files: 44% (82/185) Updating files: 45% (84/185) Updating files: 46% (86/185) Updating files: 47% (87/185) Updating files: 48% (89/185) Updating files: 49% (91/185) Updating files: 50% (93/185) Updating files: 51% (95/185) Updating files: 52% (97/185) Updating files: 53% (99/185) Updating files: 54% (100/185) Updating files: 55% (102/185) Updating files: 56% (104/185) Updating files: 57% (106/185) Updating files: 58% (108/185) Updating files: 59% (110/185) Updating files: 60% (111/185) Updating files: 61% (113/185) Updating files: 62% (115/185) Updating files: 63% (117/185) Updating files: 64% (119/185) Updating files: 65% (121/185) Updating files: 66% (123/185) Updating files: 67% (124/185) Updating files: 68% (126/185) Updating files: 69% (128/185) Updating files: 70% (130/185) Updating files: 71% (132/185) Updating files: 72% (134/185) Updating files: 73% (136/185) Updating files: 74% (137/185) Updating files: 75% (139/185) Updating files: 76% (141/185) Updating files: 77% (143/185) Updating files: 78% (145/185) Updating files: 79% (147/185) Updating files: 80% (148/185) Updating files: 81% (150/185) Updating files: 82% (152/185) Updating files: 83% (154/185) Updating files: 84% (156/185) Updating files: 85% (158/185) Updating files: 86% (160/185) Updating files: 87% (161/185) Updating files: 88% (163/185) Updating files: 89% (165/185) Updating files: 90% (167/185) Updating files: 91% (169/185) Updating files: 92% (171/185) Updating files: 93% (173/185) Updating files: 94% (174/185) Updating files: 95% (176/185) Updating files: 96% (178/185) Updating files: 97% (180/185) Updating files: 98% (182/185) Updating files: 99% (184/185) Updating files: 100% (185/185) Updating files: 100% (185/185), done. 2024-04-12T20:03:23.319 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 180a4176035 v0.24 2024-04-12T20:03:23.337 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.24 2024-04-12T20:03:23.407 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:03:23.407 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 25 -eq 48 ']' 2024-04-12T20:03:23.407 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.25 2024-04-12T20:03:23.407 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.25 2024-04-12T20:03:23.408 INFO:tasks.workunit.client.0.smithi131.stdout:v0.25 2024-04-12T20:03:23.408 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.25 2024-04-12T20:03:33.963 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 15% (94/622) Updating files: 16% (100/622) Updating files: 17% (106/622) Updating files: 18% (112/622) Updating files: 19% (119/622) Updating files: 20% (125/622) Updating files: 21% (131/622) Updating files: 22% (137/622) Updating files: 23% (144/622) Updating files: 24% (150/622) Updating files: 24% (152/622) Updating files: 25% (156/622) Updating files: 26% (162/622) Updating files: 27% (168/622) Updating files: 28% (175/622) Updating files: 29% (181/622) Updating files: 30% (187/622) Updating files: 31% (193/622) Updating files: 32% (200/622) Updating files: 33% (206/622) Updating files: 34% (212/622) Updating files: 35% (218/622) Updating files: 36% (224/622) Updating files: 36% (227/622) Updating files: 37% (231/622) Updating files: 38% (237/622) Updating files: 39% (243/622) Updating files: 40% (249/622) Updating files: 41% (256/622) Updating files: 42% (262/622) Updating files: 43% (268/622) Updating files: 44% (274/622) Updating files: 45% (280/622) Updating files: 46% (287/622) Updating files: 47% (293/622) Updating files: 47% (294/622) Updating files: 48% (299/622) Updating files: 49% (305/622) Updating files: 50% (311/622) Updating files: 51% (318/622) Updating files: 52% (324/622) Updating files: 53% (330/622) Updating files: 54% (336/622) Updating files: 55% (343/622) Updating files: 56% (349/622) Updating files: 57% (355/622) Updating files: 58% (361/622) Updating files: 59% (367/622) Updating files: 60% (374/622) Updating files: 61% (380/622) Updating files: 61% (385/622) Updating files: 62% (386/622) Updating files: 63% (392/622) Updating files: 64% (399/622) Updating files: 65% (405/622) Updating files: 66% (411/622) Updating files: 67% (417/622) Updating files: 68% (423/622) Updating files: 69% (430/622) Updating files: 70% (436/622) Updating files: 70% (439/622) Updating files: 71% (442/622) Updating files: 72% (448/622) Updating files: 73% (455/622) Updating files: 74% (461/622) Updating files: 75% (467/622) Updating files: 76% (473/622) Updating files: 77% (479/622) Updating files: 78% (486/622) Updating files: 78% (487/622) Updating files: 79% (492/622) Updating files: 80% (498/622) Updating files: 81% (504/622) Updating files: 82% (511/622) Updating files: 83% (517/622) Updating files: 84% (523/622) Updating files: 85% (529/622) Updating files: 86% (535/622) Updating files: 86% (541/622) Updating files: 87% (542/622) Updating files: 88% (548/622) Updating files: 89% (554/622) Updating files: 90% (560/622) Updating files: 91% (567/622) Updating files: 92% (573/622) Updating files: 93% (579/622) Updating files: 94% (585/622) Updating files: 95% (591/622) Updating files: 96% (598/622) Updating files: 97% (604/622) Updating files: 97% (605/622) Updating files: 98% (610/622) Updating files: 99% (616/622) Updating files: 100% (622/622) Updating files: 100% (622/622), done. 2024-04-12T20:03:34.282 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 3fa121bf0a8 v0.25 2024-04-12T20:03:34.299 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.25 2024-04-12T20:03:34.416 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:03:34.416 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 26 -eq 48 ']' 2024-04-12T20:03:34.416 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.26 2024-04-12T20:03:34.416 INFO:tasks.workunit.client.0.smithi131.stdout:v0.26 2024-04-12T20:03:34.416 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.26 2024-04-12T20:03:34.417 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.26 2024-04-12T20:03:41.415 INFO:tasks.workunit.client.0.smithi131.stderr:Updating files: 24% (58/239) Updating files: 25% (60/239) Updating files: 26% (63/239) Updating files: 27% (65/239) Updating files: 28% (67/239) Updating files: 29% (70/239) Updating files: 30% (72/239) Updating files: 31% (75/239) Updating files: 32% (77/239) Updating files: 33% (79/239) Updating files: 34% (82/239) Updating files: 35% (84/239) Updating files: 36% (87/239) Updating files: 37% (89/239) Updating files: 38% (91/239) Updating files: 39% (94/239) Updating files: 40% (96/239) Updating files: 41% (98/239) Updating files: 42% (101/239) Updating files: 43% (103/239) Updating files: 43% (105/239) Updating files: 44% (106/239) Updating files: 45% (108/239) Updating files: 46% (110/239) Updating files: 47% (113/239) Updating files: 48% (115/239) Updating files: 49% (118/239) Updating files: 50% (120/239) Updating files: 51% (122/239) Updating files: 52% (125/239) Updating files: 53% (127/239) Updating files: 54% (130/239) Updating files: 55% (132/239) Updating files: 56% (134/239) Updating files: 57% (137/239) Updating files: 58% (139/239) Updating files: 59% (142/239) Updating files: 60% (144/239) Updating files: 61% (146/239) Updating files: 62% (149/239) Updating files: 62% (150/239) Updating files: 63% (151/239) Updating files: 64% (153/239) Updating files: 65% (156/239) Updating files: 66% (158/239) Updating files: 67% (161/239) Updating files: 68% (163/239) Updating files: 69% (165/239) Updating files: 70% (168/239) Updating files: 71% (170/239) Updating files: 72% (173/239) Updating files: 73% (175/239) Updating files: 74% (177/239) Updating files: 75% (180/239) Updating files: 76% (182/239) Updating files: 77% (185/239) Updating files: 78% (187/239) Updating files: 79% (189/239) Updating files: 80% (192/239) Updating files: 81% (194/239) Updating files: 82% (196/239) Updating files: 83% (199/239) Updating files: 84% (201/239) Updating files: 85% (204/239) Updating files: 85% (205/239) Updating files: 86% (206/239) Updating files: 87% (208/239) Updating files: 88% (211/239) Updating files: 89% (213/239) Updating files: 90% (216/239) Updating files: 91% (218/239) Updating files: 92% (220/239) Updating files: 93% (223/239) Updating files: 94% (225/239) Updating files: 95% (228/239) Updating files: 96% (230/239) Updating files: 97% (232/239) Updating files: 98% (235/239) Updating files: 99% (237/239) Updating files: 100% (239/239) Updating files: 100% (239/239), done. 2024-04-12T20:03:42.051 INFO:tasks.workunit.client.0.smithi131.stdout:HEAD is now at 9981ff90968 v0.26 2024-04-12T20:03:42.072 INFO:tasks.workunit.client.0.smithi131.stderr:+ mkdir .snap/v0.26 2024-04-12T20:03:42.157 INFO:tasks.workunit.client.0.smithi131.stderr:+ for v in $versions 2024-04-12T20:03:42.157 INFO:tasks.workunit.client.0.smithi131.stderr:+ '[' 27 -eq 48 ']' 2024-04-12T20:03:42.157 INFO:tasks.workunit.client.0.smithi131.stdout:v0.27 2024-04-12T20:03:42.157 INFO:tasks.workunit.client.0.smithi131.stderr:+ ver=v0.27 2024-04-12T20:03:42.157 INFO:tasks.workunit.client.0.smithi131.stderr:+ echo v0.27 2024-04-12T20:03:42.157 INFO:tasks.workunit.client.0.smithi131.stderr:+ git reset --hard v0.27 2024-04-12T20:03:42.167 INFO:tasks.ceph.mds.b.smithi171.stdout:/usr/include/c++/11/bits/stl_vector.h:1145: std::vector<_Tp, _Alloc>::reference std::vector<_Tp, _Alloc>::back() [with _Tp = CInodeCommitOperations; _Alloc = std::allocator; std::vector<_Tp, _Alloc>::reference = CInodeCommitOperations&]: Assertion '!this->empty()' failed. 2024-04-12T20:03:42.167 INFO:tasks.ceph.mds.b.smithi171.stderr:*** Caught signal (Aborted) ** 2024-04-12T20:03:42.167 INFO:tasks.ceph.mds.b.smithi171.stderr: in thread 7fd5a7a00640 thread_name:ms_dispatch 2024-04-12T20:03:42.169 INFO:tasks.ceph.mds.b.smithi171.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:03:42.169 INFO:tasks.ceph.mds.b.smithi171.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd5b3e54db0] 2024-04-12T20:03:42.169 INFO:tasks.ceph.mds.b.smithi171.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd5b3ea154c] 2024-04-12T20:03:42.169 INFO:tasks.ceph.mds.b.smithi171.stderr: 3: raise() 2024-04-12T20:03:42.169 INFO:tasks.ceph.mds.b.smithi171.stderr: 4: abort() 2024-04-12T20:03:42.169 INFO:tasks.ceph.mds.b.smithi171.stderr: 5: ceph-mds(+0x14db08) [0x564124103b08] 2024-04-12T20:03:42.169 INFO:tasks.ceph.mds.b.smithi171.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x56412417a9b0] 2024-04-12T20:03:42.170 INFO:tasks.ceph.mds.b.smithi171.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x5641243f8b62] 2024-04-12T20:03:42.170 INFO:tasks.ceph.mds.b.smithi171.stderr: 8: (MDLog::trim()+0xc8a) [0x5641243fc81a] 2024-04-12T20:03:42.170 INFO:tasks.ceph.mds.b.smithi171.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x5641243fccc8] 2024-04-12T20:03:42.170 INFO:tasks.ceph.mds.b.smithi171.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7fd5b42db924] 2024-04-12T20:03:42.170 INFO:tasks.ceph.mds.b.smithi171.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7fd5b3e9f802] 2024-04-12T20:03:42.170 INFO:tasks.ceph.mds.b.smithi171.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7fd5b3e3f450] 2024-04-12T20:03:42.170 INFO:tasks.ceph.mds.b.smithi171.stderr:2024-04-12T20:03:42.170+0000 7fd5a7a00640 -1 *** Caught signal (Aborted) ** 2024-04-12T20:03:42.170 INFO:tasks.ceph.mds.b.smithi171.stderr: in thread 7fd5a7a00640 thread_name:ms_dispatch 2024-04-12T20:03:42.170 INFO:tasks.ceph.mds.b.smithi171.stderr: 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd5b3e54db0] 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd5b3ea154c] 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 3: raise() 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 4: abort() 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 5: ceph-mds(+0x14db08) [0x564124103b08] 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x56412417a9b0] 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x5641243f8b62] 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 8: (MDLog::trim()+0xc8a) [0x5641243fc81a] 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x5641243fccc8] 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7fd5b42db924] 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7fd5b3e9f802] 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7fd5b3e3f450] 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-12T20:03:42.171 INFO:tasks.ceph.mds.b.smithi171.stderr: 2024-04-12T20:03:42.229 INFO:tasks.ceph.mds.b.smithi171.stderr: 0> 2024-04-12T20:03:42.170+0000 7fd5a7a00640 -1 *** Caught signal (Aborted) ** 2024-04-12T20:03:42.229 INFO:tasks.ceph.mds.b.smithi171.stderr: in thread 7fd5a7a00640 thread_name:ms_dispatch 2024-04-12T20:03:42.229 INFO:tasks.ceph.mds.b.smithi171.stderr: 2024-04-12T20:03:42.230 INFO:tasks.ceph.mds.b.smithi171.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:03:42.230 INFO:tasks.ceph.mds.b.smithi171.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd5b3e54db0] 2024-04-12T20:03:42.230 INFO:tasks.ceph.mds.b.smithi171.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd5b3ea154c] 2024-04-12T20:03:42.230 INFO:tasks.ceph.mds.b.smithi171.stderr: 3: raise() 2024-04-12T20:03:42.230 INFO:tasks.ceph.mds.b.smithi171.stderr: 4: abort() 2024-04-12T20:03:42.230 INFO:tasks.ceph.mds.b.smithi171.stderr: 5: ceph-mds(+0x14db08) [0x564124103b08] 2024-04-12T20:03:42.230 INFO:tasks.ceph.mds.b.smithi171.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x56412417a9b0] 2024-04-12T20:03:42.230 INFO:tasks.ceph.mds.b.smithi171.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x5641243f8b62] 2024-04-12T20:03:42.230 INFO:tasks.ceph.mds.b.smithi171.stderr: 8: (MDLog::trim()+0xc8a) [0x5641243fc81a] 2024-04-12T20:03:42.230 INFO:tasks.ceph.mds.b.smithi171.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x5641243fccc8] 2024-04-12T20:03:42.230 INFO:tasks.ceph.mds.b.smithi171.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7fd5b42db924] 2024-04-12T20:03:42.231 INFO:tasks.ceph.mds.b.smithi171.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7fd5b3e9f802] 2024-04-12T20:03:42.231 INFO:tasks.ceph.mds.b.smithi171.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7fd5b3e3f450] 2024-04-12T20:03:42.231 INFO:tasks.ceph.mds.b.smithi171.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-12T20:03:42.231 INFO:tasks.ceph.mds.b.smithi171.stderr: 2024-04-12T20:03:42.246 INFO:tasks.ceph.mds.b.smithi171.stderr: -9> 2024-04-12T20:03:42.170+0000 7fd5a7a00640 -1 *** Caught signal (Aborted) ** 2024-04-12T20:03:42.246 INFO:tasks.ceph.mds.b.smithi171.stderr: in thread 7fd5a7a00640 thread_name:ms_dispatch 2024-04-12T20:03:42.246 INFO:tasks.ceph.mds.b.smithi171.stderr: 2024-04-12T20:03:42.246 INFO:tasks.ceph.mds.b.smithi171.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:03:42.246 INFO:tasks.ceph.mds.b.smithi171.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7fd5b3e54db0] 2024-04-12T20:03:42.246 INFO:tasks.ceph.mds.b.smithi171.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7fd5b3ea154c] 2024-04-12T20:03:42.247 INFO:tasks.ceph.mds.b.smithi171.stderr: 3: raise() 2024-04-12T20:03:42.247 INFO:tasks.ceph.mds.b.smithi171.stderr: 4: abort() 2024-04-12T20:03:42.247 INFO:tasks.ceph.mds.b.smithi171.stderr: 5: ceph-mds(+0x14db08) [0x564124103b08] 2024-04-12T20:03:42.247 INFO:tasks.ceph.mds.b.smithi171.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x56412417a9b0] 2024-04-12T20:03:42.247 INFO:tasks.ceph.mds.b.smithi171.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x5641243f8b62] 2024-04-12T20:03:42.247 INFO:tasks.ceph.mds.b.smithi171.stderr: 8: (MDLog::trim()+0xc8a) [0x5641243fc81a] 2024-04-12T20:03:42.247 INFO:tasks.ceph.mds.b.smithi171.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x5641243fccc8] 2024-04-12T20:03:42.247 INFO:tasks.ceph.mds.b.smithi171.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7fd5b42db924] 2024-04-12T20:03:42.247 INFO:tasks.ceph.mds.b.smithi171.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7fd5b3e9f802] 2024-04-12T20:03:42.247 INFO:tasks.ceph.mds.b.smithi171.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7fd5b3e3f450] 2024-04-12T20:03:42.247 INFO:tasks.ceph.mds.b.smithi171.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-12T20:03:42.247 INFO:tasks.ceph.mds.b.smithi171.stderr: 2024-04-12T20:03:44.055 INFO:tasks.ceph.mds.b.smithi171.stderr:daemon-helper: command crashed with signal 6 2024-04-12T20:03:44.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-04-12T20:03:50.891 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:03:50.899 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:03:51.468 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~7s 2024-04-12T20:03:58.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~13s 2024-04-12T20:04:04.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~20s 2024-04-12T20:04:07.020 INFO:tasks.ceph.mds.d.smithi171.stdout:/usr/include/c++/11/bits/stl_vector.h:1145: std::vector<_Tp, _Alloc>::reference std::vector<_Tp, _Alloc>::back() [with _Tp = CInodeCommitOperations; _Alloc = std::allocator; std::vector<_Tp, _Alloc>::reference = CInodeCommitOperations&]: Assertion '!this->empty()' failed. 2024-04-12T20:04:07.021 INFO:tasks.ceph.mds.d.smithi171.stderr:*** Caught signal (Aborted) ** 2024-04-12T20:04:07.021 INFO:tasks.ceph.mds.d.smithi171.stderr: in thread 7f9140000640 thread_name:ms_dispatch 2024-04-12T20:04:07.021 INFO:tasks.ceph.mds.d.smithi171.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:04:07.021 INFO:tasks.ceph.mds.d.smithi171.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f914c454db0] 2024-04-12T20:04:07.021 INFO:tasks.ceph.mds.d.smithi171.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f914c4a154c] 2024-04-12T20:04:07.022 INFO:tasks.ceph.mds.d.smithi171.stderr: 3: raise() 2024-04-12T20:04:07.022 INFO:tasks.ceph.mds.d.smithi171.stderr: 4: abort() 2024-04-12T20:04:07.022 INFO:tasks.ceph.mds.d.smithi171.stderr: 5: ceph-mds(+0x14db08) [0x55ad8648ab08] 2024-04-12T20:04:07.022 INFO:tasks.ceph.mds.d.smithi171.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x55ad865019b0] 2024-04-12T20:04:07.022 INFO:tasks.ceph.mds.d.smithi171.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x55ad8677fb62] 2024-04-12T20:04:07.022 INFO:tasks.ceph.mds.d.smithi171.stderr: 8: (MDLog::trim()+0xc8a) [0x55ad8678381a] 2024-04-12T20:04:07.022 INFO:tasks.ceph.mds.d.smithi171.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x55ad86783cc8] 2024-04-12T20:04:07.022 INFO:tasks.ceph.mds.d.smithi171.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7f914c8db924] 2024-04-12T20:04:07.022 INFO:tasks.ceph.mds.d.smithi171.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7f914c49f802] 2024-04-12T20:04:07.022 INFO:tasks.ceph.mds.d.smithi171.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7f914c43f450] 2024-04-12T20:04:07.023 INFO:tasks.ceph.mds.d.smithi171.stderr:2024-04-12T20:04:07.023+0000 7f9140000640 -1 *** Caught signal (Aborted) ** 2024-04-12T20:04:07.023 INFO:tasks.ceph.mds.d.smithi171.stderr: in thread 7f9140000640 thread_name:ms_dispatch 2024-04-12T20:04:07.023 INFO:tasks.ceph.mds.d.smithi171.stderr: 2024-04-12T20:04:07.023 INFO:tasks.ceph.mds.d.smithi171.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:04:07.023 INFO:tasks.ceph.mds.d.smithi171.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f914c454db0] 2024-04-12T20:04:07.023 INFO:tasks.ceph.mds.d.smithi171.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f914c4a154c] 2024-04-12T20:04:07.023 INFO:tasks.ceph.mds.d.smithi171.stderr: 3: raise() 2024-04-12T20:04:07.023 INFO:tasks.ceph.mds.d.smithi171.stderr: 4: abort() 2024-04-12T20:04:07.023 INFO:tasks.ceph.mds.d.smithi171.stderr: 5: ceph-mds(+0x14db08) [0x55ad8648ab08] 2024-04-12T20:04:07.023 INFO:tasks.ceph.mds.d.smithi171.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x55ad865019b0] 2024-04-12T20:04:07.023 INFO:tasks.ceph.mds.d.smithi171.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x55ad8677fb62] 2024-04-12T20:04:07.024 INFO:tasks.ceph.mds.d.smithi171.stderr: 8: (MDLog::trim()+0xc8a) [0x55ad8678381a] 2024-04-12T20:04:07.024 INFO:tasks.ceph.mds.d.smithi171.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x55ad86783cc8] 2024-04-12T20:04:07.024 INFO:tasks.ceph.mds.d.smithi171.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7f914c8db924] 2024-04-12T20:04:07.024 INFO:tasks.ceph.mds.d.smithi171.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7f914c49f802] 2024-04-12T20:04:07.024 INFO:tasks.ceph.mds.d.smithi171.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7f914c43f450] 2024-04-12T20:04:07.024 INFO:tasks.ceph.mds.d.smithi171.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-12T20:04:07.024 INFO:tasks.ceph.mds.d.smithi171.stderr: 2024-04-12T20:04:07.072 INFO:tasks.ceph.mds.d.smithi171.stderr: 0> 2024-04-12T20:04:07.023+0000 7f9140000640 -1 *** Caught signal (Aborted) ** 2024-04-12T20:04:07.072 INFO:tasks.ceph.mds.d.smithi171.stderr: in thread 7f9140000640 thread_name:ms_dispatch 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f914c454db0] 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f914c4a154c] 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 3: raise() 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 4: abort() 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 5: ceph-mds(+0x14db08) [0x55ad8648ab08] 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x55ad865019b0] 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x55ad8677fb62] 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 8: (MDLog::trim()+0xc8a) [0x55ad8678381a] 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x55ad86783cc8] 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7f914c8db924] 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7f914c49f802] 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7f914c43f450] 2024-04-12T20:04:07.073 INFO:tasks.ceph.mds.d.smithi171.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-12T20:04:07.074 INFO:tasks.ceph.mds.d.smithi171.stderr: 2024-04-12T20:04:07.087 INFO:tasks.ceph.mds.d.smithi171.stderr: 0> 2024-04-12T20:04:07.023+0000 7f9140000640 -1 *** Caught signal (Aborted) ** 2024-04-12T20:04:07.087 INFO:tasks.ceph.mds.d.smithi171.stderr: in thread 7f9140000640 thread_name:ms_dispatch 2024-04-12T20:04:07.087 INFO:tasks.ceph.mds.d.smithi171.stderr: 2024-04-12T20:04:07.087 INFO:tasks.ceph.mds.d.smithi171.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:04:07.087 INFO:tasks.ceph.mds.d.smithi171.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f914c454db0] 2024-04-12T20:04:07.087 INFO:tasks.ceph.mds.d.smithi171.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f914c4a154c] 2024-04-12T20:04:07.087 INFO:tasks.ceph.mds.d.smithi171.stderr: 3: raise() 2024-04-12T20:04:07.088 INFO:tasks.ceph.mds.d.smithi171.stderr: 4: abort() 2024-04-12T20:04:07.088 INFO:tasks.ceph.mds.d.smithi171.stderr: 5: ceph-mds(+0x14db08) [0x55ad8648ab08] 2024-04-12T20:04:07.088 INFO:tasks.ceph.mds.d.smithi171.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x55ad865019b0] 2024-04-12T20:04:07.088 INFO:tasks.ceph.mds.d.smithi171.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x55ad8677fb62] 2024-04-12T20:04:07.088 INFO:tasks.ceph.mds.d.smithi171.stderr: 8: (MDLog::trim()+0xc8a) [0x55ad8678381a] 2024-04-12T20:04:07.088 INFO:tasks.ceph.mds.d.smithi171.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x55ad86783cc8] 2024-04-12T20:04:07.088 INFO:tasks.ceph.mds.d.smithi171.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7f914c8db924] 2024-04-12T20:04:07.088 INFO:tasks.ceph.mds.d.smithi171.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7f914c49f802] 2024-04-12T20:04:07.088 INFO:tasks.ceph.mds.d.smithi171.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7f914c43f450] 2024-04-12T20:04:07.088 INFO:tasks.ceph.mds.d.smithi171.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-12T20:04:07.088 INFO:tasks.ceph.mds.d.smithi171.stderr: 2024-04-12T20:04:07.878 INFO:tasks.ceph.mds.d.smithi171.stderr:daemon-helper: command crashed with signal 6 2024-04-12T20:04:11.205 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~26s 2024-04-12T20:04:11.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-04-12T20:04:17.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~33s 2024-04-12T20:04:17.718 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~7s 2024-04-12T20:04:22.417 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:04:22.426 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:04:24.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~39s 2024-04-12T20:04:24.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~13s 2024-04-12T20:04:30.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~46s 2024-04-12T20:04:30.742 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~20s 2024-04-12T20:04:33.031 INFO:tasks.ceph.mds.c.smithi131.stdout:/usr/include/c++/11/bits/stl_vector.h:1145: std::vector<_Tp, _Alloc>::reference std::vector<_Tp, _Alloc>::back() [with _Tp = CInodeCommitOperations; _Alloc = std::allocator; std::vector<_Tp, _Alloc>::reference = CInodeCommitOperations&]: Assertion '!this->empty()' failed. 2024-04-12T20:04:33.032 INFO:tasks.ceph.mds.c.smithi131.stderr:*** Caught signal (Aborted) ** 2024-04-12T20:04:33.032 INFO:tasks.ceph.mds.c.smithi131.stderr: in thread 7f3053200640 thread_name:ms_dispatch 2024-04-12T20:04:33.033 INFO:tasks.ceph.mds.c.smithi131.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:04:33.033 INFO:tasks.ceph.mds.c.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f305f454db0] 2024-04-12T20:04:33.033 INFO:tasks.ceph.mds.c.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f305f4a154c] 2024-04-12T20:04:33.033 INFO:tasks.ceph.mds.c.smithi131.stderr: 3: raise() 2024-04-12T20:04:33.033 INFO:tasks.ceph.mds.c.smithi131.stderr: 4: abort() 2024-04-12T20:04:33.033 INFO:tasks.ceph.mds.c.smithi131.stderr: 5: ceph-mds(+0x14db08) [0x563cdf688b08] 2024-04-12T20:04:33.033 INFO:tasks.ceph.mds.c.smithi131.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x563cdf6ff9b0] 2024-04-12T20:04:33.033 INFO:tasks.ceph.mds.c.smithi131.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563cdf97db62] 2024-04-12T20:04:33.033 INFO:tasks.ceph.mds.c.smithi131.stderr: 8: (MDLog::trim()+0xc8a) [0x563cdf98181a] 2024-04-12T20:04:33.033 INFO:tasks.ceph.mds.c.smithi131.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x563cdf981cc8] 2024-04-12T20:04:33.033 INFO:tasks.ceph.mds.c.smithi131.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7f305f8db924] 2024-04-12T20:04:33.034 INFO:tasks.ceph.mds.c.smithi131.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7f305f49f802] 2024-04-12T20:04:33.034 INFO:tasks.ceph.mds.c.smithi131.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7f305f43f450] 2024-04-12T20:04:33.034 INFO:tasks.ceph.mds.c.smithi131.stderr:2024-04-12T20:04:33.035+0000 7f3053200640 -1 *** Caught signal (Aborted) ** 2024-04-12T20:04:33.034 INFO:tasks.ceph.mds.c.smithi131.stderr: in thread 7f3053200640 thread_name:ms_dispatch 2024-04-12T20:04:33.034 INFO:tasks.ceph.mds.c.smithi131.stderr: 2024-04-12T20:04:33.034 INFO:tasks.ceph.mds.c.smithi131.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:04:33.034 INFO:tasks.ceph.mds.c.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f305f454db0] 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f305f4a154c] 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: 3: raise() 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: 4: abort() 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: 5: ceph-mds(+0x14db08) [0x563cdf688b08] 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x563cdf6ff9b0] 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563cdf97db62] 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: 8: (MDLog::trim()+0xc8a) [0x563cdf98181a] 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x563cdf981cc8] 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7f305f8db924] 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7f305f49f802] 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7f305f43f450] 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-12T20:04:33.035 INFO:tasks.ceph.mds.c.smithi131.stderr: 2024-04-12T20:04:33.081 INFO:tasks.ceph.mds.c.smithi131.stderr: 0> 2024-04-12T20:04:33.035+0000 7f3053200640 -1 *** Caught signal (Aborted) ** 2024-04-12T20:04:33.081 INFO:tasks.ceph.mds.c.smithi131.stderr: in thread 7f3053200640 thread_name:ms_dispatch 2024-04-12T20:04:33.082 INFO:tasks.ceph.mds.c.smithi131.stderr: 2024-04-12T20:04:33.082 INFO:tasks.ceph.mds.c.smithi131.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:04:33.082 INFO:tasks.ceph.mds.c.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f305f454db0] 2024-04-12T20:04:33.082 INFO:tasks.ceph.mds.c.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f305f4a154c] 2024-04-12T20:04:33.082 INFO:tasks.ceph.mds.c.smithi131.stderr: 3: raise() 2024-04-12T20:04:33.082 INFO:tasks.ceph.mds.c.smithi131.stderr: 4: abort() 2024-04-12T20:04:33.082 INFO:tasks.ceph.mds.c.smithi131.stderr: 5: ceph-mds(+0x14db08) [0x563cdf688b08] 2024-04-12T20:04:33.082 INFO:tasks.ceph.mds.c.smithi131.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x563cdf6ff9b0] 2024-04-12T20:04:33.082 INFO:tasks.ceph.mds.c.smithi131.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563cdf97db62] 2024-04-12T20:04:33.082 INFO:tasks.ceph.mds.c.smithi131.stderr: 8: (MDLog::trim()+0xc8a) [0x563cdf98181a] 2024-04-12T20:04:33.082 INFO:tasks.ceph.mds.c.smithi131.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x563cdf981cc8] 2024-04-12T20:04:33.082 INFO:tasks.ceph.mds.c.smithi131.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7f305f8db924] 2024-04-12T20:04:33.083 INFO:tasks.ceph.mds.c.smithi131.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7f305f49f802] 2024-04-12T20:04:33.083 INFO:tasks.ceph.mds.c.smithi131.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7f305f43f450] 2024-04-12T20:04:33.083 INFO:tasks.ceph.mds.c.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-12T20:04:33.083 INFO:tasks.ceph.mds.c.smithi131.stderr: 2024-04-12T20:04:33.096 INFO:tasks.ceph.mds.c.smithi131.stderr: 0> 2024-04-12T20:04:33.035+0000 7f3053200640 -1 *** Caught signal (Aborted) ** 2024-04-12T20:04:33.096 INFO:tasks.ceph.mds.c.smithi131.stderr: in thread 7f3053200640 thread_name:ms_dispatch 2024-04-12T20:04:33.096 INFO:tasks.ceph.mds.c.smithi131.stderr: 2024-04-12T20:04:33.096 INFO:tasks.ceph.mds.c.smithi131.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:04:33.096 INFO:tasks.ceph.mds.c.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f305f454db0] 2024-04-12T20:04:33.096 INFO:tasks.ceph.mds.c.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f305f4a154c] 2024-04-12T20:04:33.096 INFO:tasks.ceph.mds.c.smithi131.stderr: 3: raise() 2024-04-12T20:04:33.096 INFO:tasks.ceph.mds.c.smithi131.stderr: 4: abort() 2024-04-12T20:04:33.097 INFO:tasks.ceph.mds.c.smithi131.stderr: 5: ceph-mds(+0x14db08) [0x563cdf688b08] 2024-04-12T20:04:33.097 INFO:tasks.ceph.mds.c.smithi131.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x563cdf6ff9b0] 2024-04-12T20:04:33.097 INFO:tasks.ceph.mds.c.smithi131.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563cdf97db62] 2024-04-12T20:04:33.097 INFO:tasks.ceph.mds.c.smithi131.stderr: 8: (MDLog::trim()+0xc8a) [0x563cdf98181a] 2024-04-12T20:04:33.097 INFO:tasks.ceph.mds.c.smithi131.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x563cdf981cc8] 2024-04-12T20:04:33.097 INFO:tasks.ceph.mds.c.smithi131.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7f305f8db924] 2024-04-12T20:04:33.097 INFO:tasks.ceph.mds.c.smithi131.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7f305f49f802] 2024-04-12T20:04:33.097 INFO:tasks.ceph.mds.c.smithi131.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7f305f43f450] 2024-04-12T20:04:33.097 INFO:tasks.ceph.mds.c.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-12T20:04:33.097 INFO:tasks.ceph.mds.c.smithi131.stderr: 2024-04-12T20:04:34.491 INFO:tasks.ceph.mds.c.smithi131.stderr:daemon-helper: command crashed with signal 6 2024-04-12T20:04:37.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-04-12T20:04:37.156 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~53s 2024-04-12T20:04:37.157 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~26s 2024-04-12T20:04:43.569 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~6s 2024-04-12T20:04:43.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~59s 2024-04-12T20:04:43.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~32s 2024-04-12T20:04:49.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~13s 2024-04-12T20:04:49.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~65s 2024-04-12T20:04:49.982 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~39s 2024-04-12T20:04:52.578 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:04:52.584 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:04:56.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~19s 2024-04-12T20:04:56.394 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~72s 2024-04-12T20:04:56.395 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~45s 2024-04-12T20:04:57.043 INFO:tasks.ceph.mds.a.smithi131.stdout:/usr/include/c++/11/bits/stl_vector.h:1145: std::vector<_Tp, _Alloc>::reference std::vector<_Tp, _Alloc>::back() [with _Tp = CInodeCommitOperations; _Alloc = std::allocator; std::vector<_Tp, _Alloc>::reference = CInodeCommitOperations&]: Assertion '!this->empty()' failed. 2024-04-12T20:04:57.043 INFO:tasks.ceph.mds.a.smithi131.stderr:*** Caught signal (Aborted) ** 2024-04-12T20:04:57.043 INFO:tasks.ceph.mds.a.smithi131.stderr: in thread 7f0e46a00640 thread_name:ms_dispatch 2024-04-12T20:04:57.044 INFO:tasks.ceph.mds.a.smithi131.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:04:57.044 INFO:tasks.ceph.mds.a.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0e52e54db0] 2024-04-12T20:04:57.044 INFO:tasks.ceph.mds.a.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0e52ea154c] 2024-04-12T20:04:57.044 INFO:tasks.ceph.mds.a.smithi131.stderr: 3: raise() 2024-04-12T20:04:57.044 INFO:tasks.ceph.mds.a.smithi131.stderr: 4: abort() 2024-04-12T20:04:57.044 INFO:tasks.ceph.mds.a.smithi131.stderr: 5: ceph-mds(+0x14db08) [0x563075a0eb08] 2024-04-12T20:04:57.044 INFO:tasks.ceph.mds.a.smithi131.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x563075a859b0] 2024-04-12T20:04:57.044 INFO:tasks.ceph.mds.a.smithi131.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563075d03b62] 2024-04-12T20:04:57.044 INFO:tasks.ceph.mds.a.smithi131.stderr: 8: (MDLog::trim()+0xc8a) [0x563075d0781a] 2024-04-12T20:04:57.044 INFO:tasks.ceph.mds.a.smithi131.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x563075d07cc8] 2024-04-12T20:04:57.044 INFO:tasks.ceph.mds.a.smithi131.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7f0e532db924] 2024-04-12T20:04:57.045 INFO:tasks.ceph.mds.a.smithi131.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7f0e52e9f802] 2024-04-12T20:04:57.045 INFO:tasks.ceph.mds.a.smithi131.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7f0e52e3f450] 2024-04-12T20:04:57.045 INFO:tasks.ceph.mds.a.smithi131.stderr:2024-04-12T20:04:57.046+0000 7f0e46a00640 -1 *** Caught signal (Aborted) ** 2024-04-12T20:04:57.045 INFO:tasks.ceph.mds.a.smithi131.stderr: in thread 7f0e46a00640 thread_name:ms_dispatch 2024-04-12T20:04:57.045 INFO:tasks.ceph.mds.a.smithi131.stderr: 2024-04-12T20:04:57.045 INFO:tasks.ceph.mds.a.smithi131.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:04:57.045 INFO:tasks.ceph.mds.a.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0e52e54db0] 2024-04-12T20:04:57.045 INFO:tasks.ceph.mds.a.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0e52ea154c] 2024-04-12T20:04:57.045 INFO:tasks.ceph.mds.a.smithi131.stderr: 3: raise() 2024-04-12T20:04:57.045 INFO:tasks.ceph.mds.a.smithi131.stderr: 4: abort() 2024-04-12T20:04:57.046 INFO:tasks.ceph.mds.a.smithi131.stderr: 5: ceph-mds(+0x14db08) [0x563075a0eb08] 2024-04-12T20:04:57.046 INFO:tasks.ceph.mds.a.smithi131.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x563075a859b0] 2024-04-12T20:04:57.046 INFO:tasks.ceph.mds.a.smithi131.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563075d03b62] 2024-04-12T20:04:57.046 INFO:tasks.ceph.mds.a.smithi131.stderr: 8: (MDLog::trim()+0xc8a) [0x563075d0781a] 2024-04-12T20:04:57.046 INFO:tasks.ceph.mds.a.smithi131.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x563075d07cc8] 2024-04-12T20:04:57.046 INFO:tasks.ceph.mds.a.smithi131.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7f0e532db924] 2024-04-12T20:04:57.046 INFO:tasks.ceph.mds.a.smithi131.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7f0e52e9f802] 2024-04-12T20:04:57.046 INFO:tasks.ceph.mds.a.smithi131.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7f0e52e3f450] 2024-04-12T20:04:57.046 INFO:tasks.ceph.mds.a.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-12T20:04:57.046 INFO:tasks.ceph.mds.a.smithi131.stderr: 2024-04-12T20:04:57.090 INFO:tasks.ceph.mds.a.smithi131.stderr: 0> 2024-04-12T20:04:57.046+0000 7f0e46a00640 -1 *** Caught signal (Aborted) ** 2024-04-12T20:04:57.090 INFO:tasks.ceph.mds.a.smithi131.stderr: in thread 7f0e46a00640 thread_name:ms_dispatch 2024-04-12T20:04:57.090 INFO:tasks.ceph.mds.a.smithi131.stderr: 2024-04-12T20:04:57.090 INFO:tasks.ceph.mds.a.smithi131.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:04:57.090 INFO:tasks.ceph.mds.a.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0e52e54db0] 2024-04-12T20:04:57.090 INFO:tasks.ceph.mds.a.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0e52ea154c] 2024-04-12T20:04:57.090 INFO:tasks.ceph.mds.a.smithi131.stderr: 3: raise() 2024-04-12T20:04:57.090 INFO:tasks.ceph.mds.a.smithi131.stderr: 4: abort() 2024-04-12T20:04:57.091 INFO:tasks.ceph.mds.a.smithi131.stderr: 5: ceph-mds(+0x14db08) [0x563075a0eb08] 2024-04-12T20:04:57.091 INFO:tasks.ceph.mds.a.smithi131.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x563075a859b0] 2024-04-12T20:04:57.091 INFO:tasks.ceph.mds.a.smithi131.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563075d03b62] 2024-04-12T20:04:57.091 INFO:tasks.ceph.mds.a.smithi131.stderr: 8: (MDLog::trim()+0xc8a) [0x563075d0781a] 2024-04-12T20:04:57.091 INFO:tasks.ceph.mds.a.smithi131.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x563075d07cc8] 2024-04-12T20:04:57.091 INFO:tasks.ceph.mds.a.smithi131.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7f0e532db924] 2024-04-12T20:04:57.091 INFO:tasks.ceph.mds.a.smithi131.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7f0e52e9f802] 2024-04-12T20:04:57.091 INFO:tasks.ceph.mds.a.smithi131.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7f0e52e3f450] 2024-04-12T20:04:57.091 INFO:tasks.ceph.mds.a.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-12T20:04:57.091 INFO:tasks.ceph.mds.a.smithi131.stderr: 2024-04-12T20:04:57.104 INFO:tasks.ceph.mds.a.smithi131.stderr: 0> 2024-04-12T20:04:57.046+0000 7f0e46a00640 -1 *** Caught signal (Aborted) ** 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: in thread 7f0e46a00640 thread_name:ms_dispatch 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: ceph version 19.0.0-2879-g324baf8d (324baf8ddb91dea46cac50cb535c306115791355) squid (dev) 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f0e52e54db0] 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f0e52ea154c] 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: 3: raise() 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: 4: abort() 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: 5: ceph-mds(+0x14db08) [0x563075a0eb08] 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: 6: (LogSegment::try_to_expire(MDSRank*, C_GatherBuilderBase >&, int)+0x2460) [0x563075a859b0] 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: 7: (MDLog::try_expire(LogSegment*, int)+0x62) [0x563075d03b62] 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: 8: (MDLog::trim()+0xc8a) [0x563075d0781a] 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: 9: (MDLog::log_trim_upkeep()+0x398) [0x563075d07cc8] 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: 10: /lib64/libstdc++.so.6(+0xdb924) [0x7f0e532db924] 2024-04-12T20:04:57.105 INFO:tasks.ceph.mds.a.smithi131.stderr: 11: /lib64/libc.so.6(+0x9f802) [0x7f0e52e9f802] 2024-04-12T20:04:57.106 INFO:tasks.ceph.mds.a.smithi131.stderr: 12: /lib64/libc.so.6(+0x3f450) [0x7f0e52e3f450] 2024-04-12T20:04:57.106 INFO:tasks.ceph.mds.a.smithi131.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-04-12T20:04:57.106 INFO:tasks.ceph.mds.a.smithi131.stderr: 2024-04-12T20:04:57.934 INFO:tasks.ceph.mds.a.smithi131.stderr:daemon-helper: command crashed with signal 6 2024-04-12T20:05:02.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-04-12T20:05:02.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~26s 2024-04-12T20:05:02.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~78s 2024-04-12T20:05:02.706 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~52s 2024-04-12T20:05:09.017 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~6s 2024-04-12T20:05:09.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~32s 2024-04-12T20:05:09.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~84s 2024-04-12T20:05:09.018 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~58s 2024-04-12T20:05:15.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~13s 2024-04-12T20:05:15.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~38s 2024-04-12T20:05:15.329 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~91s 2024-04-12T20:05:15.330 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~64s 2024-04-12T20:05:21.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~19s 2024-04-12T20:05:21.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~45s 2024-04-12T20:05:21.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~97s 2024-04-12T20:05:21.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~71s 2024-04-12T20:05:22.699 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:05:22.707 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:05:27.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~25s 2024-04-12T20:05:27.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~51s 2024-04-12T20:05:27.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~103s 2024-04-12T20:05:27.952 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~77s 2024-04-12T20:05:34.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~32s 2024-04-12T20:05:34.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~57s 2024-04-12T20:05:34.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~110s 2024-04-12T20:05:34.263 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~83s 2024-04-12T20:05:40.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~38s 2024-04-12T20:05:40.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~64s 2024-04-12T20:05:40.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~116s 2024-04-12T20:05:40.573 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~90s 2024-04-12T20:05:46.884 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~44s 2024-04-12T20:05:46.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~70s 2024-04-12T20:05:46.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~122s 2024-04-12T20:05:46.885 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~96s 2024-04-12T20:05:52.855 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:05:52.864 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:05:53.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~50s 2024-04-12T20:05:53.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~76s 2024-04-12T20:05:53.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~129s 2024-04-12T20:05:53.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~102s 2024-04-12T20:05:59.507 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~57s 2024-04-12T20:05:59.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~82s 2024-04-12T20:05:59.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~135s 2024-04-12T20:05:59.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~109s 2024-04-12T20:06:05.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~63s 2024-04-12T20:06:05.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~89s 2024-04-12T20:06:05.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~141s 2024-04-12T20:06:05.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~115s 2024-04-12T20:06:12.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~69s 2024-04-12T20:06:12.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~95s 2024-04-12T20:06:12.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~148s 2024-04-12T20:06:12.129 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~121s 2024-04-12T20:06:18.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~76s 2024-04-12T20:06:18.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~101s 2024-04-12T20:06:18.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~154s 2024-04-12T20:06:18.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~127s 2024-04-12T20:06:23.012 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:06:23.020 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:06:24.750 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~82s 2024-04-12T20:06:24.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~108s 2024-04-12T20:06:24.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~160s 2024-04-12T20:06:24.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~134s 2024-04-12T20:06:31.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~88s 2024-04-12T20:06:31.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~114s 2024-04-12T20:06:31.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~167s 2024-04-12T20:06:31.063 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~140s 2024-04-12T20:06:37.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~95s 2024-04-12T20:06:37.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~120s 2024-04-12T20:06:37.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~173s 2024-04-12T20:06:37.374 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~146s 2024-04-12T20:06:43.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~101s 2024-04-12T20:06:43.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~127s 2024-04-12T20:06:43.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~179s 2024-04-12T20:06:43.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~153s 2024-04-12T20:06:49.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~107s 2024-04-12T20:06:49.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~133s 2024-04-12T20:06:49.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~185s 2024-04-12T20:06:49.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~159s 2024-04-12T20:06:53.157 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:06:53.165 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:06:56.306 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~114s 2024-04-12T20:06:56.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~139s 2024-04-12T20:06:56.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~192s 2024-04-12T20:06:56.307 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~165s 2024-04-12T20:07:02.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~120s 2024-04-12T20:07:02.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~146s 2024-04-12T20:07:02.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~198s 2024-04-12T20:07:02.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~172s 2024-04-12T20:07:08.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~126s 2024-04-12T20:07:08.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~152s 2024-04-12T20:07:08.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~204s 2024-04-12T20:07:08.929 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~178s 2024-04-12T20:07:15.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~133s 2024-04-12T20:07:15.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~158s 2024-04-12T20:07:15.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~211s 2024-04-12T20:07:15.241 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~184s 2024-04-12T20:07:21.552 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~139s 2024-04-12T20:07:21.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~164s 2024-04-12T20:07:21.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~217s 2024-04-12T20:07:21.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~191s 2024-04-12T20:07:23.303 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:07:23.312 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:07:27.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~145s 2024-04-12T20:07:27.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~171s 2024-04-12T20:07:27.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~223s 2024-04-12T20:07:27.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~197s 2024-04-12T20:07:34.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~151s 2024-04-12T20:07:34.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~177s 2024-04-12T20:07:34.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~230s 2024-04-12T20:07:34.175 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~203s 2024-04-12T20:07:40.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~158s 2024-04-12T20:07:40.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~183s 2024-04-12T20:07:40.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~236s 2024-04-12T20:07:40.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~209s 2024-04-12T20:07:46.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~164s 2024-04-12T20:07:46.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~190s 2024-04-12T20:07:46.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~242s 2024-04-12T20:07:46.797 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~216s 2024-04-12T20:07:53.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~170s 2024-04-12T20:07:53.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~196s 2024-04-12T20:07:53.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~249s 2024-04-12T20:07:53.111 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~222s 2024-04-12T20:07:53.442 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:07:53.450 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:07:59.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~177s 2024-04-12T20:07:59.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~202s 2024-04-12T20:07:59.422 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~255s 2024-04-12T20:07:59.423 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~228s 2024-04-12T20:08:05.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~183s 2024-04-12T20:08:05.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~209s 2024-04-12T20:08:05.732 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~261s 2024-04-12T20:08:05.733 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~235s 2024-04-12T20:08:12.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~189s 2024-04-12T20:08:12.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~215s 2024-04-12T20:08:12.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~267s 2024-04-12T20:08:12.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~241s 2024-04-12T20:08:18.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~196s 2024-04-12T20:08:18.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~221s 2024-04-12T20:08:18.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~274s 2024-04-12T20:08:18.354 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~247s 2024-04-12T20:08:23.596 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:08:23.604 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:08:24.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~202s 2024-04-12T20:08:24.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~228s 2024-04-12T20:08:24.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~280s 2024-04-12T20:08:24.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~254s 2024-04-12T20:08:30.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~208s 2024-04-12T20:08:30.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~234s 2024-04-12T20:08:30.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~286s 2024-04-12T20:08:30.976 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~260s 2024-04-12T20:08:37.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~215s 2024-04-12T20:08:37.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~240s 2024-04-12T20:08:37.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~293s 2024-04-12T20:08:37.288 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~266s 2024-04-12T20:08:43.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~221s 2024-04-12T20:08:43.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~247s 2024-04-12T20:08:43.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~299s 2024-04-12T20:08:43.599 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~273s 2024-04-12T20:08:49.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~227s 2024-04-12T20:08:49.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~253s 2024-04-12T20:08:49.909 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~305s 2024-04-12T20:08:49.910 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~279s 2024-04-12T20:08:49.910 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2024-04-12T20:08:49.910 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T20:08:49.910 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T20:08:49.968 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T20:08:50.074 INFO:tasks.workunit.client.0.smithi131.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh: line 24: 49253 Bus error (core dumped) git reset --hard $ver 2024-04-12T20:08:50.075 DEBUG:teuthology.orchestra.run:got remote process result: 135 2024-04-12T20:08:50.075 INFO:tasks.workunit:Stopping ['fs/snaps'] on client.0... 2024-04-12T20:08:50.075 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-12T20:08:50.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.171+0000 7f46ee400640 1 Processor -- start 2024-04-12T20:08:50.170 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.171+0000 7f46ee400640 1 -- start start 2024-04-12T20:08:50.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.172+0000 7f46ee400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46e806df60 0x7f46e806c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:50.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.172+0000 7f46ee400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46e806cdd0 0x7f46e815b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:50.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.172+0000 7f46ee400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e806c0d0 con 0x7f46e814e870 2024-04-12T20:08:50.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.172+0000 7f46ee400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f46e806e3c0 con 0x7f46e806cdd0 2024-04-12T20:08:50.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.172+0000 7f46ee400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f46e80c2b80 con 0x7f46e806df60 2024-04-12T20:08:50.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.173+0000 7f46eda00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46e806cdd0 0x7f46e815b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:50.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.173+0000 7f46eda00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f46e806cdd0 0x7f46e815b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39738/0 (socket says 172.21.15.131:39738) 2024-04-12T20:08:50.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.173+0000 7f46eda00640 1 -- 172.21.15.131:0/2447555431 learned_addr learned my addr 172.21.15.131:0/2447555431 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:50.172 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.173+0000 7f46e7e00640 1 --2- 172.21.15.131:0/2447555431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46e806df60 0x7f46e806c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:50.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.173+0000 7f46eda00640 1 -- 172.21.15.131:0/2447555431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46e806df60 msgr2=0x7f46e806c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:50.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.173+0000 7f46eda00640 1 --2- 172.21.15.131:0/2447555431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46e806df60 0x7f46e806c890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.173+0000 7f46eda00640 1 -- 172.21.15.131:0/2447555431 >> v1:172.21.15.171:6789/0 conn(0x7f46e814e870 legacy=0x7f46e80c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:50.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.173+0000 7f46eda00640 1 -- 172.21.15.131:0/2447555431 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e8151c60 con 0x7f46e806cdd0 2024-04-12T20:08:50.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.175+0000 7f46eda00640 1 --2- 172.21.15.131:0/2447555431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e806cdd0 0x7f46e815b8e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009e50 tx=0x7f46e002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff4d01d8343e51b server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:50.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.175+0000 7f46e7400640 1 -- 172.21.15.131:0/2447555431 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e002cb00 con 0x7f46e806cdd0 2024-04-12T20:08:50.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.176+0000 7f46e7400640 1 -- 172.21.15.131:0/2447555431 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46e002cca0 con 0x7f46e806cdd0 2024-04-12T20:08:50.175 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.176+0000 7f46e7400640 1 -- 172.21.15.131:0/2447555431 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46e0034610 con 0x7f46e806cdd0 2024-04-12T20:08:50.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.176+0000 7f46ee400640 1 -- 172.21.15.131:0/2447555431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e806cdd0 msgr2=0x7f46e815b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:50.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.176+0000 7f46ee400640 1 --2- 172.21.15.131:0/2447555431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e806cdd0 0x7f46e815b8e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f46e0009e50 tx=0x7f46e002bf60 comp rx=0 tx=0).stop 2024-04-12T20:08:50.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.176+0000 7f46ee400640 1 -- 172.21.15.131:0/2447555431 shutdown_connections 2024-04-12T20:08:50.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.176+0000 7f46ee400640 1 --2- 172.21.15.131:0/2447555431 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e806cdd0 0x7f46e815b8e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.176+0000 7f46ee400640 1 --2- 172.21.15.131:0/2447555431 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46e806df60 0x7f46e806c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.176+0000 7f46ee400640 1 -- 172.21.15.131:0/2447555431 >> 172.21.15.131:0/2447555431 conn(0x7f46e80c6750 msgr2=0x7f46e80c6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:50.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.176+0000 7f46ee400640 1 -- 172.21.15.131:0/2447555431 shutdown_connections 2024-04-12T20:08:50.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.176+0000 7f46ee400640 1 -- 172.21.15.131:0/2447555431 wait complete. 2024-04-12T20:08:50.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.178+0000 7f46ee400640 1 Processor -- start 2024-04-12T20:08:50.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.178+0000 7f46ee400640 1 -- start start 2024-04-12T20:08:50.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.179+0000 7f46ee400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46e806cdd0 0x7f46e81e9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:50.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.179+0000 7f46ee400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e806df60 0x7f46e814a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:50.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.179+0000 7f46ee400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e814e870 0x7f46e814a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:50.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.179+0000 7f46ee400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f46e8151f40 con 0x7f46e806df60 2024-04-12T20:08:50.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.179+0000 7f46ee400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f46e80c4c60 con 0x7f46e814e870 2024-04-12T20:08:50.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.179+0000 7f46ee400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f46e806e800 con 0x7f46e806cdd0 2024-04-12T20:08:50.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.179+0000 7f46e7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e806df60 0x7f46e814a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:50.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.179+0000 7f46e7e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e806df60 0x7f46e814a0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39744/0 (socket says 172.21.15.131:39744) 2024-04-12T20:08:50.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.179+0000 7f46e7e00640 1 -- 172.21.15.131:0/3692168375 learned_addr learned my addr 172.21.15.131:0/3692168375 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:50.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.180+0000 7f46ed000640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46e806cdd0 0x7f46e81e9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:50.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.180+0000 7f46eda00640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e814e870 0x7f46e814a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:50.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.180+0000 7f46e7e00640 1 -- 172.21.15.131:0/3692168375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46e806cdd0 msgr2=0x7f46e81e9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:50.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.180+0000 7f46e7e00640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46e806cdd0 0x7f46e81e9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.180+0000 7f46e7e00640 1 -- 172.21.15.131:0/3692168375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e814e870 msgr2=0x7f46e814a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:50.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.180+0000 7f46e7e00640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e814e870 0x7f46e814a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.180+0000 7f46e7e00640 1 -- 172.21.15.131:0/3692168375 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e80ac620 con 0x7f46e806df60 2024-04-12T20:08:50.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.180+0000 7f46e7e00640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e806df60 0x7f46e814a0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f46d400d800 tx=0x7f46d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:50.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.180+0000 7f46e4c00640 1 -- 172.21.15.131:0/3692168375 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d400b6c0 con 0x7f46e806df60 2024-04-12T20:08:50.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.180+0000 7f46e4c00640 1 -- 172.21.15.131:0/3692168375 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46d4019070 con 0x7f46e806df60 2024-04-12T20:08:50.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.180+0000 7f46e4c00640 1 -- 172.21.15.131:0/3692168375 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46d400ba80 con 0x7f46e806df60 2024-04-12T20:08:50.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.180+0000 7f46ee400640 1 -- 172.21.15.131:0/3692168375 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46e814b1a0 con 0x7f46e806df60 2024-04-12T20:08:50.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.181+0000 7f46ee400640 1 -- 172.21.15.131:0/3692168375 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46e81ea810 con 0x7f46e806df60 2024-04-12T20:08:50.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.182+0000 7f46ee400640 1 -- 172.21.15.131:0/3692168375 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46e814ec50 con 0x7f46e806df60 2024-04-12T20:08:50.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.183+0000 7f46e4c00640 1 -- 172.21.15.131:0/3692168375 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f46d400bc20 con 0x7f46e806df60 2024-04-12T20:08:50.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.184+0000 7f46e4c00640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f46c806c8f0 0x7f46c806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:50.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.184+0000 7f46e4c00640 1 -- 172.21.15.131:0/3692168375 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f46d408c560 con 0x7f46e806df60 2024-04-12T20:08:50.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.184+0000 7f46ed000640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f46c806c8f0 0x7f46c806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:50.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.185+0000 7f46ed000640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f46c806c8f0 0x7f46c806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f46dc001500 tx=0x7f46dc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:50.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.189+0000 7f46e4c00640 1 -- 172.21.15.131:0/3692168375 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f46e814ec50 con 0x7f46e806df60 2024-04-12T20:08:50.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.395+0000 7f46ee400640 1 -- 172.21.15.131:0/3692168375 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f46e8075c30 con 0x7f46e806df60 2024-04-12T20:08:50.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.396+0000 7f46e4c00640 1 -- 172.21.15.131:0/3692168375 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+19332 (secure 0 0 0) 0x7f46d401c360 con 0x7f46e806df60 2024-04-12T20:08:50.396 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T20:08:50.397 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":53,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T20:04:46.991521+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.131:6837/2898590457":"2024-04-13T20:04:46.991422+0000","172.21.15.131:6835/2898590457":"2024-04-13T20:04:46.991422+0000","172.21.15.171:6835/373698102":"2024-04-13T20:04:21.983874+0000","172.21.15.171:6833/373698102":"2024-04-13T20:04:21.983874+0000","172.21.15.171:6834/1013642393":"2024-04-13T20:03:56.972117+0000","172.21.15.171:6832/1013642393":"2024-04-13T20:03:56.972117+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T20:08:50.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.399+0000 7f46ee400640 1 -- 172.21.15.131:0/3692168375 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f46c806c8f0 msgr2=0x7f46c806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:50.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.399+0000 7f46ee400640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f46c806c8f0 0x7f46c806edb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f46dc001500 tx=0x7f46dc009040 comp rx=0 tx=0).stop 2024-04-12T20:08:50.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.399+0000 7f46ee400640 1 -- 172.21.15.131:0/3692168375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e806df60 msgr2=0x7f46e814a0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:50.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.399+0000 7f46ee400640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e806df60 0x7f46e814a0d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f46d400d800 tx=0x7f46d400dcc0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.399+0000 7f46ee400640 1 -- 172.21.15.131:0/3692168375 shutdown_connections 2024-04-12T20:08:50.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.399+0000 7f46ee400640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f46c806c8f0 0x7f46c806edb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.399+0000 7f46ee400640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f46e814e870 0x7f46e814a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.399+0000 7f46ee400640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46e806df60 0x7f46e814a0d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.399+0000 7f46ee400640 1 --2- 172.21.15.131:0/3692168375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f46e806cdd0 0x7f46e81e9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.399+0000 7f46ee400640 1 -- 172.21.15.131:0/3692168375 >> 172.21.15.131:0/3692168375 conn(0x7f46e80c6750 msgr2=0x7f46e814c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:50.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.400+0000 7f46ee400640 1 -- 172.21.15.131:0/3692168375 shutdown_connections 2024-04-12T20:08:50.400 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.400+0000 7f46ee400640 1 -- 172.21.15.131:0/3692168375 wait complete. 2024-04-12T20:08:50.417 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T19:39:04.855067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-12T19:39:09.370965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-12T19:39:09.858079+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-12T19:39:13.479306+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-12T20:08:50.417 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T20:08:50.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.664+0000 7f04bc000640 1 Processor -- start 2024-04-12T20:08:50.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.664+0000 7f04bc000640 1 -- start start 2024-04-12T20:08:50.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.665+0000 7f04bc000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04b414b5d0 0x7f04b4151c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:50.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.665+0000 7f04bc000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f04b40c1320 0x7f04b40c4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:50.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.665+0000 7f04bc000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04b40c1820 con 0x7f04b40c52f0 2024-04-12T20:08:50.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.665+0000 7f04bc000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f04b40c0860 con 0x7f04b40c1320 2024-04-12T20:08:50.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.665+0000 7f04bc000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f04b41517b0 con 0x7f04b414b5d0 2024-04-12T20:08:50.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.666+0000 7f04b8c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f04b40c1320 0x7f04b40c4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:50.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.666+0000 7f04b9600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04b414b5d0 0x7f04b4151c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:50.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.666+0000 7f04b8c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f04b40c1320 0x7f04b40c4db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3300/0 says I am v2:172.21.15.131:57518/0 (socket says 172.21.15.131:57518) 2024-04-12T20:08:50.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.666+0000 7f04b8c00640 1 -- 172.21.15.131:0/1736688664 learned_addr learned my addr 172.21.15.131:0/1736688664 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:50.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.666+0000 7f04b9600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04b414b5d0 0x7f04b4151c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:54760/0 (socket says 172.21.15.131:54760) 2024-04-12T20:08:50.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.666+0000 7f04b8c00640 1 -- 172.21.15.131:0/1736688664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04b414b5d0 msgr2=0x7f04b4151c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:50.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.666+0000 7f04b8c00640 1 --2- 172.21.15.131:0/1736688664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04b414b5d0 0x7f04b4151c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.666+0000 7f04b8c00640 1 -- 172.21.15.131:0/1736688664 >> v1:172.21.15.171:6789/0 conn(0x7f04b40c52f0 legacy=0x7f04b4154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:50.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.667+0000 7f04b8c00640 1 -- 172.21.15.131:0/1736688664 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b40c1b00 con 0x7f04b40c1320 2024-04-12T20:08:50.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.668+0000 7f04b8c00640 1 --2- 172.21.15.131:0/1736688664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04b40c1320 0x7f04b40c4db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009870 tx=0x7f04a802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7898a916fad4c03 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:50.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.669+0000 7f04b3e00640 1 -- 172.21.15.131:0/1736688664 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8034070 con 0x7f04b40c1320 2024-04-12T20:08:50.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.669+0000 7f04b3e00640 1 -- 172.21.15.131:0/1736688664 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04a8030840 con 0x7f04b40c1320 2024-04-12T20:08:50.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.669+0000 7f04b3e00640 1 -- 172.21.15.131:0/1736688664 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a8030c10 con 0x7f04b40c1320 2024-04-12T20:08:50.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.669+0000 7f04bc000640 1 -- 172.21.15.131:0/1736688664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04b40c1320 msgr2=0x7f04b40c4db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:50.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.669+0000 7f04bc000640 1 --2- 172.21.15.131:0/1736688664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04b40c1320 0x7f04b40c4db0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009870 tx=0x7f04a802b980 comp rx=0 tx=0).stop 2024-04-12T20:08:50.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.669+0000 7f04bc000640 1 -- 172.21.15.131:0/1736688664 shutdown_connections 2024-04-12T20:08:50.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.669+0000 7f04bc000640 1 --2- 172.21.15.131:0/1736688664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04b40c1320 0x7f04b40c4db0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.669+0000 7f04bc000640 1 --2- 172.21.15.131:0/1736688664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04b414b5d0 0x7f04b4151c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.669+0000 7f04bc000640 1 -- 172.21.15.131:0/1736688664 >> 172.21.15.131:0/1736688664 conn(0x7f04b40a84b0 msgr2=0x7f04b40a88c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:50.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.669+0000 7f04bc000640 1 -- 172.21.15.131:0/1736688664 shutdown_connections 2024-04-12T20:08:50.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.669+0000 7f04bc000640 1 -- 172.21.15.131:0/1736688664 wait complete. 2024-04-12T20:08:50.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.671+0000 7f04bc000640 1 Processor -- start 2024-04-12T20:08:50.670 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.671+0000 7f04bc000640 1 -- start start 2024-04-12T20:08:50.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.672+0000 7f04bc000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04b40c1320 0x7f04b40a9830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:50.672 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.672+0000 7f04bc000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04b40c52f0 0x7f04b40aa800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.672+0000 7f04bc000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04b414b5d0 0x7f04b40be060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.672+0000 7f04bc000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f04b41510f0 con 0x7f04b414b5d0 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.672+0000 7f04bc000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f04b406e2e0 con 0x7f04b40c1320 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.672+0000 7f04bc000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f04b40c0c80 con 0x7f04b40c52f0 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.672+0000 7f04ba000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04b414b5d0 0x7f04b40be060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.673+0000 7f04ba000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04b414b5d0 0x7f04b40be060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39752/0 (socket says 172.21.15.131:39752) 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.673+0000 7f04ba000640 1 -- 172.21.15.131:0/2644720058 learned_addr learned my addr 172.21.15.131:0/2644720058 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.673+0000 7f04b8c00640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04b40c52f0 0x7f04b40aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.673+0000 7f04b9600640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04b40c1320 0x7f04b40a9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.673+0000 7f04ba000640 1 -- 172.21.15.131:0/2644720058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04b40c52f0 msgr2=0x7f04b40aa800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.673+0000 7f04ba000640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04b40c52f0 0x7f04b40aa800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.673+0000 7f04ba000640 1 -- 172.21.15.131:0/2644720058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04b40c1320 msgr2=0x7f04b40a9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.673+0000 7f04ba000640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04b40c1320 0x7f04b40a9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.673 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.673+0000 7f04ba000640 1 -- 172.21.15.131:0/2644720058 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04b41de1c0 con 0x7f04b414b5d0 2024-04-12T20:08:50.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.673+0000 7f04ba000640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04b414b5d0 0x7f04b40be060 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00c730 tx=0x7f04ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:50.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.674+0000 7f04b1600640 1 -- 172.21.15.131:0/2644720058 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac003b70 con 0x7f04b414b5d0 2024-04-12T20:08:50.674 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.674+0000 7f04b1600640 1 -- 172.21.15.131:0/2644720058 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04ac003d10 con 0x7f04b414b5d0 2024-04-12T20:08:50.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.674+0000 7f04bc000640 1 -- 172.21.15.131:0/2644720058 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04b40a9d70 con 0x7f04b414b5d0 2024-04-12T20:08:50.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.674+0000 7f04b1600640 1 -- 172.21.15.131:0/2644720058 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04ac00aa90 con 0x7f04b414b5d0 2024-04-12T20:08:50.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.674+0000 7f04bc000640 1 -- 172.21.15.131:0/2644720058 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04b41dd920 con 0x7f04b414b5d0 2024-04-12T20:08:50.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.675+0000 7f04bc000640 1 -- 172.21.15.131:0/2644720058 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04b40694c0 con 0x7f04b414b5d0 2024-04-12T20:08:50.675 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.676+0000 7f04b1600640 1 -- 172.21.15.131:0/2644720058 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f04ac00ac30 con 0x7f04b414b5d0 2024-04-12T20:08:50.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.678+0000 7f04b1600640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f049406c8f0 0x7f049406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:50.677 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.678+0000 7f04b1600640 1 -- 172.21.15.131:0/2644720058 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f04ac08bee0 con 0x7f04b414b5d0 2024-04-12T20:08:50.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.678+0000 7f04b9600640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f049406c8f0 0x7f049406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:50.678 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.679+0000 7f04b9600640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f049406c8f0 0x7f049406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009ad0 tx=0x7f04a0008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:50.681 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.682+0000 7f04b1600640 1 -- 172.21.15.131:0/2644720058 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f04b40694c0 con 0x7f04b414b5d0 2024-04-12T20:08:50.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.881+0000 7f04bc000640 1 -- 172.21.15.131:0/2644720058 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f04b404fd50 con 0x7f04b414b5d0 2024-04-12T20:08:50.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.881+0000 7f04b1600640 1 -- 172.21.15.131:0/2644720058 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) ==== 93+0+10 (secure 0 0 0) 0x7f04ac059e90 con 0x7f04b414b5d0 2024-04-12T20:08:50.881 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-12T20:08:50.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.884+0000 7f04bc000640 1 -- 172.21.15.131:0/2644720058 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f049406c8f0 msgr2=0x7f049406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:50.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.884+0000 7f04bc000640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f049406c8f0 0x7f049406edb0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f04a0009ad0 tx=0x7f04a0008040 comp rx=0 tx=0).stop 2024-04-12T20:08:50.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.884+0000 7f04bc000640 1 -- 172.21.15.131:0/2644720058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04b414b5d0 msgr2=0x7f04b40be060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:50.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.884+0000 7f04bc000640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04b414b5d0 0x7f04b40be060 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f04ac00c730 tx=0x7f04ac00cbf0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.883 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.884+0000 7f04bc000640 1 -- 172.21.15.131:0/2644720058 shutdown_connections 2024-04-12T20:08:50.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.884+0000 7f04bc000640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f049406c8f0 0x7f049406edb0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.884+0000 7f04bc000640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04b414b5d0 0x7f04b40be060 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.884+0000 7f04bc000640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f04b40c52f0 0x7f04b40aa800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.884+0000 7f04bc000640 1 --2- 172.21.15.131:0/2644720058 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f04b40c1320 0x7f04b40a9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:50.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.884+0000 7f04bc000640 1 -- 172.21.15.131:0/2644720058 >> 172.21.15.131:0/2644720058 conn(0x7f04b40a84b0 msgr2=0x7f04b41d7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:50.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.884+0000 7f04bc000640 1 -- 172.21.15.131:0/2644720058 shutdown_connections 2024-04-12T20:08:50.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:50.884+0000 7f04bc000640 1 -- 172.21.15.131:0/2644720058 wait complete. 2024-04-12T20:08:50.902 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-12T20:08:51.095 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.096+0000 7f1fc2400640 1 Processor -- start 2024-04-12T20:08:51.096 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.096+0000 7f1fc2400640 1 -- start start 2024-04-12T20:08:51.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.097+0000 7f1fc2400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc0c28c0 0x7f1fbc0c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.097+0000 7f1fc2400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fbc0c5e80 con 0x7f1fbc0c3730 2024-04-12T20:08:51.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.098+0000 7f1fc2400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fbc0c2d20 con 0x7f1fbc0c17a0 2024-04-12T20:08:51.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.098+0000 7f1fc2400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1fbc0c59f0 con 0x7f1fbc0c28c0 2024-04-12T20:08:51.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.098+0000 7f1fbbe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f1fbc0c3730 0x7f1fbc15ba80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46876/0 (socket says 172.21.15.131:46876) 2024-04-12T20:08:51.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.098+0000 7f1fbbe00640 1 -- 172.21.15.131:0/3966359286 learned_addr learned my addr 172.21.15.131:0/3966359286 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T20:08:51.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.098+0000 7f1fbaa00640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc0c28c0 0x7f1fbc0c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.098+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911698942 0 0) 0x7f1fbc0c5e80 con 0x7f1fbc0c3730 2024-04-12T20:08:51.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.098+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fa0003520 con 0x7f1fbc0c3730 2024-04-12T20:08:51.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3438342037 0 0) 0x7f1fa0003520 con 0x7f1fbc0c3730 2024-04-12T20:08:51.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc0c28c0 msgr2=0x7f1fbc0c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:51.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc0c28c0 0x7f1fbc0c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.100 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 >> v1:172.21.15.171:6789/0 conn(0x7f1fbc0c17a0 legacy=0x7f1fbc1511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc0c4020 con 0x7f1fbc0c3730 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f1fb40019f0 con 0x7f1fbc0c3730 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 >> v1:172.21.15.131:6789/0 conn(0x7f1fbc0c3730 legacy=0x7f1fbc15ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc0c28c0 0x7f1fa00039e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fa0003f60 0x7f1fa0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fa0004d40 0x7f1fa00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0c59f0 con 0x7f1fa0003f60 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1fa000baa0 con 0x7f1fa0004d40 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1fa000bca0 con 0x7f1fbc0c28c0 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fbaa00640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fa0003f60 0x7f1fa0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fbb400640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc0c28c0 0x7f1fa00039e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.099+0000 7f1fbbe00640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fa0004d40 0x7f1fa00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.100+0000 7f1fbaa00640 1 -- 172.21.15.131:0/3966359286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc0c28c0 msgr2=0x7f1fa00039e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:51.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.100+0000 7f1fbaa00640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc0c28c0 0x7f1fa00039e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.100+0000 7f1fbaa00640 1 -- 172.21.15.131:0/3966359286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fa0004d40 msgr2=0x7f1fa00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:51.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.100+0000 7f1fbaa00640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fa0004d40 0x7f1fa00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.100+0000 7f1fbaa00640 1 -- 172.21.15.131:0/3966359286 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fa0003520 con 0x7f1fa0003f60 2024-04-12T20:08:51.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.100+0000 7f1fbbe00640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fa0004d40 0x7f1fa00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:51.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.101+0000 7f1fbaa00640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fa0003f60 0x7f1fa0004800 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009ac0 tx=0x7f1fa0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b45d5667e637058 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:51.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.101+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8039070 con 0x7f1fa0003f60 2024-04-12T20:08:51.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.101+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa802c6b0 con 0x7f1fa0003f60 2024-04-12T20:08:51.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.101+0000 7f1fba000640 1 -- 172.21.15.131:0/3966359286 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8009690 con 0x7f1fa0003f60 2024-04-12T20:08:51.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.101+0000 7f1fc2400640 1 -- 172.21.15.131:0/3966359286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fa0003f60 msgr2=0x7f1fa0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.101+0000 7f1fc2400640 1 --2- 172.21.15.131:0/3966359286 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fa0003f60 0x7f1fa0004800 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009ac0 tx=0x7f1fa0005830 comp rx=0 tx=0).stop 2024-04-12T20:08:51.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.102+0000 7f1fbbe00640 1 -- 172.21.15.131:0/3966359286 reap_dead start 2024-04-12T20:08:51.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.102+0000 7f1fc2400640 1 -- 172.21.15.131:0/3966359286 shutdown_connections 2024-04-12T20:08:51.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.102+0000 7f1fc2400640 1 -- 172.21.15.131:0/3966359286 >> 172.21.15.131:0/3966359286 conn(0x7f1fbc0a8490 msgr2=0x7f1fbc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:51.105 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.102+0000 7f1fc2400640 1 -- 172.21.15.131:0/3966359286 shutdown_connections 2024-04-12T20:08:51.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.102+0000 7f1fc2400640 1 -- 172.21.15.131:0/3966359286 wait complete. 2024-04-12T20:08:51.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.103+0000 7f1fc2400640 1 Processor -- start 2024-04-12T20:08:51.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.103+0000 7f1fc2400640 1 -- start start 2024-04-12T20:08:51.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.104+0000 7f1fc2400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fa0003f60 0x7f1fbc14faf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.104+0000 7f1fc2400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fbc0bc230 0x7f1fbc14dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.104+0000 7f1fc2400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc14e1d0 0x7f1fbc1ea0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.104+0000 7f1fc2400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0c3ba0 con 0x7f1fa0003f60 2024-04-12T20:08:51.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.104+0000 7f1fc2400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0c6540 con 0x7f1fbc0bc230 2024-04-12T20:08:51.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.104+0000 7f1fc2400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f1fbc1518f0 con 0x7f1fbc14e1d0 2024-04-12T20:08:51.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.105+0000 7f1fbb400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fa0003f60 0x7f1fbc14faf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.105+0000 7f1fbb400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fa0003f60 0x7f1fbc14faf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39770/0 (socket says 172.21.15.131:39770) 2024-04-12T20:08:51.106 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.105+0000 7f1fbb400640 1 -- 172.21.15.131:0/2468761782 learned_addr learned my addr 172.21.15.131:0/2468761782 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.105+0000 7f1fbbe00640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc14e1d0 0x7f1fbc1ea0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.105+0000 7f1fbaa00640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fbc0bc230 0x7f1fbc14dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.105+0000 7f1fbb400640 1 -- 172.21.15.131:0/2468761782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc14e1d0 msgr2=0x7f1fbc1ea0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.105+0000 7f1fbb400640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc14e1d0 0x7f1fbc1ea0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.105+0000 7f1fbb400640 1 -- 172.21.15.131:0/2468761782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fbc0bc230 msgr2=0x7f1fbc14dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.105+0000 7f1fbb400640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fbc0bc230 0x7f1fbc14dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.105+0000 7f1fbb400640 1 -- 172.21.15.131:0/2468761782 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc150030 con 0x7f1fa0003f60 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.105+0000 7f1fbaa00640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fbc0bc230 0x7f1fbc14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.105+0000 7f1fbb400640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fa0003f60 0x7f1fbc14faf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00e580 tx=0x7f1fac00ea40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.106+0000 7f1fb3400640 1 -- 172.21.15.131:0/2468761782 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac0052e0 con 0x7f1fa0003f60 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.106+0000 7f1fb3400640 1 -- 172.21.15.131:0/2468761782 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fac018070 con 0x7f1fa0003f60 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.106+0000 7f1fb3400640 1 -- 172.21.15.131:0/2468761782 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac003810 con 0x7f1fa0003f60 2024-04-12T20:08:51.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.106+0000 7f1fc2400640 1 -- 172.21.15.131:0/2468761782 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc1e7550 con 0x7f1fa0003f60 2024-04-12T20:08:51.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.106+0000 7f1fc2400640 1 -- 172.21.15.131:0/2468761782 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fbc0bd050 con 0x7f1fa0003f60 2024-04-12T20:08:51.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.107+0000 7f1fc2400640 1 -- 172.21.15.131:0/2468761782 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fbc04fd50 con 0x7f1fa0003f60 2024-04-12T20:08:51.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.108+0000 7f1fb3400640 1 -- 172.21.15.131:0/2468761782 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f1fac0039b0 con 0x7f1fa0003f60 2024-04-12T20:08:51.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.109+0000 7f1fb3400640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f1f9c06c8f0 0x7f1f9c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.109+0000 7f1fb3400640 1 -- 172.21.15.131:0/2468761782 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f1fac08bca0 con 0x7f1fa0003f60 2024-04-12T20:08:51.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.109+0000 7f1fbaa00640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f1f9c06c8f0 0x7f1f9c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.110+0000 7f1fbaa00640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f1f9c06c8f0 0x7f1f9c06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8036000 tx=0x7f1fa8030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:51.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.113+0000 7f1fb3400640 1 -- 172.21.15.131:0/2468761782 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f1fac059b70 con 0x7f1fa0003f60 2024-04-12T20:08:51.134 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi131 with status 135: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=324baf8ddb91dea46cac50cb535c306115791355 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2024-04-12T20:08:51.378 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=7f8068191fff4719bfadc19ce4d58bd0 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/workunit.py", line 145, in task _spawn_on_all_clients(ctx, refspec, all_tasks, config.get('env'), File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/workunit.py", line 295, in _spawn_on_all_clients p.spawn(_run_tests, ctx, refspec, role, [unit], env, File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 84, in __exit__ for result in self: File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 98, in __next__ resurrect_traceback(result) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 30, in resurrect_traceback raise exc.exc_info[1] File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/parallel.py", line 23, in capture_traceback return func(*args, **kwargs) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/workunit.py", line 434, in _run_tests remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi131 with status 135: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=324baf8ddb91dea46cac50cb535c306115791355 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh' 2024-04-12T20:08:51.381 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-12T20:08:51.390 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-12T20:08:51.390 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T20:08:51.391 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T20:08:51.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.299+0000 7f1fc2400640 1 -- 172.21.15.131:0/2468761782 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1fbc14e5b0 con 0x7f1fa0003f60 2024-04-12T20:08:51.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.300+0000 7f1fb3400640 1 -- 172.21.15.131:0/2468761782 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) ==== 104+0+11 (secure 0 0 0) 0x7f1fac059470 con 0x7f1fa0003f60 2024-04-12T20:08:51.396 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T20:08:51.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.302+0000 7f1fc2400640 1 -- 172.21.15.131:0/2468761782 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f1f9c06c8f0 msgr2=0x7f1f9c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.302+0000 7f1fc2400640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f1f9c06c8f0 0x7f1f9c06edb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8036000 tx=0x7f1fa8030000 comp rx=0 tx=0).stop 2024-04-12T20:08:51.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.303+0000 7f1fc2400640 1 -- 172.21.15.131:0/2468761782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fa0003f60 msgr2=0x7f1fbc14faf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.303+0000 7f1fc2400640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fa0003f60 0x7f1fbc14faf0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00e580 tx=0x7f1fac00ea40 comp rx=0 tx=0).stop 2024-04-12T20:08:51.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.303+0000 7f1fc2400640 1 -- 172.21.15.131:0/2468761782 shutdown_connections 2024-04-12T20:08:51.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.303+0000 7f1fc2400640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f1f9c06c8f0 0x7f1f9c06edb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.303+0000 7f1fc2400640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f1fbc0bc230 0x7f1fbc14dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.303+0000 7f1fc2400640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f1fbc14e1d0 0x7f1fbc1ea0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.398 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.303+0000 7f1fc2400640 1 --2- 172.21.15.131:0/2468761782 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1fa0003f60 0x7f1fbc14faf0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.303+0000 7f1fc2400640 1 -- 172.21.15.131:0/2468761782 >> 172.21.15.131:0/2468761782 conn(0x7f1fbc0a8490 msgr2=0x7f1fbc0a7bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:51.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.303+0000 7f1fc2400640 1 -- 172.21.15.131:0/2468761782 shutdown_connections 2024-04-12T20:08:51.399 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.303+0000 7f1fc2400640 1 -- 172.21.15.131:0/2468761782 wait complete. 2024-04-12T20:08:51.399 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-12T20:08:51.487 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T20:08:51.487 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T20:08:51.566 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T20:08:51.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.639+0000 7f8c59600640 1 Processor -- start 2024-04-12T20:08:51.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.640+0000 7f8c59600640 1 -- start start 2024-04-12T20:08:51.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.641+0000 7f8c59600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f8c540c28c0 0x7f8c540c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.641+0000 7f8c59600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c540c3730 0x7f8c5415ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.640 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.641+0000 7f8c59600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c540c2d50 con 0x7f8c540c17a0 2024-04-12T20:08:51.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.641+0000 7f8c59600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f8c540c59f0 con 0x7f8c540c28c0 2024-04-12T20:08:51.641 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.641+0000 7f8c59600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c540c5e80 con 0x7f8c540c3730 2024-04-12T20:08:51.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.642+0000 7f8c52a00640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f8c540c17a0 0x7f8c541511e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.131:50616/0 (socket says 172.21.15.131:50616) 2024-04-12T20:08:51.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.642+0000 7f8c52a00640 1 -- 172.21.15.131:0/1291614438 learned_addr learned my addr 172.21.15.131:0/1291614438 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T20:08:51.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.642+0000 7f8c4be00640 1 --2- 172.21.15.131:0/1291614438 >> v2:172.21.15.171:3300/0 conn(0x7f8c540c28c0 0x7f8c540c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.642+0000 7f8c53400640 1 --2- 172.21.15.131:0/1291614438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c540c3730 0x7f8c5415ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.642+0000 7f8c4be00640 1 -- 172.21.15.131:0/1291614438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c540c3730 msgr2=0x7f8c5415ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:51.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.642+0000 7f8c4be00640 1 --2- 172.21.15.131:0/1291614438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c540c3730 0x7f8c5415ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.642+0000 7f8c4be00640 1 -- 172.21.15.131:0/1291614438 >> v1:172.21.15.171:6789/0 conn(0x7f8c540c17a0 legacy=0x7f8c541511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.642+0000 7f8c4be00640 1 -- 172.21.15.131:0/1291614438 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c540c4020 con 0x7f8c540c28c0 2024-04-12T20:08:51.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.644+0000 7f8c4be00640 1 --2- 172.21.15.131:0/1291614438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c540c28c0 0x7f8c540c31f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0097a0 tx=0x7f8c3c02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=403a065342039578 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:51.643 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.644+0000 7f8c52000640 1 -- 172.21.15.131:0/1291614438 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c035020 con 0x7f8c540c28c0 2024-04-12T20:08:51.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.644+0000 7f8c52000640 1 -- 172.21.15.131:0/1291614438 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c3c031810 con 0x7f8c540c28c0 2024-04-12T20:08:51.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.644+0000 7f8c52000640 1 -- 172.21.15.131:0/1291614438 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c031be0 con 0x7f8c540c28c0 2024-04-12T20:08:51.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.645+0000 7f8c59600640 1 -- 172.21.15.131:0/1291614438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c540c28c0 msgr2=0x7f8c540c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.645+0000 7f8c59600640 1 --2- 172.21.15.131:0/1291614438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c540c28c0 0x7f8c540c31f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0097a0 tx=0x7f8c3c02b8b0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.645+0000 7f8c59600640 1 -- 172.21.15.131:0/1291614438 shutdown_connections 2024-04-12T20:08:51.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.645+0000 7f8c59600640 1 --2- 172.21.15.131:0/1291614438 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c540c3730 0x7f8c5415ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.645+0000 7f8c59600640 1 --2- 172.21.15.131:0/1291614438 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c540c28c0 0x7f8c540c31f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.645+0000 7f8c59600640 1 -- 172.21.15.131:0/1291614438 >> 172.21.15.131:0/1291614438 conn(0x7f8c540a8490 msgr2=0x7f8c540a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:51.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.645+0000 7f8c59600640 1 -- 172.21.15.131:0/1291614438 shutdown_connections 2024-04-12T20:08:51.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.645+0000 7f8c59600640 1 -- 172.21.15.131:0/1291614438 wait complete. 2024-04-12T20:08:51.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.646+0000 7f8c59600640 1 Processor -- start 2024-04-12T20:08:51.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.647+0000 7f8c59600640 1 -- start start 2024-04-12T20:08:51.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.647+0000 7f8c59600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c540c17a0 0x7f8c541eaed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.647+0000 7f8c59600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c540c28c0 0x7f8c541ea6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.647+0000 7f8c59600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c540c3730 0x7f8c541da430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.647+0000 7f8c59600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8c540c3ba0 con 0x7f8c540c28c0 2024-04-12T20:08:51.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.647+0000 7f8c59600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8c540c6540 con 0x7f8c540c3730 2024-04-12T20:08:51.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.647+0000 7f8c59600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8c541518f0 con 0x7f8c540c17a0 2024-04-12T20:08:51.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.648+0000 7f8c4be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c540c28c0 0x7f8c541ea6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.648+0000 7f8c4be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c540c28c0 0x7f8c541ea6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39784/0 (socket says 172.21.15.131:39784) 2024-04-12T20:08:51.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.648+0000 7f8c4be00640 1 -- 172.21.15.131:0/2191922713 learned_addr learned my addr 172.21.15.131:0/2191922713 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:51.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.648+0000 7f8c52a00640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c540c17a0 0x7f8c541eaed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.649 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.648+0000 7f8c53400640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c540c3730 0x7f8c541da430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.648+0000 7f8c4be00640 1 -- 172.21.15.131:0/2191922713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c540c17a0 msgr2=0x7f8c541eaed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.648+0000 7f8c4be00640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c540c17a0 0x7f8c541eaed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.648+0000 7f8c4be00640 1 -- 172.21.15.131:0/2191922713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c540c3730 msgr2=0x7f8c541da430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.648+0000 7f8c4be00640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c540c3730 0x7f8c541da430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.648+0000 7f8c4be00640 1 -- 172.21.15.131:0/2191922713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c541eac20 con 0x7f8c540c28c0 2024-04-12T20:08:51.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.648+0000 7f8c53400640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c540c3730 0x7f8c541da430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:51.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.649+0000 7f8c4be00640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c540c28c0 0x7f8c541ea6e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0098c0 tx=0x7f8c3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:51.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.649+0000 7f8c4aa00640 1 -- 172.21.15.131:0/2191922713 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c041070 con 0x7f8c540c28c0 2024-04-12T20:08:51.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.649+0000 7f8c4aa00640 1 -- 172.21.15.131:0/2191922713 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8c3c03ad00 con 0x7f8c540c28c0 2024-04-12T20:08:51.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.649+0000 7f8c4aa00640 1 -- 172.21.15.131:0/2191922713 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c3c035040 con 0x7f8c540c28c0 2024-04-12T20:08:51.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.649+0000 7f8c59600640 1 -- 172.21.15.131:0/2191922713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c541d7300 con 0x7f8c540c28c0 2024-04-12T20:08:51.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.649+0000 7f8c59600640 1 -- 172.21.15.131:0/2191922713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c540a5d40 con 0x7f8c540c28c0 2024-04-12T20:08:51.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.650+0000 7f8c59600640 1 -- 172.21.15.131:0/2191922713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c5404fd50 con 0x7f8c540c28c0 2024-04-12T20:08:51.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.651+0000 7f8c4aa00640 1 -- 172.21.15.131:0/2191922713 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8c3c038020 con 0x7f8c540c28c0 2024-04-12T20:08:51.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.652+0000 7f8c4aa00640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8c3006c920 0x7f8c3006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.652+0000 7f8c4aa00640 1 -- 172.21.15.131:0/2191922713 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f8c3c0adc60 con 0x7f8c540c28c0 2024-04-12T20:08:51.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.653+0000 7f8c52a00640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8c3006c920 0x7f8c3006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.653+0000 7f8c52a00640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8c3006c920 0x7f8c3006ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8c54150cf0 tx=0x7f8c44009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:51.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.656+0000 7f8c4aa00640 1 -- 172.21.15.131:0/2191922713 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8c3c07bb70 con 0x7f8c540c28c0 2024-04-12T20:08:51.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.798+0000 7f9818c00640 1 Processor -- start 2024-04-12T20:08:51.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.798+0000 7f9818c00640 1 -- start start 2024-04-12T20:08:51.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.799+0000 7f9818c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f98140a8120 0x7f98140728d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.799+0000 7f9818c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f98140a4e60 0x7f9814159a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.799+0000 7f9818c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98141531a0 con 0x7f98140a8500 2024-04-12T20:08:51.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.799+0000 7f9818c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f9814153680 con 0x7f98140a4e60 2024-04-12T20:08:51.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.799+0000 7f9818c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9814071df0 con 0x7f98140a8120 2024-04-12T20:08:51.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.800+0000 7f9811400640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f98140a8500 0x7f98141526f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46890/0 (socket says 172.21.15.131:46890) 2024-04-12T20:08:51.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.800+0000 7f9812800640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f98140a4e60 0x7f9814159a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.800+0000 7f9811400640 1 -- 172.21.15.131:0/3710050110 learned_addr learned my addr 172.21.15.131:0/3710050110 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T20:08:51.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.800+0000 7f9811e00640 1 --2- 172.21.15.131:0/3710050110 >> v2:172.21.15.171:3300/0 conn(0x7f98140a8120 0x7f98140728d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.800+0000 7f9812800640 1 -- 172.21.15.131:0/3710050110 >> v2:172.21.15.171:3300/0 conn(0x7f98140a8120 msgr2=0x7f98140728d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:51.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.800+0000 7f9812800640 1 --2- 172.21.15.131:0/3710050110 >> v2:172.21.15.171:3300/0 conn(0x7f98140a8120 0x7f98140728d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.800+0000 7f9812800640 1 -- 172.21.15.131:0/3710050110 >> v1:172.21.15.131:6789/0 conn(0x7f98140a8500 legacy=0x7f98141526f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.800+0000 7f9810a00640 1 -- 172.21.15.131:0/3710050110 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1959993050 0 0) 0x7f98141531a0 con 0x7f98140a8500 2024-04-12T20:08:51.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.800+0000 7f9812800640 1 -- 172.21.15.131:0/3710050110 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98140720d0 con 0x7f98140a4e60 2024-04-12T20:08:51.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.802+0000 7f9812800640 1 --2- 172.21.15.131:0/3710050110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98140a4e60 0x7f9814159a80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f98140b9880 tx=0x7f980c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc8b59ad6f2f16f4 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:51.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.802+0000 7f9810a00640 1 -- 172.21.15.131:0/3710050110 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c039070 con 0x7f98140a4e60 2024-04-12T20:08:51.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.802+0000 7f9810a00640 1 -- 172.21.15.131:0/3710050110 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c02cc80 con 0x7f98140a4e60 2024-04-12T20:08:51.802 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.802+0000 7f9810a00640 1 -- 172.21.15.131:0/3710050110 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c034660 con 0x7f98140a4e60 2024-04-12T20:08:51.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.803+0000 7f9818c00640 1 -- 172.21.15.131:0/3710050110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98140a4e60 msgr2=0x7f9814159a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.803+0000 7f9818c00640 1 --2- 172.21.15.131:0/3710050110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98140a4e60 0x7f9814159a80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f98140b9880 tx=0x7f980c02bed0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.803+0000 7f9818c00640 1 -- 172.21.15.131:0/3710050110 shutdown_connections 2024-04-12T20:08:51.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.803+0000 7f9818c00640 1 --2- 172.21.15.131:0/3710050110 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98140a4e60 0x7f9814159a80 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.803+0000 7f9818c00640 1 --2- 172.21.15.131:0/3710050110 >> v2:172.21.15.171:3300/0 conn(0x7f98140a8120 0x7f98140728d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.803+0000 7f9818c00640 1 -- 172.21.15.131:0/3710050110 >> 172.21.15.131:0/3710050110 conn(0x7f98140c2590 msgr2=0x7f98140c29a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:51.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.803+0000 7f9818c00640 1 -- 172.21.15.131:0/3710050110 shutdown_connections 2024-04-12T20:08:51.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.803+0000 7f9818c00640 1 -- 172.21.15.131:0/3710050110 wait complete. 2024-04-12T20:08:51.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.805+0000 7f9818c00640 1 Processor -- start 2024-04-12T20:08:51.804 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.805+0000 7f9818c00640 1 -- start start 2024-04-12T20:08:51.805 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9818c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98140a4e60 0x7f98140bb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9818c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98140a8120 0x7f981414f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9818c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98140a8500 0x7f981414fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9818c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f981406d970 con 0x7f98140a8500 2024-04-12T20:08:51.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9818c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9814072e10 con 0x7f98140a4e60 2024-04-12T20:08:51.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9818c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9814152e00 con 0x7f98140a8120 2024-04-12T20:08:51.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9812800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98140a8500 0x7f981414fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.806 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9812800640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98140a8500 0x7f981414fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39794/0 (socket says 172.21.15.131:39794) 2024-04-12T20:08:51.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9812800640 1 -- 172.21.15.131:0/4090902493 learned_addr learned my addr 172.21.15.131:0/4090902493 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:51.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9811e00640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98140a4e60 0x7f98140bb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9811400640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98140a8120 0x7f981414f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9812800640 1 -- 172.21.15.131:0/4090902493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98140a8120 msgr2=0x7f981414f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9812800640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98140a8120 0x7f981414f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9812800640 1 -- 172.21.15.131:0/4090902493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98140a4e60 msgr2=0x7f98140bb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9812800640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98140a4e60 0x7f98140bb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.806+0000 7f9812800640 1 -- 172.21.15.131:0/4090902493 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981414b830 con 0x7f98140a8500 2024-04-12T20:08:51.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.807+0000 7f9812800640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98140a8500 0x7f981414fa70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f980c009e80 tx=0x7f980c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:51.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.807+0000 7f980a000640 1 -- 172.21.15.131:0/4090902493 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c039050 con 0x7f98140a8500 2024-04-12T20:08:51.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.807+0000 7f980a000640 1 -- 172.21.15.131:0/4090902493 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f980c045070 con 0x7f98140a8500 2024-04-12T20:08:51.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.807+0000 7f980a000640 1 -- 172.21.15.131:0/4090902493 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f980c009450 con 0x7f98140a8500 2024-04-12T20:08:51.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.807+0000 7f9818c00640 1 -- 172.21.15.131:0/4090902493 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f981414c8f0 con 0x7f98140a8500 2024-04-12T20:08:51.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.807+0000 7f9818c00640 1 -- 172.21.15.131:0/4090902493 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f981414c610 con 0x7f98140a8500 2024-04-12T20:08:51.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.808+0000 7f9818c00640 1 -- 172.21.15.131:0/4090902493 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98140bffa0 con 0x7f98140a8500 2024-04-12T20:08:51.809 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.809+0000 7f980a000640 1 -- 172.21.15.131:0/4090902493 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f980c03e850 con 0x7f98140a8500 2024-04-12T20:08:51.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.810+0000 7f980a000640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f97f406c8f0 0x7f97f406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:51.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.810+0000 7f980a000640 1 -- 172.21.15.131:0/4090902493 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f980c0aec60 con 0x7f98140a8500 2024-04-12T20:08:51.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.810+0000 7f9811e00640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f97f406c8f0 0x7f97f406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:51.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.811+0000 7f9811e00640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f97f406c8f0 0x7f97f406edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9804006fd0 tx=0x7f9804008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:51.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.815+0000 7f980a000640 1 -- 172.21.15.131:0/4090902493 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f98140bffa0 con 0x7f98140a8500 2024-04-12T20:08:51.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.871+0000 7f8c59600640 1 -- 172.21.15.131:0/2191922713 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8c541516a0 con 0x7f8c540c28c0 2024-04-12T20:08:51.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.872+0000 7f8c4aa00640 1 -- 172.21.15.131:0/2191922713 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) ==== 100+0+11 (secure 0 0 0) 0x7f8c3c07b470 con 0x7f8c540c28c0 2024-04-12T20:08:51.871 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-12T20:08:51.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.875+0000 7f8c59600640 1 -- 172.21.15.131:0/2191922713 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8c3006c920 msgr2=0x7f8c3006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.875+0000 7f8c59600640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8c3006c920 0x7f8c3006ede0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8c54150cf0 tx=0x7f8c44009040 comp rx=0 tx=0).stop 2024-04-12T20:08:51.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.875+0000 7f8c59600640 1 -- 172.21.15.131:0/2191922713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c540c28c0 msgr2=0x7f8c541ea6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:51.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.875+0000 7f8c59600640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c540c28c0 0x7f8c541ea6e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f8c3c0098c0 tx=0x7f8c3c0046c0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.875+0000 7f8c59600640 1 -- 172.21.15.131:0/2191922713 shutdown_connections 2024-04-12T20:08:51.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.875+0000 7f8c59600640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8c3006c920 0x7f8c3006ede0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.875+0000 7f8c59600640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8c540c3730 0x7f8c541da430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.875+0000 7f8c59600640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c540c28c0 0x7f8c541ea6e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.875+0000 7f8c59600640 1 --2- 172.21.15.131:0/2191922713 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8c540c17a0 0x7f8c541eaed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:51.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.875+0000 7f8c59600640 1 -- 172.21.15.131:0/2191922713 >> 172.21.15.131:0/2191922713 conn(0x7f8c540a8490 msgr2=0x7f8c540beb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:51.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.875+0000 7f8c59600640 1 -- 172.21.15.131:0/2191922713 shutdown_connections 2024-04-12T20:08:51.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:51.875+0000 7f8c59600640 1 -- 172.21.15.131:0/2191922713 wait complete. 2024-04-12T20:08:51.891 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-12T20:08:52.010 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.011+0000 7f9818c00640 1 -- 172.21.15.131:0/4090902493 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f981404fd50 con 0x7f98140a8500 2024-04-12T20:08:52.012 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.013+0000 7f980a000640 1 -- 172.21.15.131:0/4090902493 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+19332 (secure 0 0 0) 0x7f980c07cc10 con 0x7f98140a8500 2024-04-12T20:08:52.012 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T20:08:52.012 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":53,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T20:04:46.991521+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.131:6837/2898590457":"2024-04-13T20:04:46.991422+0000","172.21.15.131:6835/2898590457":"2024-04-13T20:04:46.991422+0000","172.21.15.171:6835/373698102":"2024-04-13T20:04:21.983874+0000","172.21.15.171:6833/373698102":"2024-04-13T20:04:21.983874+0000","172.21.15.171:6834/1013642393":"2024-04-13T20:03:56.972117+0000","172.21.15.171:6832/1013642393":"2024-04-13T20:03:56.972117+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T20:08:52.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.015+0000 7f9818c00640 1 -- 172.21.15.131:0/4090902493 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f97f406c8f0 msgr2=0x7f97f406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.015+0000 7f9818c00640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f97f406c8f0 0x7f97f406edb0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9804006fd0 tx=0x7f9804008040 comp rx=0 tx=0).stop 2024-04-12T20:08:52.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.015+0000 7f9818c00640 1 -- 172.21.15.131:0/4090902493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98140a8500 msgr2=0x7f981414fa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.015+0000 7f9818c00640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98140a8500 0x7f981414fa70 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f980c009e80 tx=0x7f980c004a40 comp rx=0 tx=0).stop 2024-04-12T20:08:52.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.015+0000 7f9818c00640 1 -- 172.21.15.131:0/4090902493 shutdown_connections 2024-04-12T20:08:52.015 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.015+0000 7f9818c00640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f97f406c8f0 0x7f97f406edb0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.015+0000 7f9818c00640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98140a8500 0x7f981414fa70 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.015+0000 7f9818c00640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f98140a8120 0x7f981414f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.015+0000 7f9818c00640 1 --2- 172.21.15.131:0/4090902493 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f98140a4e60 0x7f98140bb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.015+0000 7f9818c00640 1 -- 172.21.15.131:0/4090902493 >> 172.21.15.131:0/4090902493 conn(0x7f98140c2590 msgr2=0x7f981406f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:52.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.016+0000 7f9818c00640 1 -- 172.21.15.131:0/4090902493 shutdown_connections 2024-04-12T20:08:52.016 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.016+0000 7f9818c00640 1 -- 172.21.15.131:0/4090902493 wait complete. 2024-04-12T20:08:52.033 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T19:39:04.855067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-12T19:39:09.370965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-12T19:39:09.858079+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-12T19:39:13.479306+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-12T20:08:52.034 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T20:08:52.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.121+0000 7fd0b1200640 1 Processor -- start 2024-04-12T20:08:52.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.122+0000 7fd0b1200640 1 -- start start 2024-04-12T20:08:52.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.123+0000 7fd0b1200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd0ac14ae80 0x7fd0ac0c5600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.123+0000 7fd0b1200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ac0c6030 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.123+0000 7fd0b1200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0ac1518f0 con 0x7fd0ac0c5b40 2024-04-12T20:08:52.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.123+0000 7fd0b1200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fd0ac151e90 con 0x7fd0ac14ae80 2024-04-12T20:08:52.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.123+0000 7fd0ab400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd0ac14ae80 0x7fd0ac0c5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.123+0000 7fd0ab400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fd0ac14ae80 0x7fd0ac0c5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39806/0 (socket says 172.21.15.131:39806) 2024-04-12T20:08:52.123 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.123+0000 7fd0ab400640 1 -- 172.21.15.131:0/4170072755 learned_addr learned my addr 172.21.15.131:0/4170072755 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:52.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.124+0000 7fd0ab400640 1 -- 172.21.15.131:0/4170072755 >> v1:172.21.15.171:6789/0 conn(0x7fd0ac0c5b40 legacy=0x7fd0ac06c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:52.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.124+0000 7fd0ab400640 1 -- 172.21.15.131:0/4170072755 >> v1:172.21.15.131:6789/0 conn(0x7fd0ac0c2ae0 legacy=0x7fd0ac0ab6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.124+0000 7fd0ab400640 1 -- 172.21.15.131:0/4170072755 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ac0ac570 con 0x7fd0ac14ae80 2024-04-12T20:08:52.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.124+0000 7fd0aa000640 1 -- 172.21.15.131:0/4170072755 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1085887819 0 0) 0x7fd0ac0c6030 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.124 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.125+0000 7fd0ab400640 1 --2- 172.21.15.131:0/4170072755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac14ae80 0x7fd0ac0c5600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009870 tx=0x7fd09c02b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=972bc6e0196e835b server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:52.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.125+0000 7fd0aa000640 1 -- 172.21.15.131:0/4170072755 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c034070 con 0x7fd0ac14ae80 2024-04-12T20:08:52.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.125+0000 7fd0aa000640 1 -- 172.21.15.131:0/4170072755 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd09c030850 con 0x7fd0ac14ae80 2024-04-12T20:08:52.125 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.125+0000 7fd0aa000640 1 -- 172.21.15.131:0/4170072755 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c030c20 con 0x7fd0ac14ae80 2024-04-12T20:08:52.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.126+0000 7fd0b1200640 1 -- 172.21.15.131:0/4170072755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac14ae80 msgr2=0x7fd0ac0c5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.126+0000 7fd0b1200640 1 --2- 172.21.15.131:0/4170072755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac14ae80 0x7fd0ac0c5600 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009870 tx=0x7fd09c02b990 comp rx=0 tx=0).stop 2024-04-12T20:08:52.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.126+0000 7fd0b1200640 1 -- 172.21.15.131:0/4170072755 shutdown_connections 2024-04-12T20:08:52.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.126+0000 7fd0b1200640 1 --2- 172.21.15.131:0/4170072755 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac14ae80 0x7fd0ac0c5600 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.126+0000 7fd0b1200640 1 -- 172.21.15.131:0/4170072755 >> 172.21.15.131:0/4170072755 conn(0x7fd0ac0c3170 msgr2=0x7fd0ac0c3580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:52.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.126+0000 7fd0b1200640 1 -- 172.21.15.131:0/4170072755 shutdown_connections 2024-04-12T20:08:52.126 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.126+0000 7fd0b1200640 1 -- 172.21.15.131:0/4170072755 wait complete. 2024-04-12T20:08:52.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.127+0000 7fd0b1200640 1 Processor -- start 2024-04-12T20:08:52.127 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.128+0000 7fd0b1200640 1 -- start start 2024-04-12T20:08:52.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.128+0000 7fd0b1200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0c2ae0 0x7fd0ac1da530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.128+0000 7fd0b1200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0ac0c5b40 0x7fd0ac146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.128+0000 7fd0b1200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0ac14ae80 0x7fd0ac147020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.128+0000 7fd0b1200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac0a5f40 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.128+0000 7fd0b1200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fd0ac06be70 con 0x7fd0ac0c5b40 2024-04-12T20:08:52.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.128+0000 7fd0b1200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fd0ac06df60 con 0x7fd0ac14ae80 2024-04-12T20:08:52.129 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.129+0000 7fd0ab400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0c2ae0 0x7fd0ac1da530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.129+0000 7fd0ab400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0c2ae0 0x7fd0ac1da530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39822/0 (socket says 172.21.15.131:39822) 2024-04-12T20:08:52.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.129+0000 7fd0ab400640 1 -- 172.21.15.131:0/1135631672 learned_addr learned my addr 172.21.15.131:0/1135631672 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:52.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.129+0000 7fd0ab400640 1 -- 172.21.15.131:0/1135631672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0ac14ae80 msgr2=0x7fd0ac147020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.129+0000 7fd0ab400640 1 --2- 172.21.15.131:0/1135631672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0ac14ae80 0x7fd0ac147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.129+0000 7fd0ab400640 1 -- 172.21.15.131:0/1135631672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0ac0c5b40 msgr2=0x7fd0ac146ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.129+0000 7fd0ab400640 1 --2- 172.21.15.131:0/1135631672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0ac0c5b40 0x7fd0ac146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.129+0000 7fd0ab400640 1 -- 172.21.15.131:0/1135631672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0ac1daa70 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.130 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.129+0000 7fd0ab400640 1 --2- 172.21.15.131:0/1135631672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0c2ae0 0x7fd0ac1da530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009870 tx=0x7fd09c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:52.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.129+0000 7fd0a3400640 1 -- 172.21.15.131:0/1135631672 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c034040 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.130+0000 7fd0a3400640 1 -- 172.21.15.131:0/1135631672 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd09c03aae0 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.130+0000 7fd0a3400640 1 -- 172.21.15.131:0/1135631672 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09c004030 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.130+0000 7fd0b1200640 1 -- 172.21.15.131:0/1135631672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0ac1e6ff0 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.131 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.130+0000 7fd0b1200640 1 -- 172.21.15.131:0/1135631672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0ac146000 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.131+0000 7fd0b1200640 1 -- 172.21.15.131:0/1135631672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0ac0a75d0 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.132+0000 7fd0a3400640 1 -- 172.21.15.131:0/1135631672 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fd09c04b060 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.133+0000 7fd0a3400640 1 --2- 172.21.15.131:0/1135631672 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd08c06c8f0 0x7fd08c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.133+0000 7fd0a3400640 1 -- 172.21.15.131:0/1135631672 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7fd09c0ae1a0 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.133+0000 7fd0aaa00640 1 --2- 172.21.15.131:0/1135631672 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd08c06c8f0 0x7fd08c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.134+0000 7fd0aaa00640 1 --2- 172.21.15.131:0/1135631672 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd08c06c8f0 0x7fd08c06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac1425d0 tx=0x7fd098007910 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:52.137 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.138+0000 7fd0a3400640 1 -- 172.21.15.131:0/1135631672 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fd0ac0a75d0 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.217+0000 7f8db8400640 1 Processor -- start 2024-04-12T20:08:52.216 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.217+0000 7f8db8400640 1 -- start start 2024-04-12T20:08:52.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.218+0000 7f8db8400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8db00c4e00 0x7f8db0155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.217 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.218+0000 7f8db8400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db014b760 con 0x7f8db014b380 2024-04-12T20:08:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.218+0000 7f8db8400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8db00c3af0 con 0x7f8db00c0a20 2024-04-12T20:08:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.218+0000 7f8db8400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8db00c4760 con 0x7f8db00c4e00 2024-04-12T20:08:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.218+0000 7f8db5a00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f8db014b380 0x7f8db00c1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46908/0 (socket says 172.21.15.131:46908) 2024-04-12T20:08:52.218 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.218+0000 7f8db5a00640 1 -- 172.21.15.131:0/2598492143 learned_addr learned my addr 172.21.15.131:0/2598492143 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T20:08:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8db6400640 1 --2- 172.21.15.131:0/2598492143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8db00c4e00 0x7f8db0155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054014586 0 0) 0x7f8da4001110 con 0x7f8db014b380 2024-04-12T20:08:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d98003520 con 0x7f8db014b380 2024-04-12T20:08:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1002849148 0 0) 0x7f8d98003520 con 0x7f8db014b380 2024-04-12T20:08:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8db00c4e00 msgr2=0x7f8db0155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:52.221 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 --2- 172.21.15.131:0/2598492143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8db00c4e00 0x7f8db0155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 >> v1:172.21.15.171:6789/0 conn(0x7f8db00c0a20 legacy=0x7f8db0151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db00c49b0 con 0x7f8db014b380 2024-04-12T20:08:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f8da4001840 con 0x7f8db014b380 2024-04-12T20:08:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 >> v1:172.21.15.131:6789/0 conn(0x7f8db014b380 legacy=0x7f8db00c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 --2- 172.21.15.131:0/2598492143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d980039e0 0x7f8d98003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 --2- 172.21.15.131:0/2598492143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d98004800 0x7f8d98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 --2- 172.21.15.131:0/2598492143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d980052e0 0x7f8d9800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8db00c4760 con 0x7f8d980039e0 2024-04-12T20:08:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8d9800c160 con 0x7f8d980052e0 2024-04-12T20:08:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8d9800c360 con 0x7f8d98004800 2024-04-12T20:08:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.219+0000 7f8db6400640 1 --2- 172.21.15.131:0/2598492143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8db00c4e00 0x7f8db0155050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T20:08:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.220+0000 7f8db5a00640 1 --2- 172.21.15.131:0/2598492143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d980039e0 0x7f8d98003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.220+0000 7f8db5a00640 1 -- 172.21.15.131:0/2598492143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d98004800 msgr2=0x7f8d98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.220+0000 7f8db5a00640 1 --2- 172.21.15.131:0/2598492143 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d98004800 0x7f8d98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.220+0000 7f8db5a00640 1 -- 172.21.15.131:0/2598492143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d980052e0 msgr2=0x7f8d9800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:52.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.220+0000 7f8db6400640 1 --2- 172.21.15.131:0/2598492143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d980052e0 0x7f8d9800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.220+0000 7f8db5a00640 1 --2- 172.21.15.131:0/2598492143 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8d980052e0 0x7f8d9800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.220+0000 7f8db5a00640 1 -- 172.21.15.131:0/2598492143 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d98003520 con 0x7f8d980039e0 2024-04-12T20:08:52.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.221+0000 7f8db5a00640 1 --2- 172.21.15.131:0/2598492143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d980039e0 0x7f8d98003e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8da4007fd0 tx=0x7f8d98005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e364249579aecf19 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:52.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.221+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4007e30 con 0x7f8d980039e0 2024-04-12T20:08:52.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.221+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da4030070 con 0x7f8d980039e0 2024-04-12T20:08:52.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.222+0000 7f8dafe00640 1 -- 172.21.15.131:0/2598492143 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da402ce50 con 0x7f8d980039e0 2024-04-12T20:08:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.222+0000 7f8db8400640 1 -- 172.21.15.131:0/2598492143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d980039e0 msgr2=0x7f8d98003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.222+0000 7f8db8400640 1 --2- 172.21.15.131:0/2598492143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d980039e0 0x7f8d98003e00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8da4007fd0 tx=0x7f8d98005830 comp rx=0 tx=0).stop 2024-04-12T20:08:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.222+0000 7f8db6400640 1 -- 172.21.15.131:0/2598492143 reap_dead start 2024-04-12T20:08:52.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.222+0000 7f8db8400640 1 -- 172.21.15.131:0/2598492143 shutdown_connections 2024-04-12T20:08:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.222+0000 7f8db8400640 1 -- 172.21.15.131:0/2598492143 >> 172.21.15.131:0/2598492143 conn(0x7f8db00a8490 msgr2=0x7f8db00a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.222+0000 7f8db8400640 1 -- 172.21.15.131:0/2598492143 shutdown_connections 2024-04-12T20:08:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.222+0000 7f8db8400640 1 -- 172.21.15.131:0/2598492143 wait complete. 2024-04-12T20:08:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.224+0000 7f8db8400640 1 Processor -- start 2024-04-12T20:08:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.224+0000 7f8db8400640 1 -- start start 2024-04-12T20:08:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.225+0000 7f8db8400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d980039e0 0x7f8db0149570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.225+0000 7f8db8400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8db00ba9f0 0x7f8db00bc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.225+0000 7f8db8400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db00bcce0 0x7f8db00bd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.225+0000 7f8db8400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8db0154b30 con 0x7f8db00bcce0 2024-04-12T20:08:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.225+0000 7f8db8400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8db0154600 con 0x7f8db00ba9f0 2024-04-12T20:08:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.225+0000 7f8db8400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8db00c1a10 con 0x7f8d980039e0 2024-04-12T20:08:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.225+0000 7f8db6400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db00bcce0 0x7f8db00bd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.225+0000 7f8db6400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db00bcce0 0x7f8db00bd160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39842/0 (socket says 172.21.15.131:39842) 2024-04-12T20:08:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.225+0000 7f8db6400640 1 -- 172.21.15.131:0/432072583 learned_addr learned my addr 172.21.15.131:0/432072583 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.225+0000 7f8db5a00640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d980039e0 0x7f8db0149570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.225+0000 7f8db5000640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8db00ba9f0 0x7f8db00bc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.229 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.226+0000 7f8db6400640 1 -- 172.21.15.131:0/432072583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d980039e0 msgr2=0x7f8db0149570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.226+0000 7f8db6400640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d980039e0 0x7f8db0149570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.226+0000 7f8db6400640 1 -- 172.21.15.131:0/432072583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8db00ba9f0 msgr2=0x7f8db00bc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.226+0000 7f8db6400640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8db00ba9f0 0x7f8db00bc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.226+0000 7f8db6400640 1 -- 172.21.15.131:0/432072583 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8db0149ab0 con 0x7f8db00bcce0 2024-04-12T20:08:52.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.226+0000 7f8db6400640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db00bcce0 0x7f8db00bd160 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8da8004270 tx=0x7f8da8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:52.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.226+0000 7f8dad600640 1 -- 172.21.15.131:0/432072583 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8019070 con 0x7f8db00bcce0 2024-04-12T20:08:52.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.226+0000 7f8dad600640 1 -- 172.21.15.131:0/432072583 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da8007d20 con 0x7f8db00bcce0 2024-04-12T20:08:52.230 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.226+0000 7f8dad600640 1 -- 172.21.15.131:0/432072583 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da8014640 con 0x7f8db00bcce0 2024-04-12T20:08:52.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.226+0000 7f8db8400640 1 -- 172.21.15.131:0/432072583 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8db00bc620 con 0x7f8db00bcce0 2024-04-12T20:08:52.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.227+0000 7f8db8400640 1 -- 172.21.15.131:0/432072583 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8db0149d20 con 0x7f8db00bcce0 2024-04-12T20:08:52.231 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.228+0000 7f8db8400640 1 -- 172.21.15.131:0/432072583 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8db004fd50 con 0x7f8db00bcce0 2024-04-12T20:08:52.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.229+0000 7f8dad600640 1 -- 172.21.15.131:0/432072583 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8da8005d10 con 0x7f8db00bcce0 2024-04-12T20:08:52.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.230+0000 7f8dad600640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8d9006c8f0 0x7f8d9006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.230+0000 7f8dad600640 1 -- 172.21.15.131:0/432072583 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f8da808bca0 con 0x7f8db00bcce0 2024-04-12T20:08:52.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.231+0000 7f8db5a00640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8d9006c8f0 0x7f8d9006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.232 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.232+0000 7f8db5a00640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8d9006c8f0 0x7f8d9006edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8da4034000 tx=0x7f8da4009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:52.235 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.236+0000 7f8dad600640 1 -- 172.21.15.131:0/432072583 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8da8059c50 con 0x7f8db00bcce0 2024-04-12T20:08:52.341 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.342+0000 7fd0b1200640 1 -- 172.21.15.131:0/1135631672 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fd0ac04fd50 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.342 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.343+0000 7fd0a3400640 1 -- 172.21.15.131:0/1135631672 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v53) ==== 103+0+11 (secure 0 0 0) 0x7fd09c03f070 con 0x7fd0ac0c2ae0 2024-04-12T20:08:52.342 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T20:08:52.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.346+0000 7fd0b1200640 1 -- 172.21.15.131:0/1135631672 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd08c06c8f0 msgr2=0x7fd08c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.346+0000 7fd0b1200640 1 --2- 172.21.15.131:0/1135631672 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd08c06c8f0 0x7fd08c06edb0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd0ac1425d0 tx=0x7fd098007910 comp rx=0 tx=0).stop 2024-04-12T20:08:52.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.346+0000 7fd0b1200640 1 -- 172.21.15.131:0/1135631672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0c2ae0 msgr2=0x7fd0ac1da530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.345 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.346+0000 7fd0b1200640 1 --2- 172.21.15.131:0/1135631672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0c2ae0 0x7fd0ac1da530 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fd09c009870 tx=0x7fd09c0046c0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.346+0000 7fd0b1200640 1 -- 172.21.15.131:0/1135631672 shutdown_connections 2024-04-12T20:08:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.346+0000 7fd0b1200640 1 --2- 172.21.15.131:0/1135631672 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fd08c06c8f0 0x7fd08c06edb0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.346+0000 7fd0b1200640 1 --2- 172.21.15.131:0/1135631672 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fd0ac0c5b40 0x7fd0ac146ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.346+0000 7fd0b1200640 1 --2- 172.21.15.131:0/1135631672 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fd0ac14ae80 0x7fd0ac147020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.346+0000 7fd0b1200640 1 --2- 172.21.15.131:0/1135631672 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0c2ae0 0x7fd0ac1da530 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.346+0000 7fd0b1200640 1 -- 172.21.15.131:0/1135631672 >> 172.21.15.131:0/1135631672 conn(0x7fd0ac0c3170 msgr2=0x7fd0ac14a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.346+0000 7fd0b1200640 1 -- 172.21.15.131:0/1135631672 shutdown_connections 2024-04-12T20:08:52.346 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.346+0000 7fd0b1200640 1 -- 172.21.15.131:0/1135631672 wait complete. 2024-04-12T20:08:52.363 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-12T20:08:52.425 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.426+0000 7f8db8400640 1 -- 172.21.15.131:0/432072583 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f8db0153e80 con 0x7f8db00bcce0 2024-04-12T20:08:52.426 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.426+0000 7f8dad600640 1 -- 172.21.15.131:0/432072583 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) ==== 93+0+10 (secure 0 0 0) 0x7f8da8059550 con 0x7f8db00bcce0 2024-04-12T20:08:52.426 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-12T20:08:52.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.429+0000 7f8db8400640 1 -- 172.21.15.131:0/432072583 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8d9006c8f0 msgr2=0x7f8d9006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.429+0000 7f8db8400640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8d9006c8f0 0x7f8d9006edb0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8da4034000 tx=0x7f8da4009030 comp rx=0 tx=0).stop 2024-04-12T20:08:52.428 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.429+0000 7f8db8400640 1 -- 172.21.15.131:0/432072583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db00bcce0 msgr2=0x7f8db00bd160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.429+0000 7f8db8400640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db00bcce0 0x7f8db00bd160 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f8da8004270 tx=0x7f8da8004730 comp rx=0 tx=0).stop 2024-04-12T20:08:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.429+0000 7f8db8400640 1 -- 172.21.15.131:0/432072583 shutdown_connections 2024-04-12T20:08:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.429+0000 7f8db8400640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8d9006c8f0 0x7f8d9006edb0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.429+0000 7f8db8400640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8db00ba9f0 0x7f8db00bc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.429+0000 7f8db8400640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8db00bcce0 0x7f8db00bd160 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.429+0000 7f8db8400640 1 --2- 172.21.15.131:0/432072583 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8d980039e0 0x7f8db0149570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.429+0000 7f8db8400640 1 -- 172.21.15.131:0/432072583 >> 172.21.15.131:0/432072583 conn(0x7f8db00a8490 msgr2=0x7f8db00a6390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:52.429 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.429+0000 7f8db8400640 1 -- 172.21.15.131:0/432072583 shutdown_connections 2024-04-12T20:08:52.430 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.429+0000 7f8db8400640 1 -- 172.21.15.131:0/432072583 wait complete. 2024-04-12T20:08:52.445 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-12T20:08:52.548 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.549+0000 7fba63400640 1 Processor -- start 2024-04-12T20:08:52.549 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.549+0000 7fba63400640 1 -- start start 2024-04-12T20:08:52.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.550+0000 7fba63400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba5c0c17a0 0x7fba5c0c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.550+0000 7fba63400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fba5c1511e0 0x7fba5c151640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.550+0000 7fba63400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba5c0c5e80 con 0x7fba5c0c31f0 2024-04-12T20:08:52.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.550+0000 7fba63400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fba5c0c59f0 con 0x7fba5c1511e0 2024-04-12T20:08:52.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.550+0000 7fba63400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fba5c0c4020 con 0x7fba5c0c17a0 2024-04-12T20:08:52.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.550+0000 7fba53e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fba5c1511e0 0x7fba5c151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.551+0000 7fba53e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fba5c1511e0 0x7fba5c151640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39852/0 (socket says 172.21.15.131:39852) 2024-04-12T20:08:52.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.551+0000 7fba53e00640 1 -- 172.21.15.131:0/1410691216 learned_addr learned my addr 172.21.15.131:0/1410691216 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:52.550 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.551+0000 7fba60a00640 1 --2- 172.21.15.131:0/1410691216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba5c0c17a0 0x7fba5c0c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.551+0000 7fba53e00640 1 -- 172.21.15.131:0/1410691216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba5c0c17a0 msgr2=0x7fba5c0c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:52.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.551+0000 7fba53e00640 1 --2- 172.21.15.131:0/1410691216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba5c0c17a0 0x7fba5c0c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.551 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.551+0000 7fba53e00640 1 -- 172.21.15.131:0/1410691216 >> v1:172.21.15.171:6789/0 conn(0x7fba5c0c31f0 legacy=0x7fba5c0c36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.551+0000 7fba53e00640 1 -- 172.21.15.131:0/1410691216 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c0c6260 con 0x7fba5c1511e0 2024-04-12T20:08:52.552 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.552+0000 7fba53e00640 1 --2- 172.21.15.131:0/1410691216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba5c1511e0 0x7fba5c151640 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fba44009870 tx=0x7fba4402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3492fa786a642c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.552+0000 7fba5be00640 1 -- 172.21.15.131:0/1410691216 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44034070 con 0x7fba5c1511e0 2024-04-12T20:08:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.552+0000 7fba5be00640 1 -- 172.21.15.131:0/1410691216 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba44030840 con 0x7fba5c1511e0 2024-04-12T20:08:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.552+0000 7fba5be00640 1 -- 172.21.15.131:0/1410691216 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44030c10 con 0x7fba5c1511e0 2024-04-12T20:08:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.553+0000 7fba63400640 1 -- 172.21.15.131:0/1410691216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba5c1511e0 msgr2=0x7fba5c151640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.553+0000 7fba63400640 1 --2- 172.21.15.131:0/1410691216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba5c1511e0 0x7fba5c151640 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fba44009870 tx=0x7fba4402b980 comp rx=0 tx=0).stop 2024-04-12T20:08:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.553+0000 7fba63400640 1 -- 172.21.15.131:0/1410691216 shutdown_connections 2024-04-12T20:08:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.553+0000 7fba63400640 1 --2- 172.21.15.131:0/1410691216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba5c1511e0 0x7fba5c151640 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.553 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.553+0000 7fba63400640 1 --2- 172.21.15.131:0/1410691216 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba5c0c17a0 0x7fba5c0c28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.553+0000 7fba63400640 1 -- 172.21.15.131:0/1410691216 >> 172.21.15.131:0/1410691216 conn(0x7fba5c0a8490 msgr2=0x7fba5c0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:52.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.553+0000 7fba63400640 1 -- 172.21.15.131:0/1410691216 shutdown_connections 2024-04-12T20:08:52.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.553+0000 7fba63400640 1 -- 172.21.15.131:0/1410691216 wait complete. 2024-04-12T20:08:52.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.555+0000 7fba63400640 1 Processor -- start 2024-04-12T20:08:52.554 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.555+0000 7fba63400640 1 -- start start 2024-04-12T20:08:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.556+0000 7fba63400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba5c0c17a0 0x7fba5c1d8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.556+0000 7fba63400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba5c0c31f0 0x7fba5c1d9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.556+0000 7fba63400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba5c1511e0 0x7fba5c1d9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.556+0000 7fba63400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c0c48e0 con 0x7fba5c0c17a0 2024-04-12T20:08:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.556+0000 7fba63400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fba5c0c4760 con 0x7fba5c1511e0 2024-04-12T20:08:52.556 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.556+0000 7fba63400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fba5c0c1b80 con 0x7fba5c0c31f0 2024-04-12T20:08:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.556+0000 7fba60a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba5c0c17a0 0x7fba5c1d8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.556+0000 7fba60a00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba5c0c17a0 0x7fba5c1d8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39862/0 (socket says 172.21.15.131:39862) 2024-04-12T20:08:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.556+0000 7fba60a00640 1 -- 172.21.15.131:0/59652566 learned_addr learned my addr 172.21.15.131:0/59652566 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.556+0000 7fba53e00640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba5c0c31f0 0x7fba5c1d9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.556+0000 7fba61400640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba5c1511e0 0x7fba5c1d9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba60a00640 1 -- 172.21.15.131:0/59652566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba5c0c31f0 msgr2=0x7fba5c1d9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba60a00640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba5c0c31f0 0x7fba5c1d9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba60a00640 1 -- 172.21.15.131:0/59652566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba5c1511e0 msgr2=0x7fba5c1d9ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.557 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba60a00640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba5c1511e0 0x7fba5c1d9ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba60a00640 1 -- 172.21.15.131:0/59652566 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5c1d7950 con 0x7fba5c0c17a0 2024-04-12T20:08:52.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba53e00640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba5c0c31f0 0x7fba5c1d9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:52.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba61400640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba5c1511e0 0x7fba5c1d9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:52.558 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba60a00640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba5c0c17a0 0x7fba5c1d8340 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00d830 tx=0x7fba4c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:52.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba59600640 1 -- 172.21.15.131:0/59652566 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00b6c0 con 0x7fba5c0c17a0 2024-04-12T20:08:52.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba59600640 1 -- 172.21.15.131:0/59652566 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba4c019070 con 0x7fba5c0c17a0 2024-04-12T20:08:52.559 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba59600640 1 -- 172.21.15.131:0/59652566 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c00bac0 con 0x7fba5c0c17a0 2024-04-12T20:08:52.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba63400640 1 -- 172.21.15.131:0/59652566 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5c1d7390 con 0x7fba5c0c17a0 2024-04-12T20:08:52.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.557+0000 7fba63400640 1 -- 172.21.15.131:0/59652566 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5c0ba790 con 0x7fba5c0c17a0 2024-04-12T20:08:52.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.559+0000 7fba63400640 1 -- 172.21.15.131:0/59652566 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba5c0c2170 con 0x7fba5c0c17a0 2024-04-12T20:08:52.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.559+0000 7fba59600640 1 -- 172.21.15.131:0/59652566 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fba4c01e460 con 0x7fba5c0c17a0 2024-04-12T20:08:52.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.560+0000 7fba59600640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fba3806c8f0 0x7fba3806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.560+0000 7fba59600640 1 -- 172.21.15.131:0/59652566 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7fba4c08c790 con 0x7fba5c0c17a0 2024-04-12T20:08:52.560 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.560+0000 7fba53e00640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fba3806c8f0 0x7fba3806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.561 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.561+0000 7fba53e00640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fba3806c8f0 0x7fba3806edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fba44036000 tx=0x7fba4403b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:52.563 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.564+0000 7fba59600640 1 -- 172.21.15.131:0/59652566 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fba5c0c2170 con 0x7fba5c0c17a0 2024-04-12T20:08:52.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.627+0000 7f08c6400640 1 Processor -- start 2024-04-12T20:08:52.626 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.627+0000 7f08c6400640 1 -- start start 2024-04-12T20:08:52.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.628+0000 7f08c6400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08c00ba230 0x7f08c00bf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.628+0000 7f08c6400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f08c01511b0 0x7f08c0151660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.628+0000 7f08c6400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08c0073490 con 0x7f08c00704e0 2024-04-12T20:08:52.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.628+0000 7f08c6400640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f08c00beb60 con 0x7f08c01511b0 2024-04-12T20:08:52.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.628+0000 7f08c6400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f08c0073750 con 0x7f08c00ba230 2024-04-12T20:08:52.628 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.628+0000 7f08bfe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f08c01511b0 0x7f08c0151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.628+0000 7f08bea00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f08c00704e0 0x7f08c006b9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46912/0 (socket says 172.21.15.131:46912) 2024-04-12T20:08:52.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.628+0000 7f08bfe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f08c01511b0 0x7f08c0151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39874/0 (socket says 172.21.15.131:39874) 2024-04-12T20:08:52.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.628+0000 7f08bea00640 1 -- 172.21.15.131:0/2420426577 learned_addr learned my addr 172.21.15.131:0/2420426577 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T20:08:52.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.629+0000 7f08bf400640 1 --2- 172.21.15.131:0/2420426577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08c00ba230 0x7f08c00bf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.629+0000 7f08bfe00640 1 -- 172.21.15.131:0/2420426577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08c00ba230 msgr2=0x7f08c00bf8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:52.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.629+0000 7f08bfe00640 1 --2- 172.21.15.131:0/2420426577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08c00ba230 0x7f08c00bf8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.629+0000 7f08bfe00640 1 -- 172.21.15.131:0/2420426577 >> v1:172.21.15.131:6789/0 conn(0x7f08c00704e0 legacy=0x7f08c006b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.629+0000 7f08bfe00640 1 -- 172.21.15.131:0/2420426577 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c0073a30 con 0x7f08c01511b0 2024-04-12T20:08:52.629 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.629+0000 7f08be000640 1 -- 172.21.15.131:0/2420426577 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553182582 0 0) 0x7f08c0073490 con 0x7f08c00704e0 2024-04-12T20:08:52.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.630+0000 7f08bfe00640 1 --2- 172.21.15.131:0/2420426577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08c01511b0 0x7f08c0151660 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009d90 tx=0x7f08b802bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4b6aa78960cad12 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:52.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.631+0000 7f08be000640 1 -- 172.21.15.131:0/2420426577 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8039070 con 0x7f08c01511b0 2024-04-12T20:08:52.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.631+0000 7f08be000640 1 -- 172.21.15.131:0/2420426577 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b802cb30 con 0x7f08c01511b0 2024-04-12T20:08:52.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.631+0000 7f08be000640 1 -- 172.21.15.131:0/2420426577 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b8034440 con 0x7f08c01511b0 2024-04-12T20:08:52.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.631+0000 7f08c6400640 1 -- 172.21.15.131:0/2420426577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08c01511b0 msgr2=0x7f08c0151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.631+0000 7f08c6400640 1 --2- 172.21.15.131:0/2420426577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08c01511b0 0x7f08c0151660 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f08b8009d90 tx=0x7f08b802bd80 comp rx=0 tx=0).stop 2024-04-12T20:08:52.631 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.631+0000 7f08c6400640 1 -- 172.21.15.131:0/2420426577 shutdown_connections 2024-04-12T20:08:52.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.631+0000 7f08c6400640 1 --2- 172.21.15.131:0/2420426577 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08c01511b0 0x7f08c0151660 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.631+0000 7f08c6400640 1 --2- 172.21.15.131:0/2420426577 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08c00ba230 0x7f08c00bf8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.631+0000 7f08c6400640 1 -- 172.21.15.131:0/2420426577 >> 172.21.15.131:0/2420426577 conn(0x7f08c00c0120 msgr2=0x7f08c00c0530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:52.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.632+0000 7f08c6400640 1 -- 172.21.15.131:0/2420426577 shutdown_connections 2024-04-12T20:08:52.632 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.632+0000 7f08c6400640 1 -- 172.21.15.131:0/2420426577 wait complete. 2024-04-12T20:08:52.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.633+0000 7f08c6400640 1 Processor -- start 2024-04-12T20:08:52.633 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.633+0000 7f08c6400640 1 -- start start 2024-04-12T20:08:52.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.634+0000 7f08c6400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08c00704e0 0x7f08c01dd7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.634+0000 7f08c6400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08c00ba230 0x7f08c01ea0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.634+0000 7f08c6400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08c01511b0 0x7f08c00a84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.634+0000 7f08c6400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f08c006c730 con 0x7f08c00704e0 2024-04-12T20:08:52.635 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.634+0000 7f08c6400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f08c006c0f0 con 0x7f08c01511b0 2024-04-12T20:08:52.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.634+0000 7f08c6400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f08c006c8b0 con 0x7f08c00ba230 2024-04-12T20:08:52.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.634+0000 7f08bf400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08c00704e0 0x7f08c01dd7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.634+0000 7f08bf400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08c00704e0 0x7f08c01dd7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39888/0 (socket says 172.21.15.131:39888) 2024-04-12T20:08:52.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.634+0000 7f08bf400640 1 -- 172.21.15.131:0/112304295 learned_addr learned my addr 172.21.15.131:0/112304295 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:52.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.635+0000 7f08bea00640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08c00ba230 0x7f08c01ea0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.635+0000 7f08bf400640 1 -- 172.21.15.131:0/112304295 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08c00ba230 msgr2=0x7f08c01ea0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.635+0000 7f08bfe00640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08c01511b0 0x7f08c00a84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.635+0000 7f08bf400640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08c00ba230 0x7f08c01ea0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.636 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.635+0000 7f08bf400640 1 -- 172.21.15.131:0/112304295 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08c01511b0 msgr2=0x7f08c00a84b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.635+0000 7f08bf400640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08c01511b0 0x7f08c00a84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.635+0000 7f08bf400640 1 -- 172.21.15.131:0/112304295 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08c01ddcf0 con 0x7f08c00704e0 2024-04-12T20:08:52.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.635+0000 7f08bea00640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08c00ba230 0x7f08c01ea0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:52.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.635+0000 7f08bf400640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08c00704e0 0x7f08c01dd7b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f08b000d800 tx=0x7f08b000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:52.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.636+0000 7f08b7400640 1 -- 172.21.15.131:0/112304295 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b000b6c0 con 0x7f08c00704e0 2024-04-12T20:08:52.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.636+0000 7f08b7400640 1 -- 172.21.15.131:0/112304295 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08b0019070 con 0x7f08c00704e0 2024-04-12T20:08:52.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.636+0000 7f08b7400640 1 -- 172.21.15.131:0/112304295 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08b000ba80 con 0x7f08c00704e0 2024-04-12T20:08:52.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.636+0000 7f08c6400640 1 -- 172.21.15.131:0/112304295 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08c00bbaa0 con 0x7f08c00704e0 2024-04-12T20:08:52.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.636+0000 7f08c6400640 1 -- 172.21.15.131:0/112304295 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08c01e6d80 con 0x7f08c00704e0 2024-04-12T20:08:52.638 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.637+0000 7f08c6400640 1 -- 172.21.15.131:0/112304295 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08c004fd50 con 0x7f08c00704e0 2024-04-12T20:08:52.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.638+0000 7f08b7400640 1 -- 172.21.15.131:0/112304295 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f08b000bc20 con 0x7f08c00704e0 2024-04-12T20:08:52.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.639+0000 7f08b7400640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f08a006c8f0 0x7f08a006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:52.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.639+0000 7f08b7400640 1 -- 172.21.15.131:0/112304295 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f08b008c510 con 0x7f08c00704e0 2024-04-12T20:08:52.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.639+0000 7f08bea00640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f08a006c8f0 0x7f08a006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:52.639 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.640+0000 7f08bea00640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f08a006c8f0 0x7f08a006edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f08c01de0f0 tx=0x7f08ac009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:52.642 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.643+0000 7f08b7400640 1 -- 172.21.15.131:0/112304295 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f08b0011340 con 0x7f08c00704e0 2024-04-12T20:08:52.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.778+0000 7fba63400640 1 -- 172.21.15.131:0/59652566 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fba5c151f10 con 0x7fba5c0c17a0 2024-04-12T20:08:52.778 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.779+0000 7fba59600640 1 -- 172.21.15.131:0/59652566 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v53) ==== 80+0+370 (secure 0 0 0) 0x7fba5c151f10 con 0x7fba5c0c17a0 2024-04-12T20:08:52.779 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131:6837/2898590457 2024-04-13T20:04:46.991422+0000 2024-04-12T20:08:52.779 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131:6835/2898590457 2024-04-13T20:04:46.991422+0000 2024-04-12T20:08:52.779 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6835/373698102 2024-04-13T20:04:21.983874+0000 2024-04-12T20:08:52.779 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6833/373698102 2024-04-13T20:04:21.983874+0000 2024-04-12T20:08:52.779 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6834/1013642393 2024-04-13T20:03:56.972117+0000 2024-04-12T20:08:52.779 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6832/1013642393 2024-04-13T20:03:56.972117+0000 2024-04-12T20:08:52.780 INFO:teuthology.orchestra.run.smithi131.stderr:listed 6 entries 2024-04-12T20:08:52.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.782+0000 7fba63400640 1 -- 172.21.15.131:0/59652566 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fba3806c8f0 msgr2=0x7fba3806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.782+0000 7fba63400640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fba3806c8f0 0x7fba3806edb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fba44036000 tx=0x7fba4403b040 comp rx=0 tx=0).stop 2024-04-12T20:08:52.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.782+0000 7fba63400640 1 -- 172.21.15.131:0/59652566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba5c0c17a0 msgr2=0x7fba5c1d8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.782+0000 7fba63400640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba5c0c17a0 0x7fba5c1d8340 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fba4c00d830 tx=0x7fba4c00dcf0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.782+0000 7fba63400640 1 -- 172.21.15.131:0/59652566 shutdown_connections 2024-04-12T20:08:52.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.782+0000 7fba63400640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fba3806c8f0 0x7fba3806edb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.782+0000 7fba63400640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fba5c1511e0 0x7fba5c1d9ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.782+0000 7fba63400640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fba5c0c31f0 0x7fba5c1d9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.782+0000 7fba63400640 1 --2- 172.21.15.131:0/59652566 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fba5c0c17a0 0x7fba5c1d8340 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.782+0000 7fba63400640 1 -- 172.21.15.131:0/59652566 >> 172.21.15.131:0/59652566 conn(0x7fba5c0a8490 msgr2=0x7fba5c0beae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:52.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.782+0000 7fba63400640 1 -- 172.21.15.131:0/59652566 shutdown_connections 2024-04-12T20:08:52.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.782+0000 7fba63400640 1 -- 172.21.15.131:0/59652566 wait complete. 2024-04-12T20:08:52.798 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T20:08:52.798 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T20:08:52.837 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T20:08:52.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.842+0000 7f08c6400640 1 -- 172.21.15.131:0/112304295 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f08c00c3410 con 0x7f08c00704e0 2024-04-12T20:08:52.842 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.843+0000 7f08b7400640 1 -- 172.21.15.131:0/112304295 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) ==== 104+0+11 (secure 0 0 0) 0x7f08b005a430 con 0x7f08c00704e0 2024-04-12T20:08:52.843 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T20:08:52.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.845+0000 7f08c6400640 1 -- 172.21.15.131:0/112304295 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f08a006c8f0 msgr2=0x7f08a006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.845+0000 7f08c6400640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f08a006c8f0 0x7f08a006edb0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f08c01de0f0 tx=0x7f08ac009040 comp rx=0 tx=0).stop 2024-04-12T20:08:52.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.845+0000 7f08c6400640 1 -- 172.21.15.131:0/112304295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08c00704e0 msgr2=0x7f08c01dd7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:52.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.845+0000 7f08c6400640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08c00704e0 0x7f08c01dd7b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f08b000d800 tx=0x7f08b000dcc0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.846 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.845+0000 7f08c6400640 1 -- 172.21.15.131:0/112304295 shutdown_connections 2024-04-12T20:08:52.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.845+0000 7f08c6400640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f08a006c8f0 0x7f08a006edb0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.845+0000 7f08c6400640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f08c01511b0 0x7f08c00a84b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.845+0000 7f08c6400640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f08c00ba230 0x7f08c01ea0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.845+0000 7f08c6400640 1 --2- 172.21.15.131:0/112304295 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08c00704e0 0x7f08c01dd7b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:52.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.845+0000 7f08c6400640 1 -- 172.21.15.131:0/112304295 >> 172.21.15.131:0/112304295 conn(0x7f08c00c0120 msgr2=0x7f08c00c1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:52.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.846+0000 7f08c6400640 1 -- 172.21.15.131:0/112304295 shutdown_connections 2024-04-12T20:08:52.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:52.846+0000 7f08c6400640 1 -- 172.21.15.131:0/112304295 wait complete. 2024-04-12T20:08:52.864 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-12T20:08:53.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.030+0000 7fc9e1600640 1 Processor -- start 2024-04-12T20:08:53.029 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.030+0000 7fc9e1600640 1 -- start start 2024-04-12T20:08:53.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.031+0000 7fc9e1600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9dc150bc0 0x7fc9dc06e020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.031+0000 7fc9e1600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fc9dc159990 0x7fc9dc15bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.031+0000 7fc9e1600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9dc0c1ea0 con 0x7fc9dc0c2130 2024-04-12T20:08:53.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.031+0000 7fc9e1600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fc9dc150fa0 con 0x7fc9dc150bc0 2024-04-12T20:08:53.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.031+0000 7fc9e1600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fc9dc0c2eb0 con 0x7fc9dc159990 2024-04-12T20:08:53.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.031+0000 7fc9daa00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9dc150bc0 0x7fc9dc06e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.031+0000 7fc9daa00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fc9dc150bc0 0x7fc9dc06e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39898/0 (socket says 172.21.15.131:39898) 2024-04-12T20:08:53.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.031+0000 7fc9daa00640 1 -- 172.21.15.131:0/4014240170 learned_addr learned my addr 172.21.15.131:0/4014240170 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:53.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.031+0000 7fc9d2000640 1 --1- 172.21.15.131:0/4014240170 >> v1:172.21.15.131:6789/0 conn(0x7fc9dc0c2130 0x7fc9dc06cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46916/0 (socket says 172.21.15.131:46916) 2024-04-12T20:08:53.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.032+0000 7fc9db400640 1 --2- 172.21.15.131:0/4014240170 >> v2:172.21.15.171:3300/0 conn(0x7fc9dc159990 0x7fc9dc15bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.032+0000 7fc9daa00640 1 -- 172.21.15.131:0/4014240170 >> v2:172.21.15.171:3300/0 conn(0x7fc9dc159990 msgr2=0x7fc9dc15bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.032+0000 7fc9daa00640 1 --2- 172.21.15.131:0/4014240170 >> v2:172.21.15.171:3300/0 conn(0x7fc9dc159990 0x7fc9dc15bd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.032+0000 7fc9daa00640 1 -- 172.21.15.131:0/4014240170 >> v1:172.21.15.131:6789/0 conn(0x7fc9dc0c2130 legacy=0x7fc9dc06cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.032+0000 7fc9daa00640 1 -- 172.21.15.131:0/4014240170 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc0c1be0 con 0x7fc9dc150bc0 2024-04-12T20:08:53.033 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.032+0000 7fc9da000640 1 -- 172.21.15.131:0/4014240170 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 253001323 0 0) 0x7fc9dc0c1ea0 con 0x7fc9dc0c2130 2024-04-12T20:08:53.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.033+0000 7fc9daa00640 1 --2- 172.21.15.131:0/4014240170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc150bc0 0x7fc9dc06e020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc06ebe0 tx=0x7fc9cc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07443aa403f3519 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.033+0000 7fc9da000640 1 -- 172.21.15.131:0/4014240170 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc02c9f0 con 0x7fc9dc150bc0 2024-04-12T20:08:53.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.033+0000 7fc9da000640 1 -- 172.21.15.131:0/4014240170 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9cc02cb90 con 0x7fc9dc150bc0 2024-04-12T20:08:53.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.033+0000 7fc9da000640 1 -- 172.21.15.131:0/4014240170 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc0343f0 con 0x7fc9dc150bc0 2024-04-12T20:08:53.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.034+0000 7fc9e1600640 1 -- 172.21.15.131:0/4014240170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc150bc0 msgr2=0x7fc9dc06e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.034 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.034+0000 7fc9e1600640 1 --2- 172.21.15.131:0/4014240170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc150bc0 0x7fc9dc06e020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc06ebe0 tx=0x7fc9cc02be50 comp rx=0 tx=0).stop 2024-04-12T20:08:53.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.034+0000 7fc9e1600640 1 -- 172.21.15.131:0/4014240170 shutdown_connections 2024-04-12T20:08:53.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.034+0000 7fc9e1600640 1 --2- 172.21.15.131:0/4014240170 >> v2:172.21.15.171:3300/0 conn(0x7fc9dc159990 0x7fc9dc15bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.034+0000 7fc9e1600640 1 --2- 172.21.15.131:0/4014240170 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc150bc0 0x7fc9dc06e020 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.034+0000 7fc9e1600640 1 -- 172.21.15.131:0/4014240170 >> 172.21.15.131:0/4014240170 conn(0x7fc9dc0c68d0 msgr2=0x7fc9dc0c6ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:53.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.034+0000 7fc9e1600640 1 -- 172.21.15.131:0/4014240170 shutdown_connections 2024-04-12T20:08:53.035 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.034+0000 7fc9e1600640 1 -- 172.21.15.131:0/4014240170 wait complete. 2024-04-12T20:08:53.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.036+0000 7fc9e1600640 1 Processor -- start 2024-04-12T20:08:53.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.036+0000 7fc9e1600640 1 -- start start 2024-04-12T20:08:53.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9e1600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc0c2130 0x7fc9dc1e9f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.037 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9e1600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9dc150bc0 0x7fc9dc0bb310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9e1600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9dc159990 0x7fc9dc0bb850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9e1600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc0ba100 con 0x7fc9dc0c2130 2024-04-12T20:08:53.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9e1600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fc9dc151d00 con 0x7fc9dc150bc0 2024-04-12T20:08:53.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9e1600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fc9dc0c1760 con 0x7fc9dc159990 2024-04-12T20:08:53.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9daa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc0c2130 0x7fc9dc1e9f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9daa00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc0c2130 0x7fc9dc1e9f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39914/0 (socket says 172.21.15.131:39914) 2024-04-12T20:08:53.038 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9daa00640 1 -- 172.21.15.131:0/4147670971 learned_addr learned my addr 172.21.15.131:0/4147670971 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:53.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9daa00640 1 -- 172.21.15.131:0/4147670971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9dc159990 msgr2=0x7fc9dc0bb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9daa00640 1 --2- 172.21.15.131:0/4147670971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9dc159990 0x7fc9dc0bb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9daa00640 1 -- 172.21.15.131:0/4147670971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9dc150bc0 msgr2=0x7fc9dc0bb310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9daa00640 1 --2- 172.21.15.131:0/4147670971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9dc150bc0 0x7fc9dc0bb310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.037+0000 7fc9daa00640 1 -- 172.21.15.131:0/4147670971 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9dc0c0b40 con 0x7fc9dc0c2130 2024-04-12T20:08:53.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.038+0000 7fc9daa00640 1 --2- 172.21.15.131:0/4147670971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc0c2130 0x7fc9dc1e9f80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc036040 tx=0x7fc9cc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.038+0000 7fc9d3400640 1 -- 172.21.15.131:0/4147670971 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc044030 con 0x7fc9dc0c2130 2024-04-12T20:08:53.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.038+0000 7fc9d3400640 1 -- 172.21.15.131:0/4147670971 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9cc02c7f0 con 0x7fc9dc0c2130 2024-04-12T20:08:53.039 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.038+0000 7fc9d3400640 1 -- 172.21.15.131:0/4147670971 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc040690 con 0x7fc9dc0c2130 2024-04-12T20:08:53.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.038+0000 7fc9e1600640 1 -- 172.21.15.131:0/4147670971 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9dc1ea8a0 con 0x7fc9dc0c2130 2024-04-12T20:08:53.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.038+0000 7fc9e1600640 1 -- 172.21.15.131:0/4147670971 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9dc1558d0 con 0x7fc9dc0c2130 2024-04-12T20:08:53.040 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.039+0000 7fc9e1600640 1 -- 172.21.15.131:0/4147670971 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9dc04fd50 con 0x7fc9dc0c2130 2024-04-12T20:08:53.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.040+0000 7fc9d3400640 1 -- 172.21.15.131:0/4147670971 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fc9cc047070 con 0x7fc9dc0c2130 2024-04-12T20:08:53.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.041+0000 7fc9d3400640 1 --2- 172.21.15.131:0/4147670971 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc9b806c920 0x7fc9b806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.041+0000 7fc9d3400640 1 -- 172.21.15.131:0/4147670971 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7fc9cc0ae640 con 0x7fc9dc0c2130 2024-04-12T20:08:53.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.041+0000 7fc9d2000640 1 --2- 172.21.15.131:0/4147670971 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc9b806c920 0x7fc9b806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.041 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.042+0000 7fc9d2000640 1 --2- 172.21.15.131:0/4147670971 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc9b806c920 0x7fc9b806ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4007fd0 tx=0x7fc9c4007920 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.045 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.046+0000 7fc9d3400640 1 -- 172.21.15.131:0/4147670971 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fc9cc04e070 con 0x7fc9dc0c2130 2024-04-12T20:08:53.097 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.098+0000 7f9cc3200640 1 Processor -- start 2024-04-12T20:08:53.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.098+0000 7f9cc3200640 1 -- start start 2024-04-12T20:08:53.098 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.099+0000 7f9cc3200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f9cbc0c17a0 0x7f9cbc0c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.099+0000 7f9cc3200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc1511e0 0x7f9cbc151640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.099+0000 7f9cc3200640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9cbc0c5e80 con 0x7f9cbc0c31f0 2024-04-12T20:08:53.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.099+0000 7f9cc3200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f9cbc0c59f0 con 0x7f9cbc0c17a0 2024-04-12T20:08:53.099 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.099+0000 7f9cc3200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9cbc0c4020 con 0x7f9cbc1511e0 2024-04-12T20:08:53.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.100+0000 7f9cc1200640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f9cbc0c31f0 0x7f9cbc0c36a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46920/0 (socket says 172.21.15.131:46920) 2024-04-12T20:08:53.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.100+0000 7f9cc1200640 1 -- 172.21.15.131:0/4203796045 learned_addr learned my addr 172.21.15.131:0/4203796045 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T20:08:53.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.100+0000 7f9cbbe00640 1 --2- 172.21.15.131:0/4203796045 >> v2:172.21.15.171:3300/0 conn(0x7f9cbc0c17a0 0x7f9cbc0c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.100+0000 7f9cbb400640 1 --2- 172.21.15.131:0/4203796045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc1511e0 0x7f9cbc151640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.100+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 954984900 0 0) 0x7f9cbc0c5e80 con 0x7f9cbc0c31f0 2024-04-12T20:08:53.101 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.100+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ca0003520 con 0x7f9cbc0c31f0 2024-04-12T20:08:53.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2038964870 0 0) 0x7f9ca0003520 con 0x7f9cbc0c31f0 2024-04-12T20:08:53.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc1511e0 msgr2=0x7f9cbc151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 --2- 172.21.15.131:0/4203796045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc1511e0 0x7f9cbc151640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 >> v2:172.21.15.171:3300/0 conn(0x7f9cbc0c17a0 msgr2=0x7f9cbc0c28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 --2- 172.21.15.131:0/4203796045 >> v2:172.21.15.171:3300/0 conn(0x7f9cbc0c17a0 0x7f9cbc0c28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc0c6260 con 0x7f9cbc0c31f0 2024-04-12T20:08:53.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f9cb40019f0 con 0x7f9cbc0c31f0 2024-04-12T20:08:53.102 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 >> v1:172.21.15.131:6789/0 conn(0x7f9cbc0c31f0 legacy=0x7f9cbc0c36a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 --2- 172.21.15.131:0/4203796045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc1511e0 0x7f9ca00039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 --2- 172.21.15.131:0/4203796045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ca0003f30 0x7f9ca0004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 --2- 172.21.15.131:0/4203796045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ca0004d40 0x7f9ca00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc0c59f0 con 0x7f9ca0003f30 2024-04-12T20:08:53.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc0c4020 con 0x7f9ca0004d40 2024-04-12T20:08:53.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9ca000b9c0 con 0x7f9cbc1511e0 2024-04-12T20:08:53.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbb400640 1 --2- 172.21.15.131:0/4203796045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ca0003f30 0x7f9ca0004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.103 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbbe00640 1 --2- 172.21.15.131:0/4203796045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc1511e0 0x7f9ca00039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbb400640 1 -- 172.21.15.131:0/4203796045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc1511e0 msgr2=0x7f9ca00039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbb400640 1 --2- 172.21.15.131:0/4203796045 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc1511e0 0x7f9ca00039b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbb400640 1 -- 172.21.15.131:0/4203796045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ca0004d40 msgr2=0x7f9ca00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbb400640 1 --2- 172.21.15.131:0/4203796045 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ca0004d40 0x7f9ca00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.104 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.101+0000 7f9cbb400640 1 -- 172.21.15.131:0/4203796045 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ca0003520 con 0x7f9ca0003f30 2024-04-12T20:08:53.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.102+0000 7f9cbb400640 1 --2- 172.21.15.131:0/4203796045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ca0003f30 0x7f9ca0004800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009ac0 tx=0x7f9ca0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fb4feb428a91463 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.103+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8039070 con 0x7f9ca0003f30 2024-04-12T20:08:53.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.103+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9ca802c6b0 con 0x7f9ca0003f30 2024-04-12T20:08:53.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.103+0000 7f9cbaa00640 1 -- 172.21.15.131:0/4203796045 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca8009690 con 0x7f9ca0003f30 2024-04-12T20:08:53.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.103+0000 7f9cc3200640 1 -- 172.21.15.131:0/4203796045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ca0003f30 msgr2=0x7f9ca0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.103+0000 7f9cc3200640 1 --2- 172.21.15.131:0/4203796045 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9ca0003f30 0x7f9ca0004800 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8009ac0 tx=0x7f9ca0005830 comp rx=0 tx=0).stop 2024-04-12T20:08:53.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.103+0000 7f9cc1200640 1 -- 172.21.15.131:0/4203796045 reap_dead start 2024-04-12T20:08:53.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.103+0000 7f9cc3200640 1 -- 172.21.15.131:0/4203796045 shutdown_connections 2024-04-12T20:08:53.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.103+0000 7f9cc3200640 1 -- 172.21.15.131:0/4203796045 >> 172.21.15.131:0/4203796045 conn(0x7f9cbc0a8490 msgr2=0x7f9cbc0a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:53.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.103+0000 7f9cc3200640 1 -- 172.21.15.131:0/4203796045 shutdown_connections 2024-04-12T20:08:53.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.103+0000 7f9cc3200640 1 -- 172.21.15.131:0/4203796045 wait complete. 2024-04-12T20:08:53.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.105+0000 7f9cc3200640 1 Processor -- start 2024-04-12T20:08:53.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.105+0000 7f9cc3200640 1 -- start start 2024-04-12T20:08:53.108 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.106+0000 7f9cc3200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ca0003f30 0x7f9cbc09bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.106+0000 7f9cc3200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc0bccd0 0x7f9cbc1d9710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.106+0000 7f9cc3200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cbc1d9c50 0x7f9cbc1e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.106+0000 7f9cc3200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc0c48e0 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.106+0000 7f9cc3200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f9cbc0c4760 con 0x7f9ca0003f30 2024-04-12T20:08:53.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.106+0000 7f9cc3200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f9cbc0c1b80 con 0x7f9cbc0bccd0 2024-04-12T20:08:53.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.106+0000 7f9cc1200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cbc1d9c50 0x7f9cbc1e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.106+0000 7f9cc1200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cbc1d9c50 0x7f9cbc1e9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39936/0 (socket says 172.21.15.131:39936) 2024-04-12T20:08:53.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.106+0000 7f9cc1200640 1 -- 172.21.15.131:0/4202985287 learned_addr learned my addr 172.21.15.131:0/4202985287 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:53.109 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.106+0000 7f9cbbe00640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ca0003f30 0x7f9cbc09bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.106+0000 7f9cbb400640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc0bccd0 0x7f9cbc1d9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cc1200640 1 -- 172.21.15.131:0/4202985287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc0bccd0 msgr2=0x7f9cbc1d9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cc1200640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc0bccd0 0x7f9cbc1d9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cc1200640 1 -- 172.21.15.131:0/4202985287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ca0003f30 msgr2=0x7f9cbc09bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cc1200640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ca0003f30 0x7f9cbc09bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cc1200640 1 -- 172.21.15.131:0/4202985287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cbc1da0d0 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cbb400640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc0bccd0 0x7f9cbc1d9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:53.110 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cbbe00640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ca0003f30 0x7f9cbc09bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:53.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cc1200640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cbc1d9c50 0x7f9cbc1e9ce0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0c5b70 tx=0x7f9cb400cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cb3e00640 1 -- 172.21.15.131:0/4202985287 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb4007110 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cb3e00640 1 -- 172.21.15.131:0/4202985287 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9cb40072b0 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cb3e00640 1 -- 172.21.15.131:0/4202985287 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cb40076a0 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cc3200640 1 -- 172.21.15.131:0/4202985287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cbc1db450 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.111 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.107+0000 7f9cc3200640 1 -- 172.21.15.131:0/4202985287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cbc1e74d0 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.108+0000 7f9cc3200640 1 -- 172.21.15.131:0/4202985287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cbc04fd50 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.109+0000 7f9cb3e00640 1 -- 172.21.15.131:0/4202985287 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f9cb4011070 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.112 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.110+0000 7f9cb3e00640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f9c9c06c920 0x7f9c9c06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.110+0000 7f9cb3e00640 1 -- 172.21.15.131:0/4202985287 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f9cb408bc30 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.110+0000 7f9cbbe00640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f9c9c06c920 0x7f9c9c06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.113 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.111+0000 7f9cbbe00640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f9c9c06c920 0x7f9c9c06ede0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009a60 tx=0x7f9cac008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.114 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.114+0000 7f9cb3e00640 1 -- 172.21.15.131:0/4202985287 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f9cbc1da0d0 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.236 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.237+0000 7fc9e1600640 1 -- 172.21.15.131:0/4147670971 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc9dc0b9d40 con 0x7fc9dc0c2130 2024-04-12T20:08:53.238 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.239+0000 7fc9d3400640 1 -- 172.21.15.131:0/4147670971 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+19332 (secure 0 0 0) 0x7fc9cc07c550 con 0x7fc9dc0c2130 2024-04-12T20:08:53.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T20:08:53.239 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":53,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T20:04:46.991521+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.131:6837/2898590457":"2024-04-13T20:04:46.991422+0000","172.21.15.131:6835/2898590457":"2024-04-13T20:04:46.991422+0000","172.21.15.171:6835/373698102":"2024-04-13T20:04:21.983874+0000","172.21.15.171:6833/373698102":"2024-04-13T20:04:21.983874+0000","172.21.15.171:6834/1013642393":"2024-04-13T20:03:56.972117+0000","172.21.15.171:6832/1013642393":"2024-04-13T20:03:56.972117+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T20:08:53.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.241+0000 7fc9e1600640 1 -- 172.21.15.131:0/4147670971 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc9b806c920 msgr2=0x7fc9b806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.241+0000 7fc9e1600640 1 --2- 172.21.15.131:0/4147670971 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc9b806c920 0x7fc9b806ede0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc9c4007fd0 tx=0x7fc9c4007920 comp rx=0 tx=0).stop 2024-04-12T20:08:53.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.241+0000 7fc9e1600640 1 -- 172.21.15.131:0/4147670971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc0c2130 msgr2=0x7fc9dc1e9f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.241+0000 7fc9e1600640 1 --2- 172.21.15.131:0/4147670971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc0c2130 0x7fc9dc1e9f80 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc036040 tx=0x7fc9cc004a40 comp rx=0 tx=0).stop 2024-04-12T20:08:53.241 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.241+0000 7fc9e1600640 1 -- 172.21.15.131:0/4147670971 shutdown_connections 2024-04-12T20:08:53.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.241+0000 7fc9e1600640 1 --2- 172.21.15.131:0/4147670971 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fc9b806c920 0x7fc9b806ede0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.241+0000 7fc9e1600640 1 --2- 172.21.15.131:0/4147670971 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fc9dc150bc0 0x7fc9dc0bb310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.241+0000 7fc9e1600640 1 --2- 172.21.15.131:0/4147670971 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fc9dc159990 0x7fc9dc0bb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.242+0000 7fc9e1600640 1 --2- 172.21.15.131:0/4147670971 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9dc0c2130 0x7fc9dc1e9f80 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.242+0000 7fc9e1600640 1 -- 172.21.15.131:0/4147670971 >> 172.21.15.131:0/4147670971 conn(0x7fc9dc0c68d0 msgr2=0x7fc9dc14fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:53.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.242+0000 7fc9e1600640 1 -- 172.21.15.131:0/4147670971 shutdown_connections 2024-04-12T20:08:53.242 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.242+0000 7fc9e1600640 1 -- 172.21.15.131:0/4147670971 wait complete. 2024-04-12T20:08:53.258 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T19:39:04.855067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-12T19:39:09.370965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-12T19:39:09.858079+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-12T19:39:13.479306+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-12T20:08:53.259 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T20:08:53.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.315+0000 7f9cc3200640 1 -- 172.21.15.131:0/4202985287 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f9cbc0c4280 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.314 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.315+0000 7f9cb3e00640 1 -- 172.21.15.131:0/4202985287 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) ==== 100+0+11 (secure 0 0 0) 0x7f9cb4059b40 con 0x7f9cbc1d9c50 2024-04-12T20:08:53.315 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-12T20:08:53.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.317+0000 7f9cc3200640 1 -- 172.21.15.131:0/4202985287 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f9c9c06c920 msgr2=0x7f9c9c06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.317+0000 7f9cc3200640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f9c9c06c920 0x7f9c9c06ede0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9cac009a60 tx=0x7f9cac008040 comp rx=0 tx=0).stop 2024-04-12T20:08:53.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.317+0000 7f9cc3200640 1 -- 172.21.15.131:0/4202985287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cbc1d9c50 msgr2=0x7f9cbc1e9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.317 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.317+0000 7f9cc3200640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cbc1d9c50 0x7f9cbc1e9ce0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f9cbc0c5b70 tx=0x7f9cb400cf00 comp rx=0 tx=0).stop 2024-04-12T20:08:53.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.317+0000 7f9cc3200640 1 -- 172.21.15.131:0/4202985287 shutdown_connections 2024-04-12T20:08:53.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.317+0000 7f9cc3200640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f9c9c06c920 0x7f9c9c06ede0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.317+0000 7f9cc3200640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9cbc1d9c50 0x7f9cbc1e9ce0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.317+0000 7f9cc3200640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f9cbc0bccd0 0x7f9cbc1d9710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.317+0000 7f9cc3200640 1 --2- 172.21.15.131:0/4202985287 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f9ca0003f30 0x7f9cbc09bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.318+0000 7f9cc3200640 1 -- 172.21.15.131:0/4202985287 >> 172.21.15.131:0/4202985287 conn(0x7f9cbc0a8490 msgr2=0x7f9cbc0a60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:53.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.318+0000 7f9cc3200640 1 -- 172.21.15.131:0/4202985287 shutdown_connections 2024-04-12T20:08:53.318 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.318+0000 7f9cc3200640 1 -- 172.21.15.131:0/4202985287 wait complete. 2024-04-12T20:08:53.333 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-12T20:08:53.446 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.447+0000 7f22da400640 1 Processor -- start 2024-04-12T20:08:53.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.447+0000 7f22da400640 1 -- start start 2024-04-12T20:08:53.447 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.448+0000 7f22da400640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f22d414b380 0x7f22d4155050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.448+0000 7f22da400640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d414b760 con 0x7f22d40c0a20 2024-04-12T20:08:53.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.448+0000 7f22da400640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d40c3af0 con 0x7f22d40c4e00 2024-04-12T20:08:53.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.448+0000 7f22da400640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f22d40c4760 con 0x7f22d414b380 2024-04-12T20:08:53.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.448+0000 7f22cbe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f22d40c0a20 0x7f22d40c1300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46936/0 (socket says 172.21.15.131:46936) 2024-04-12T20:08:53.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.448+0000 7f22cbe00640 1 -- 172.21.15.131:0/2704296484 learned_addr learned my addr 172.21.15.131:0/2704296484 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T20:08:53.448 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d3400640 1 --2- 172.21.15.131:0/2704296484 >> v2:172.21.15.171:3300/0 conn(0x7f22d414b380 0x7f22d4155050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760782148 0 0) 0x7f22bc001110 con 0x7f22d40c0a20 2024-04-12T20:08:53.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22b8003520 con 0x7f22d40c0a20 2024-04-12T20:08:53.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3689543821 0 0) 0x7f22b8003520 con 0x7f22d40c0a20 2024-04-12T20:08:53.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 >> v2:172.21.15.171:3300/0 conn(0x7f22d414b380 msgr2=0x7f22d4155050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 --2- 172.21.15.131:0/2704296484 >> v2:172.21.15.171:3300/0 conn(0x7f22d414b380 0x7f22d4155050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 >> v1:172.21.15.171:6789/0 conn(0x7f22d40c4e00 legacy=0x7f22d4151010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d40c49b0 con 0x7f22d40c0a20 2024-04-12T20:08:53.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f22bc001840 con 0x7f22d40c0a20 2024-04-12T20:08:53.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 >> v1:172.21.15.131:6789/0 conn(0x7f22d40c0a20 legacy=0x7f22d40c1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 --2- 172.21.15.131:0/2704296484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 0x7f22b8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 --2- 172.21.15.131:0/2704296484 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22b8004800 0x7f22b8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 --2- 172.21.15.131:0/2704296484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22b80051c0 0x7f22b800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f22d40c4760 con 0x7f22b80039b0 2024-04-12T20:08:53.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22b800c160 con 0x7f22b80051c0 2024-04-12T20:08:53.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.449+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22b800c360 con 0x7f22b8004800 2024-04-12T20:08:53.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.450+0000 7f22d3400640 1 --2- 172.21.15.131:0/2704296484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 0x7f22b8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.450+0000 7f22cbe00640 1 --2- 172.21.15.131:0/2704296484 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22b8004800 0x7f22b8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.450+0000 7f22d3400640 1 -- 172.21.15.131:0/2704296484 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22b8004800 msgr2=0x7f22b8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.450+0000 7f22d3e00640 1 --2- 172.21.15.131:0/2704296484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22b80051c0 0x7f22b800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.450+0000 7f22d3400640 1 --2- 172.21.15.131:0/2704296484 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22b8004800 0x7f22b8004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.450+0000 7f22d3400640 1 -- 172.21.15.131:0/2704296484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22b80051c0 msgr2=0x7f22b800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.450+0000 7f22d3400640 1 --2- 172.21.15.131:0/2704296484 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22b80051c0 0x7f22b800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.450+0000 7f22d3400640 1 -- 172.21.15.131:0/2704296484 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22b8003520 con 0x7f22b80039b0 2024-04-12T20:08:53.453 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.450+0000 7f22d3e00640 1 -- 172.21.15.131:0/2704296484 reap_dead start 2024-04-12T20:08:53.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.451+0000 7f22d3400640 1 --2- 172.21.15.131:0/2704296484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 0x7f22b8003dd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009aa0 tx=0x7f22b8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3ecd7d0b4fb504 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.451+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4039070 con 0x7f22b80039b0 2024-04-12T20:08:53.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.452+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c402c6b0 con 0x7f22b80039b0 2024-04-12T20:08:53.454 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.452+0000 7f22d2a00640 1 -- 172.21.15.131:0/2704296484 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4009670 con 0x7f22b80039b0 2024-04-12T20:08:53.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.452+0000 7f22da400640 1 -- 172.21.15.131:0/2704296484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 msgr2=0x7f22b8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.452+0000 7f22da400640 1 --2- 172.21.15.131:0/2704296484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 0x7f22b8003dd0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009aa0 tx=0x7f22b8005830 comp rx=0 tx=0).stop 2024-04-12T20:08:53.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.452+0000 7f22da400640 1 -- 172.21.15.131:0/2704296484 shutdown_connections 2024-04-12T20:08:53.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.452+0000 7f22da400640 1 --2- 172.21.15.131:0/2704296484 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 0x7f22b8003dd0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.452+0000 7f22da400640 1 -- 172.21.15.131:0/2704296484 >> 172.21.15.131:0/2704296484 conn(0x7f22d40a8490 msgr2=0x7f22d40a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:53.457 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.452+0000 7f22da400640 1 -- 172.21.15.131:0/2704296484 shutdown_connections 2024-04-12T20:08:53.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.452+0000 7f22da400640 1 -- 172.21.15.131:0/2704296484 wait complete. 2024-04-12T20:08:53.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.454+0000 7f22da400640 1 Processor -- start 2024-04-12T20:08:53.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.454+0000 7f22da400640 1 -- start start 2024-04-12T20:08:53.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.455+0000 7f22da400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 0x7f22d40bb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.455+0000 7f22da400640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22d40bd410 0x7f22d40ab990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.455+0000 7f22da400640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40bca50 0x7f22d41e76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.455+0000 7f22da400640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f22d4154b30 con 0x7f22b80039b0 2024-04-12T20:08:53.458 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.455+0000 7f22da400640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f22d4154600 con 0x7f22d40bd410 2024-04-12T20:08:53.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.455+0000 7f22da400640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f22d40c5370 con 0x7f22d40bca50 2024-04-12T20:08:53.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.455+0000 7f22d3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 0x7f22d40bb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.455+0000 7f22d3400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 0x7f22d40bb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39954/0 (socket says 172.21.15.131:39954) 2024-04-12T20:08:53.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.455+0000 7f22d3400640 1 -- 172.21.15.131:0/3287616303 learned_addr learned my addr 172.21.15.131:0/3287616303 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:53.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.456+0000 7f22cbe00640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22d40bd410 0x7f22d40ab990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.456+0000 7f22d3e00640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40bca50 0x7f22d41e76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.456+0000 7f22d3400640 1 -- 172.21.15.131:0/3287616303 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40bca50 msgr2=0x7f22d41e76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.456+0000 7f22d3400640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40bca50 0x7f22d41e76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.459 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.456+0000 7f22d3400640 1 -- 172.21.15.131:0/3287616303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22d40bd410 msgr2=0x7f22d40ab990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.456+0000 7f22d3400640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22d40bd410 0x7f22d40ab990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.456+0000 7f22d3400640 1 -- 172.21.15.131:0/3287616303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d41eb000 con 0x7f22b80039b0 2024-04-12T20:08:53.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.456+0000 7f22cbe00640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22d40bd410 0x7f22d40ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:53.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.456+0000 7f22d3400640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 0x7f22d40bb8c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009bc0 tx=0x7f22c4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.457+0000 7f22cb400640 1 -- 172.21.15.131:0/3287616303 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4044030 con 0x7f22b80039b0 2024-04-12T20:08:53.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.457+0000 7f22cb400640 1 -- 172.21.15.131:0/3287616303 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c4034580 con 0x7f22b80039b0 2024-04-12T20:08:53.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.457+0000 7f22da400640 1 -- 172.21.15.131:0/3287616303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d41eb550 con 0x7f22b80039b0 2024-04-12T20:08:53.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.457+0000 7f22cb400640 1 -- 172.21.15.131:0/3287616303 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4039040 con 0x7f22b80039b0 2024-04-12T20:08:53.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.457+0000 7f22da400640 1 -- 172.21.15.131:0/3287616303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d414de50 con 0x7f22b80039b0 2024-04-12T20:08:53.460 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.458+0000 7f22da400640 1 -- 172.21.15.131:0/3287616303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d404fd50 con 0x7f22b80039b0 2024-04-12T20:08:53.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.459+0000 7f22cb400640 1 -- 172.21.15.131:0/3287616303 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f22c4047070 con 0x7f22b80039b0 2024-04-12T20:08:53.461 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.460+0000 7f22cb400640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f22b006c8f0 0x7f22b006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.460+0000 7f22cb400640 1 -- 172.21.15.131:0/3287616303 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f22c40ad570 con 0x7f22b80039b0 2024-04-12T20:08:53.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.460+0000 7f22cbe00640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f22b006c8f0 0x7f22b006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.462 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.461+0000 7f22cbe00640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f22b006c8f0 0x7f22b006edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0019b0 tx=0x7f22bc009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.464+0000 7f22cb400640 1 -- 172.21.15.131:0/3287616303 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f22c407b5a0 con 0x7f22b80039b0 2024-04-12T20:08:53.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.524+0000 7faa6ea00640 1 Processor -- start 2024-04-12T20:08:53.523 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.524+0000 7faa6ea00640 1 -- start start 2024-04-12T20:08:53.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.525+0000 7faa6ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa6814f8a0 0x7faa680bda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.525+0000 7faa6ea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa6814ece0 0x7faa68159660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.525+0000 7faa6ea00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6814fc80 con 0x7faa680a5ff0 2024-04-12T20:08:53.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.525+0000 7faa6ea00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7faa68073aa0 con 0x7faa6814ece0 2024-04-12T20:08:53.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.525+0000 7faa6ea00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa6814f110 con 0x7faa6814f8a0 2024-04-12T20:08:53.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.526+0000 7faa6e000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa6814ece0 0x7faa68159660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.526+0000 7faa6e000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7faa6814ece0 0x7faa68159660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39962/0 (socket says 172.21.15.131:39962) 2024-04-12T20:08:53.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.526+0000 7faa6e000640 1 -- 172.21.15.131:0/1693179437 learned_addr learned my addr 172.21.15.131:0/1693179437 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:53.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.526+0000 7faa6d600640 1 --2- 172.21.15.131:0/1693179437 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa6814f8a0 0x7faa680bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.526+0000 7faa6e000640 1 -- 172.21.15.131:0/1693179437 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa6814f8a0 msgr2=0x7faa680bda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.526+0000 7faa6e000640 1 --2- 172.21.15.131:0/1693179437 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa6814f8a0 0x7faa680bda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.526+0000 7faa6e000640 1 -- 172.21.15.131:0/1693179437 >> v1:172.21.15.171:6789/0 conn(0x7faa680a5ff0 legacy=0x7faa680bf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.526+0000 7faa6e000640 1 -- 172.21.15.131:0/1693179437 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa680beb00 con 0x7faa6814ece0 2024-04-12T20:08:53.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.527+0000 7faa6e000640 1 --2- 172.21.15.131:0/1693179437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6814ece0 0x7faa68159660 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa6806d790 tx=0x7faa6002bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b11b4510265487c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.527+0000 7faa67e00640 1 -- 172.21.15.131:0/1693179437 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6002c930 con 0x7faa6814ece0 2024-04-12T20:08:53.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.528+0000 7faa67e00640 1 -- 172.21.15.131:0/1693179437 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6002cad0 con 0x7faa6814ece0 2024-04-12T20:08:53.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.528+0000 7faa67e00640 1 -- 172.21.15.131:0/1693179437 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa600343f0 con 0x7faa6814ece0 2024-04-12T20:08:53.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.528+0000 7faa6ea00640 1 -- 172.21.15.131:0/1693179437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6814ece0 msgr2=0x7faa68159660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.528+0000 7faa6ea00640 1 --2- 172.21.15.131:0/1693179437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6814ece0 0x7faa68159660 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7faa6806d790 tx=0x7faa6002bd90 comp rx=0 tx=0).stop 2024-04-12T20:08:53.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.528+0000 7faa6ea00640 1 -- 172.21.15.131:0/1693179437 shutdown_connections 2024-04-12T20:08:53.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.528+0000 7faa6ea00640 1 --2- 172.21.15.131:0/1693179437 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6814ece0 0x7faa68159660 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.528+0000 7faa6ea00640 1 --2- 172.21.15.131:0/1693179437 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa6814f8a0 0x7faa680bda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.528+0000 7faa6ea00640 1 -- 172.21.15.131:0/1693179437 >> 172.21.15.131:0/1693179437 conn(0x7faa6806bbc0 msgr2=0x7faa6806bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:53.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.528+0000 7faa6ea00640 1 -- 172.21.15.131:0/1693179437 shutdown_connections 2024-04-12T20:08:53.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.528+0000 7faa6ea00640 1 -- 172.21.15.131:0/1693179437 wait complete. 2024-04-12T20:08:53.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.530+0000 7faa6ea00640 1 Processor -- start 2024-04-12T20:08:53.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.530+0000 7faa6ea00640 1 -- start start 2024-04-12T20:08:53.531 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6ea00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa680a5ff0 0x7faa680c14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6ea00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa6814ece0 0x7faa681d9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6ea00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6814f8a0 0x7faa681da190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6ea00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7faa680be110 con 0x7faa6814f8a0 2024-04-12T20:08:53.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6ea00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7faa680bf8d0 con 0x7faa6814ece0 2024-04-12T20:08:53.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6ea00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7faa680bd130 con 0x7faa680a5ff0 2024-04-12T20:08:53.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6814f8a0 0x7faa681da190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6e000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6814f8a0 0x7faa681da190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39964/0 (socket says 172.21.15.131:39964) 2024-04-12T20:08:53.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6e000640 1 -- 172.21.15.131:0/3258117785 learned_addr learned my addr 172.21.15.131:0/3258117785 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:53.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6cc00640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa6814ece0 0x7faa681d9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6d600640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa680a5ff0 0x7faa680c14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6e000640 1 -- 172.21.15.131:0/3258117785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa680a5ff0 msgr2=0x7faa680c14c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6e000640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa680a5ff0 0x7faa680c14c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6e000640 1 -- 172.21.15.131:0/3258117785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa6814ece0 msgr2=0x7faa681d9c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6e000640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa6814ece0 0x7faa681d9c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.531+0000 7faa6e000640 1 -- 172.21.15.131:0/3258117785 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa680c1a00 con 0x7faa6814f8a0 2024-04-12T20:08:53.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.532+0000 7faa6cc00640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa6814ece0 0x7faa681d9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:53.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.532+0000 7faa6e000640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6814f8a0 0x7faa681da190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faa60036040 tx=0x7faa60004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.532+0000 7faa65600640 1 -- 172.21.15.131:0/3258117785 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa60043020 con 0x7faa6814f8a0 2024-04-12T20:08:53.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.532+0000 7faa65600640 1 -- 172.21.15.131:0/3258117785 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6003e450 con 0x7faa6814f8a0 2024-04-12T20:08:53.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.532+0000 7faa65600640 1 -- 172.21.15.131:0/3258117785 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6003e860 con 0x7faa6814f8a0 2024-04-12T20:08:53.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.532+0000 7faa6ea00640 1 -- 172.21.15.131:0/3258117785 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa681d9490 con 0x7faa6814f8a0 2024-04-12T20:08:53.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.532+0000 7faa6ea00640 1 -- 172.21.15.131:0/3258117785 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa680b8100 con 0x7faa6814f8a0 2024-04-12T20:08:53.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.534+0000 7faa6ea00640 1 -- 172.21.15.131:0/3258117785 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa6804fd50 con 0x7faa6814f8a0 2024-04-12T20:08:53.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.534+0000 7faa65600640 1 -- 172.21.15.131:0/3258117785 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7faa60046020 con 0x7faa6814f8a0 2024-04-12T20:08:53.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.535+0000 7faa65600640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7faa4806c920 0x7faa4806ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.535+0000 7faa65600640 1 -- 172.21.15.131:0/3258117785 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7faa600ae760 con 0x7faa6814f8a0 2024-04-12T20:08:53.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.535+0000 7faa6d600640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7faa4806c920 0x7faa4806ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.536 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.536+0000 7faa6d600640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7faa4806c920 0x7faa4806ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faa5c006fd0 tx=0x7faa5c008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.539 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.540+0000 7faa65600640 1 -- 172.21.15.131:0/3258117785 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7faa6004d070 con 0x7faa6814f8a0 2024-04-12T20:08:53.658 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.659+0000 7f22da400640 1 -- 172.21.15.131:0/3287616303 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f22d40a7930 con 0x7f22b80039b0 2024-04-12T20:08:53.659 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.660+0000 7f22cb400640 1 -- 172.21.15.131:0/3287616303 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) ==== 93+0+10 (secure 0 0 0) 0x7f22c407aea0 con 0x7f22b80039b0 2024-04-12T20:08:53.659 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-12T20:08:53.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.662+0000 7f22da400640 1 -- 172.21.15.131:0/3287616303 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f22b006c8f0 msgr2=0x7f22b006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.662+0000 7f22da400640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f22b006c8f0 0x7f22b006edb0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0019b0 tx=0x7f22bc009040 comp rx=0 tx=0).stop 2024-04-12T20:08:53.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.662+0000 7f22da400640 1 -- 172.21.15.131:0/3287616303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 msgr2=0x7f22d40bb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.662+0000 7f22da400640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 0x7f22d40bb8c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009bc0 tx=0x7f22c4004730 comp rx=0 tx=0).stop 2024-04-12T20:08:53.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.662+0000 7f22da400640 1 -- 172.21.15.131:0/3287616303 shutdown_connections 2024-04-12T20:08:53.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.662+0000 7f22da400640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f22b006c8f0 0x7f22b006edb0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.662+0000 7f22da400640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f22d40bd410 0x7f22d40ab990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.662+0000 7f22da400640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f22d40bca50 0x7f22d41e76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.662+0000 7f22da400640 1 --2- 172.21.15.131:0/3287616303 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b80039b0 0x7f22d40bb8c0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.662+0000 7f22da400640 1 -- 172.21.15.131:0/3287616303 >> 172.21.15.131:0/3287616303 conn(0x7f22d40a8490 msgr2=0x7f22d40c1200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:53.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.663+0000 7f22da400640 1 -- 172.21.15.131:0/3287616303 shutdown_connections 2024-04-12T20:08:53.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.663+0000 7f22da400640 1 -- 172.21.15.131:0/3287616303 wait complete. 2024-04-12T20:08:53.682 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-12T20:08:53.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.741+0000 7faa6ea00640 1 -- 172.21.15.131:0/3258117785 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7faa680bc890 con 0x7faa6814f8a0 2024-04-12T20:08:53.740 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.741+0000 7faa65600640 1 -- 172.21.15.131:0/3258117785 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v53) ==== 103+0+11 (secure 0 0 0) 0x7faa60033e40 con 0x7faa6814f8a0 2024-04-12T20:08:53.741 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T20:08:53.742 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:08:53.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.743+0000 7faa6ea00640 1 -- 172.21.15.131:0/3258117785 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7faa4806c920 msgr2=0x7faa4806ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.743+0000 7faa6ea00640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7faa4806c920 0x7faa4806ede0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7faa5c006fd0 tx=0x7faa5c008040 comp rx=0 tx=0).stop 2024-04-12T20:08:53.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.743+0000 7faa6ea00640 1 -- 172.21.15.131:0/3258117785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6814f8a0 msgr2=0x7faa681da190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.743+0000 7faa6ea00640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6814f8a0 0x7faa681da190 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7faa60036040 tx=0x7faa60004a40 comp rx=0 tx=0).stop 2024-04-12T20:08:53.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.744+0000 7faa6ea00640 1 -- 172.21.15.131:0/3258117785 shutdown_connections 2024-04-12T20:08:53.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.744+0000 7faa6ea00640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7faa4806c920 0x7faa4806ede0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.744+0000 7faa6ea00640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7faa6814ece0 0x7faa681d9c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.744 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.744+0000 7faa6ea00640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faa6814f8a0 0x7faa681da190 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.744+0000 7faa6ea00640 1 --2- 172.21.15.131:0/3258117785 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7faa680a5ff0 0x7faa680c14c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.744+0000 7faa6ea00640 1 -- 172.21.15.131:0/3258117785 >> 172.21.15.131:0/3258117785 conn(0x7faa6806bbc0 msgr2=0x7faa6806bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:53.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.744+0000 7faa6ea00640 1 -- 172.21.15.131:0/3258117785 shutdown_connections 2024-04-12T20:08:53.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.744+0000 7faa6ea00640 1 -- 172.21.15.131:0/3258117785 wait complete. 2024-04-12T20:08:53.750 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:08:53.761 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-12T20:08:53.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.870+0000 7fe56f200640 1 Processor -- start 2024-04-12T20:08:53.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.870+0000 7fe56f200640 1 -- start start 2024-04-12T20:08:53.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56f200640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fe56814e880 0x7fe5680c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56f200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe5680c4aa0 0x7fe56806c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56f200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5680c14b0 con 0x7fe56806cd30 2024-04-12T20:08:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56f200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fe5680c1930 con 0x7fe5680c4aa0 2024-04-12T20:08:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56f200640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fe56806c080 con 0x7fe56814e880 2024-04-12T20:08:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56d400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe5680c4aa0 0x7fe56806c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56d400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fe5680c4aa0 0x7fe56806c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39966/0 (socket says 172.21.15.131:39966) 2024-04-12T20:08:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56d400640 1 -- 172.21.15.131:0/395076216 learned_addr learned my addr 172.21.15.131:0/395076216 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56de00640 1 --2- 172.21.15.131:0/395076216 >> v2:172.21.15.171:3300/0 conn(0x7fe56814e880 0x7fe5680c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56d400640 1 -- 172.21.15.131:0/395076216 >> v2:172.21.15.171:3300/0 conn(0x7fe56814e880 msgr2=0x7fe5680c4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56d400640 1 --2- 172.21.15.131:0/395076216 >> v2:172.21.15.171:3300/0 conn(0x7fe56814e880 0x7fe5680c4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56d400640 1 -- 172.21.15.131:0/395076216 >> v1:172.21.15.171:6789/0 conn(0x7fe56806cd30 legacy=0x7fe5681545c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.871+0000 7fe56d400640 1 -- 172.21.15.131:0/395076216 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe568151b70 con 0x7fe5680c4aa0 2024-04-12T20:08:53.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.872+0000 7fe56d400640 1 --2- 172.21.15.131:0/395076216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5680c4aa0 0x7fe56806c7f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe5680c1680 tx=0x7fe55802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a163d111bad9164b server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.873+0000 7fe56ca00640 1 -- 172.21.15.131:0/395076216 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55802e070 con 0x7fe5680c4aa0 2024-04-12T20:08:53.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.873+0000 7fe56ca00640 1 -- 172.21.15.131:0/395076216 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe558037070 con 0x7fe5680c4aa0 2024-04-12T20:08:53.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.873+0000 7fe56ca00640 1 -- 172.21.15.131:0/395076216 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe558031a00 con 0x7fe5680c4aa0 2024-04-12T20:08:53.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.873+0000 7fe56f200640 1 -- 172.21.15.131:0/395076216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5680c4aa0 msgr2=0x7fe56806c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.873 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.873+0000 7fe56f200640 1 --2- 172.21.15.131:0/395076216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5680c4aa0 0x7fe56806c7f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe5680c1680 tx=0x7fe55802b880 comp rx=0 tx=0).stop 2024-04-12T20:08:53.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.873+0000 7fe56f200640 1 -- 172.21.15.131:0/395076216 shutdown_connections 2024-04-12T20:08:53.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.873+0000 7fe56f200640 1 --2- 172.21.15.131:0/395076216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5680c4aa0 0x7fe56806c7f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.873+0000 7fe56f200640 1 --2- 172.21.15.131:0/395076216 >> v2:172.21.15.171:3300/0 conn(0x7fe56814e880 0x7fe5680c4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.873+0000 7fe56f200640 1 -- 172.21.15.131:0/395076216 >> 172.21.15.131:0/395076216 conn(0x7fe5680c6760 msgr2=0x7fe5680c6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:53.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.873+0000 7fe56f200640 1 -- 172.21.15.131:0/395076216 shutdown_connections 2024-04-12T20:08:53.874 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.874+0000 7fe56f200640 1 -- 172.21.15.131:0/395076216 wait complete. 2024-04-12T20:08:53.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.875+0000 7fe56f200640 1 Processor -- start 2024-04-12T20:08:53.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.875+0000 7fe56f200640 1 -- start start 2024-04-12T20:08:53.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.876+0000 7fe56f200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe56806cd30 0x7fe5680bcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.876+0000 7fe56f200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5680c4aa0 0x7fe5680bf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.876+0000 7fe56f200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56814e880 0x7fe5680bfe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.876+0000 7fe56f200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fe5680c4ec0 con 0x7fe56806cd30 2024-04-12T20:08:53.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.876+0000 7fe56f200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fe56806c360 con 0x7fe5680c4aa0 2024-04-12T20:08:53.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.876+0000 7fe56f200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fe5680c1e80 con 0x7fe56814e880 2024-04-12T20:08:53.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.876+0000 7fe56de00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe56806cd30 0x7fe5680bcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.876+0000 7fe56de00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe56806cd30 0x7fe5680bcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39978/0 (socket says 172.21.15.131:39978) 2024-04-12T20:08:53.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.876+0000 7fe56de00640 1 -- 172.21.15.131:0/3506424651 learned_addr learned my addr 172.21.15.131:0/3506424651 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:53.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.876+0000 7fe56d400640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5680c4aa0 0x7fe5680bf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.876+0000 7fe56e800640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56814e880 0x7fe5680bfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.877+0000 7fe56de00640 1 -- 172.21.15.131:0/3506424651 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56814e880 msgr2=0x7fe5680bfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.877+0000 7fe56de00640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56814e880 0x7fe5680bfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.877+0000 7fe56de00640 1 -- 172.21.15.131:0/3506424651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5680c4aa0 msgr2=0x7fe5680bf4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.877+0000 7fe56de00640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5680c4aa0 0x7fe5680bf4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.877+0000 7fe56de00640 1 -- 172.21.15.131:0/3506424651 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5680b8b00 con 0x7fe56806cd30 2024-04-12T20:08:53.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.877+0000 7fe56d400640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5680c4aa0 0x7fe5680bf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-12T20:08:53.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.877+0000 7fe56de00640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe56806cd30 0x7fe5680bcef0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00d800 tx=0x7fe55c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.877+0000 7fe562000640 1 -- 172.21.15.131:0/3506424651 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00b6c0 con 0x7fe56806cd30 2024-04-12T20:08:53.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.877+0000 7fe562000640 1 -- 172.21.15.131:0/3506424651 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe55c019070 con 0x7fe56806cd30 2024-04-12T20:08:53.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.877+0000 7fe562000640 1 -- 172.21.15.131:0/3506424651 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe55c00ba80 con 0x7fe56806cd30 2024-04-12T20:08:53.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.877+0000 7fe56f200640 1 -- 172.21.15.131:0/3506424651 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5680bfb30 con 0x7fe56806cd30 2024-04-12T20:08:53.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.878+0000 7fe56f200640 1 -- 172.21.15.131:0/3506424651 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe568154af0 con 0x7fe56806cd30 2024-04-12T20:08:53.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.879+0000 7fe56f200640 1 -- 172.21.15.131:0/3506424651 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe568154e30 con 0x7fe56806cd30 2024-04-12T20:08:53.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.879+0000 7fe562000640 1 -- 172.21.15.131:0/3506424651 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fe55c00bc20 con 0x7fe56806cd30 2024-04-12T20:08:53.880 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.881+0000 7fe562000640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe54c06c8f0 0x7fe54c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.881+0000 7fe562000640 1 -- 172.21.15.131:0/3506424651 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7fe55c08c460 con 0x7fe56806cd30 2024-04-12T20:08:53.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.881+0000 7fe56d400640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe54c06c8f0 0x7fe54c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.881 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.882+0000 7fe56d400640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe54c06c8f0 0x7fe54c06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe558036000 tx=0x7fe55803d040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.884 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.885+0000 7fe562000640 1 -- 172.21.15.131:0/3506424651 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fe568154e30 con 0x7fe56806cd30 2024-04-12T20:08:53.980 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.981+0000 7f3ef3c00640 1 Processor -- start 2024-04-12T20:08:53.981 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.981+0000 7f3ef3c00640 1 -- start start 2024-04-12T20:08:53.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.982+0000 7f3ef3c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3eec0bb240 0x7f3eec0c0490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.982+0000 7f3ef3c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3eec070a40 0x7f3eec0c09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.982+0000 7f3ef3c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3eec14f8a0 con 0x7f3eec0c4920 2024-04-12T20:08:53.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.982+0000 7f3ef3c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f3eec0ba7f0 con 0x7f3eec070a40 2024-04-12T20:08:53.982 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.982+0000 7f3ef3c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3eec0badb0 con 0x7f3eec0bb240 2024-04-12T20:08:53.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.983+0000 7f3eebe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3eec0bb240 0x7f3eec0c0490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.983+0000 7f3ef1c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f3eec070a40 0x7f3eec0c09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.983+0000 7f3eebe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3eec0bb240 0x7f3eec0c0490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.171:3301/0 says I am v2:172.21.15.131:54974/0 (socket says 172.21.15.131:54974) 2024-04-12T20:08:53.983 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.983+0000 7f3eebe00640 1 -- 172.21.15.131:0/3138937831 learned_addr learned my addr 172.21.15.131:0/3138937831 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:53.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.984+0000 7f3ef1c00640 1 -- 172.21.15.131:0/3138937831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3eec0bb240 msgr2=0x7f3eec0c0490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:53.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.984+0000 7f3ef1c00640 1 --2- 172.21.15.131:0/3138937831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3eec0bb240 0x7f3eec0c0490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.984+0000 7f3ef1c00640 1 -- 172.21.15.131:0/3138937831 >> v1:172.21.15.171:6789/0 conn(0x7f3eec0c4920 legacy=0x7f3eec0c10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.984+0000 7f3ef1c00640 1 -- 172.21.15.131:0/3138937831 --> v2:172.21.15.171:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eec149440 con 0x7f3eec070a40 2024-04-12T20:08:53.984 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.985+0000 7f3ef1c00640 1 --2- 172.21.15.131:0/3138937831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3eec070a40 0x7f3eec0c09d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009d90 tx=0x7f3ee402be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f99efba702bf0575 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.985+0000 7f3eeb400640 1 -- 172.21.15.131:0/3138937831 <== mon.1 v2:172.21.15.171:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4039070 con 0x7f3eec070a40 2024-04-12T20:08:53.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.985+0000 7f3eeb400640 1 -- 172.21.15.131:0/3138937831 <== mon.1 v2:172.21.15.171:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee402cbd0 con 0x7f3eec070a40 2024-04-12T20:08:53.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.985+0000 7f3eeb400640 1 -- 172.21.15.131:0/3138937831 <== mon.1 v2:172.21.15.171:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4034440 con 0x7f3eec070a40 2024-04-12T20:08:53.985 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.986+0000 7f3ef3c00640 1 -- 172.21.15.131:0/3138937831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3eec070a40 msgr2=0x7f3eec0c09d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.986+0000 7f3ef3c00640 1 --2- 172.21.15.131:0/3138937831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3eec070a40 0x7f3eec0c09d0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009d90 tx=0x7f3ee402be20 comp rx=0 tx=0).stop 2024-04-12T20:08:53.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.986+0000 7f3ef3c00640 1 -- 172.21.15.131:0/3138937831 shutdown_connections 2024-04-12T20:08:53.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.986+0000 7f3ef3c00640 1 --2- 172.21.15.131:0/3138937831 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3eec070a40 0x7f3eec0c09d0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.986+0000 7f3ef3c00640 1 --2- 172.21.15.131:0/3138937831 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3eec0bb240 0x7f3eec0c0490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.986+0000 7f3ef3c00640 1 -- 172.21.15.131:0/3138937831 >> 172.21.15.131:0/3138937831 conn(0x7f3eec073910 msgr2=0x7f3eec06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:53.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.986+0000 7f3ef3c00640 1 -- 172.21.15.131:0/3138937831 shutdown_connections 2024-04-12T20:08:53.986 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.986+0000 7f3ef3c00640 1 -- 172.21.15.131:0/3138937831 wait complete. 2024-04-12T20:08:53.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.988+0000 7f3ef3c00640 1 Processor -- start 2024-04-12T20:08:53.987 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.988+0000 7f3ef3c00640 1 -- start start 2024-04-12T20:08:53.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.989+0000 7f3ef3c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3eec070a40 0x7f3eec0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.989 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.989+0000 7f3ef3c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3eec0bb240 0x7f3eec0bf010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.989+0000 7f3ef3c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3eec0c4920 0x7f3eec145e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.989+0000 7f3ef3c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec071560 con 0x7f3eec0c4920 2024-04-12T20:08:53.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.989+0000 7f3ef3c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f3eec0baa40 con 0x7f3eec070a40 2024-04-12T20:08:53.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.989+0000 7f3ef3c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f3eec0716e0 con 0x7f3eec0bb240 2024-04-12T20:08:53.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.990+0000 7f3ef1c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3eec0c4920 0x7f3eec145e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.990+0000 7f3ef1c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3eec0c4920 0x7f3eec145e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:39980/0 (socket says 172.21.15.131:39980) 2024-04-12T20:08:53.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.990+0000 7f3ef1c00640 1 -- 172.21.15.131:0/162499858 learned_addr learned my addr 172.21.15.131:0/162499858 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:53.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.990+0000 7f3ef1200640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3eec070a40 0x7f3eec0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.990 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.990+0000 7f3eebe00640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3eec0bb240 0x7f3eec0bf010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.990+0000 7f3ef1c00640 1 -- 172.21.15.131:0/162499858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3eec0bb240 msgr2=0x7f3eec0bf010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.990+0000 7f3ef1c00640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3eec0bb240 0x7f3eec0bf010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.990+0000 7f3ef1c00640 1 -- 172.21.15.131:0/162499858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3eec070a40 msgr2=0x7f3eec0a5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:53.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.990+0000 7f3ef1c00640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3eec070a40 0x7f3eec0a5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:53.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.990+0000 7f3ef1c00640 1 -- 172.21.15.131:0/162499858 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3eec0bf550 con 0x7f3eec0c4920 2024-04-12T20:08:53.991 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.990+0000 7f3ef1c00640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3eec0c4920 0x7f3eec145e70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009eb0 tx=0x7f3ee4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.991+0000 7f3ee8c00640 1 -- 172.21.15.131:0/162499858 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4039050 con 0x7f3eec0c4920 2024-04-12T20:08:53.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.991+0000 7f3ee8c00640 1 -- 172.21.15.131:0/162499858 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ee4045070 con 0x7f3eec0c4920 2024-04-12T20:08:53.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.991+0000 7f3ee8c00640 1 -- 172.21.15.131:0/162499858 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ee4009450 con 0x7f3eec0c4920 2024-04-12T20:08:53.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.991+0000 7f3ef3c00640 1 -- 172.21.15.131:0/162499858 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3eec1e7870 con 0x7f3eec0c4920 2024-04-12T20:08:53.992 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.991+0000 7f3ef3c00640 1 -- 172.21.15.131:0/162499858 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3eec145950 con 0x7f3eec0c4920 2024-04-12T20:08:53.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.992+0000 7f3ef3c00640 1 -- 172.21.15.131:0/162499858 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3eec068c10 con 0x7f3eec0c4920 2024-04-12T20:08:53.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.993+0000 7f3ee8c00640 1 -- 172.21.15.131:0/162499858 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f3ee403e850 con 0x7f3eec0c4920 2024-04-12T20:08:53.993 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.994+0000 7f3ee8c00640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f3ecc06c920 0x7f3ecc06ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:53.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.994+0000 7f3ee8c00640 1 -- 172.21.15.131:0/162499858 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f3ee40aec10 con 0x7f3eec0c4920 2024-04-12T20:08:53.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.995+0000 7f3ef1200640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f3ecc06c920 0x7f3ecc06ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:53.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.995+0000 7f3ef1200640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f3ecc06c920 0x7f3ecc06ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0007fd0 tx=0x7f3ee0009040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:53.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:53.999+0000 7f3ee8c00640 1 -- 172.21.15.131:0/162499858 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f3eec068c10 con 0x7f3eec0c4920 2024-04-12T20:08:54.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.089+0000 7fe56f200640 1 -- 172.21.15.131:0/3506424651 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe5680c1710 con 0x7fe56806cd30 2024-04-12T20:08:54.088 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.089+0000 7fe562000640 1 -- 172.21.15.131:0/3506424651 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) ==== 104+0+11 (secure 0 0 0) 0x7fe55c060070 con 0x7fe56806cd30 2024-04-12T20:08:54.089 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T20:08:54.091 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.092+0000 7fe56f200640 1 -- 172.21.15.131:0/3506424651 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe54c06c8f0 msgr2=0x7fe54c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.092+0000 7fe56f200640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe54c06c8f0 0x7fe54c06edb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe558036000 tx=0x7fe55803d040 comp rx=0 tx=0).stop 2024-04-12T20:08:54.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.092+0000 7fe56f200640 1 -- 172.21.15.131:0/3506424651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe56806cd30 msgr2=0x7fe5680bcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.092+0000 7fe56f200640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe56806cd30 0x7fe5680bcef0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00d800 tx=0x7fe55c00dcc0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.092+0000 7fe56f200640 1 -- 172.21.15.131:0/3506424651 shutdown_connections 2024-04-12T20:08:54.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.092+0000 7fe56f200640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fe54c06c8f0 0x7fe54c06edb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.092+0000 7fe56f200640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fe5680c4aa0 0x7fe5680bf4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.092 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.092+0000 7fe56f200640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fe56814e880 0x7fe5680bfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.092+0000 7fe56f200640 1 --2- 172.21.15.131:0/3506424651 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe56806cd30 0x7fe5680bcef0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.092+0000 7fe56f200640 1 -- 172.21.15.131:0/3506424651 >> 172.21.15.131:0/3506424651 conn(0x7fe5680c6760 msgr2=0x7fe5681510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:54.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.092+0000 7fe56f200640 1 -- 172.21.15.131:0/3506424651 shutdown_connections 2024-04-12T20:08:54.093 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.092+0000 7fe56f200640 1 -- 172.21.15.131:0/3506424651 wait complete. 2024-04-12T20:08:54.116 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-12T20:08:54.223 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.224+0000 7f3ef3c00640 1 -- 172.21.15.131:0/162499858 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3eec0c4d90 con 0x7f3eec0c4920 2024-04-12T20:08:54.224 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.224+0000 7f3ee8c00640 1 -- 172.21.15.131:0/162499858 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v53) ==== 80+0+370 (secure 0 0 0) 0x7f3eec0c4d90 con 0x7f3eec0c4920 2024-04-12T20:08:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131:6837/2898590457 2024-04-13T20:04:46.991422+0000 2024-04-12T20:08:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131:6835/2898590457 2024-04-13T20:04:46.991422+0000 2024-04-12T20:08:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6835/373698102 2024-04-13T20:04:21.983874+0000 2024-04-12T20:08:54.224 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6833/373698102 2024-04-13T20:04:21.983874+0000 2024-04-12T20:08:54.225 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6834/1013642393 2024-04-13T20:03:56.972117+0000 2024-04-12T20:08:54.225 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6832/1013642393 2024-04-13T20:03:56.972117+0000 2024-04-12T20:08:54.225 INFO:teuthology.orchestra.run.smithi131.stderr:listed 6 entries 2024-04-12T20:08:54.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.227+0000 7f3ef3c00640 1 -- 172.21.15.131:0/162499858 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f3ecc06c920 msgr2=0x7f3ecc06ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.227+0000 7f3ef3c00640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f3ecc06c920 0x7f3ecc06ede0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0007fd0 tx=0x7f3ee0009040 comp rx=0 tx=0).stop 2024-04-12T20:08:54.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.227+0000 7f3ef3c00640 1 -- 172.21.15.131:0/162499858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3eec0c4920 msgr2=0x7f3eec145e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.227+0000 7f3ef3c00640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3eec0c4920 0x7f3eec145e70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4009eb0 tx=0x7f3ee4004a40 comp rx=0 tx=0).stop 2024-04-12T20:08:54.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.227+0000 7f3ef3c00640 1 -- 172.21.15.131:0/162499858 shutdown_connections 2024-04-12T20:08:54.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.227+0000 7f3ef3c00640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f3ecc06c920 0x7f3ecc06ede0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.227+0000 7f3ef3c00640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3eec0c4920 0x7f3eec145e70 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.227+0000 7f3ef3c00640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3eec0bb240 0x7f3eec0bf010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.227 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.227+0000 7f3ef3c00640 1 --2- 172.21.15.131:0/162499858 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f3eec070a40 0x7f3eec0a5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.227+0000 7f3ef3c00640 1 -- 172.21.15.131:0/162499858 >> 172.21.15.131:0/162499858 conn(0x7f3eec073910 msgr2=0x7f3eec0c3bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:54.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.227+0000 7f3ef3c00640 1 -- 172.21.15.131:0/162499858 shutdown_connections 2024-04-12T20:08:54.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.227+0000 7f3ef3c00640 1 -- 172.21.15.131:0/162499858 wait complete. 2024-04-12T20:08:54.245 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-04-12T20:08:54.245 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-12T20:08:54.286 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-12T20:08:54.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.358+0000 7f3251600640 1 Processor -- start 2024-04-12T20:08:54.357 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.358+0000 7f3251600640 1 -- start start 2024-04-12T20:08:54.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.360+0000 7f3251600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f324c0c4c90 0x7f324c06c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.360+0000 7f3251600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f324c06cd50 0x7f324c15b910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.360+0000 7f3251600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f324c0c14d0 con 0x7f324c14e8a0 2024-04-12T20:08:54.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.360+0000 7f3251600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f324c0c1950 con 0x7f324c06cd50 2024-04-12T20:08:54.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.360+0000 7f3251600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f324c06c0a0 con 0x7f324c0c4c90 2024-04-12T20:08:54.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.360+0000 7f324be00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f324c14e8a0 0x7f324c0c4580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46940/0 (socket says 172.21.15.131:46940) 2024-04-12T20:08:54.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.360+0000 7f324be00640 1 -- 172.21.15.131:0/1774955416 learned_addr learned my addr 172.21.15.131:0/1774955416 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T20:08:54.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.360+0000 7f3250c00640 1 --2- 172.21.15.131:0/1774955416 >> v2:172.21.15.131:3300/0 conn(0x7f324c06cd50 0x7f324c15b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.360+0000 7f324b400640 1 --2- 172.21.15.131:0/1774955416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f324c0c4c90 0x7f324c06c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.360+0000 7f324aa00640 1 -- 172.21.15.131:0/1774955416 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2060532366 0 0) 0x7f324c0c14d0 con 0x7f324c14e8a0 2024-04-12T20:08:54.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.360+0000 7f324aa00640 1 -- 172.21.15.131:0/1774955416 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3230003520 con 0x7f324c14e8a0 2024-04-12T20:08:54.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.361+0000 7f3250c00640 1 -- 172.21.15.131:0/1774955416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f324c0c4c90 msgr2=0x7f324c06c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:54.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.361+0000 7f3250c00640 1 --2- 172.21.15.131:0/1774955416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f324c0c4c90 0x7f324c06c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.361+0000 7f3250c00640 1 -- 172.21.15.131:0/1774955416 >> v1:172.21.15.131:6789/0 conn(0x7f324c14e8a0 legacy=0x7f324c0c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.361 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.361+0000 7f3250c00640 1 -- 172.21.15.131:0/1774955416 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324c151b90 con 0x7f324c06cd50 2024-04-12T20:08:54.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.362+0000 7f3250c00640 1 --2- 172.21.15.131:0/1774955416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f324c06cd50 0x7f324c15b910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3244009d90 tx=0x7f324402be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5628381b7c9055c server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:54.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.362+0000 7f324aa00640 1 -- 172.21.15.131:0/1774955416 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244039070 con 0x7f324c06cd50 2024-04-12T20:08:54.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.362+0000 7f324aa00640 1 -- 172.21.15.131:0/1774955416 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f324402cbc0 con 0x7f324c06cd50 2024-04-12T20:08:54.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.362+0000 7f324aa00640 1 -- 172.21.15.131:0/1774955416 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244034440 con 0x7f324c06cd50 2024-04-12T20:08:54.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.363+0000 7f3251600640 1 -- 172.21.15.131:0/1774955416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f324c06cd50 msgr2=0x7f324c15b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.363+0000 7f3251600640 1 --2- 172.21.15.131:0/1774955416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f324c06cd50 0x7f324c15b910 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f3244009d90 tx=0x7f324402be10 comp rx=0 tx=0).stop 2024-04-12T20:08:54.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.363+0000 7f3251600640 1 -- 172.21.15.131:0/1774955416 shutdown_connections 2024-04-12T20:08:54.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.363+0000 7f3251600640 1 --2- 172.21.15.131:0/1774955416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f324c06cd50 0x7f324c15b910 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.363+0000 7f3251600640 1 --2- 172.21.15.131:0/1774955416 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f324c0c4c90 0x7f324c06c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.363+0000 7f3251600640 1 -- 172.21.15.131:0/1774955416 >> 172.21.15.131:0/1774955416 conn(0x7f324c0c6780 msgr2=0x7f324c0c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:54.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.363+0000 7f3251600640 1 -- 172.21.15.131:0/1774955416 shutdown_connections 2024-04-12T20:08:54.364 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.363+0000 7f3251600640 1 -- 172.21.15.131:0/1774955416 wait complete. 2024-04-12T20:08:54.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.364+0000 7f3251600640 1 Processor -- start 2024-04-12T20:08:54.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.364+0000 7f3251600640 1 -- start start 2024-04-12T20:08:54.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.365+0000 7f3251600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f324c06cd50 0x7f324c0bcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.365+0000 7f3251600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f324c0c4c90 0x7f324c0bead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.365+0000 7f3251600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f324c14e8a0 0x7f324c0c0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.366 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.365+0000 7f3251600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f324c0c1ea0 con 0x7f324c06cd50 2024-04-12T20:08:54.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.365+0000 7f3251600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f324c06c380 con 0x7f324c0c4c90 2024-04-12T20:08:54.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.365+0000 7f3251600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f324c0c1ba0 con 0x7f324c14e8a0 2024-04-12T20:08:54.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.365+0000 7f324be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f324c06cd50 0x7f324c0bcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.366+0000 7f324be00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f324c06cd50 0x7f324c0bcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40000/0 (socket says 172.21.15.131:40000) 2024-04-12T20:08:54.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.366+0000 7f324be00640 1 -- 172.21.15.131:0/928670743 learned_addr learned my addr 172.21.15.131:0/928670743 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:54.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.366+0000 7f324b400640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f324c0c4c90 0x7f324c0bead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.366+0000 7f3250c00640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f324c14e8a0 0x7f324c0c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.367 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.366+0000 7f324be00640 1 -- 172.21.15.131:0/928670743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f324c14e8a0 msgr2=0x7f324c0c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.366+0000 7f324be00640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f324c14e8a0 0x7f324c0c0140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.366+0000 7f324be00640 1 -- 172.21.15.131:0/928670743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f324c0c4c90 msgr2=0x7f324c0bead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.366+0000 7f324be00640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f324c0c4c90 0x7f324c0bead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.366+0000 7f324be00640 1 -- 172.21.15.131:0/928670743 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f324c1da630 con 0x7f324c06cd50 2024-04-12T20:08:54.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.366+0000 7f324be00640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f324c06cd50 0x7f324c0bcdd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c430 tx=0x7f323c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:54.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.367+0000 7f3243e00640 1 -- 172.21.15.131:0/928670743 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c017070 con 0x7f324c06cd50 2024-04-12T20:08:54.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.367+0000 7f3243e00640 1 -- 172.21.15.131:0/928670743 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f323c005ce0 con 0x7f324c06cd50 2024-04-12T20:08:54.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.367+0000 7f3243e00640 1 -- 172.21.15.131:0/928670743 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c0072f0 con 0x7f324c06cd50 2024-04-12T20:08:54.368 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.367+0000 7f3251600640 1 -- 172.21.15.131:0/928670743 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f324c0bc460 con 0x7f324c06cd50 2024-04-12T20:08:54.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.367+0000 7f3251600640 1 -- 172.21.15.131:0/928670743 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f324c1e71c0 con 0x7f324c06cd50 2024-04-12T20:08:54.369 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.368+0000 7f3251600640 1 -- 172.21.15.131:0/928670743 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f324c04fd50 con 0x7f324c06cd50 2024-04-12T20:08:54.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.369+0000 7f3243e00640 1 -- 172.21.15.131:0/928670743 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f323c01a070 con 0x7f324c06cd50 2024-04-12T20:08:54.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.370+0000 7f3243e00640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f322c06c8f0 0x7f322c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.370+0000 7f3243e00640 1 -- 172.21.15.131:0/928670743 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f323c08b550 con 0x7f324c06cd50 2024-04-12T20:08:54.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.370+0000 7f324b400640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f322c06c8f0 0x7f322c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.370 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.371+0000 7f324b400640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f322c06c8f0 0x7f322c06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f324c1eb300 tx=0x7f3238008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:54.373 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.374+0000 7f3243e00640 1 -- 172.21.15.131:0/928670743 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f323c059460 con 0x7f324c06cd50 2024-04-12T20:08:54.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.514+0000 7fa6c1c00640 1 Processor -- start 2024-04-12T20:08:54.514 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.515+0000 7fa6c1c00640 1 -- start start 2024-04-12T20:08:54.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.516+0000 7fa6c1c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6bc06df60 0x7fa6bc06c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.516+0000 7fa6c1c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa6bc06cdd0 0x7fa6bc15b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.516+0000 7fa6c1c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6bc06c0d0 con 0x7fa6bc14e870 2024-04-12T20:08:54.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.516+0000 7fa6c1c00640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa6bc06e3c0 con 0x7fa6bc06df60 2024-04-12T20:08:54.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.516+0000 7fa6c1c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa6bc0c2b80 con 0x7fa6bc06cdd0 2024-04-12T20:08:54.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.516+0000 7fa6bb400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6bc06df60 0x7fa6bc06c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.517+0000 7fa6bb400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa6bc06df60 0x7fa6bc06c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40010/0 (socket says 172.21.15.131:40010) 2024-04-12T20:08:54.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.517+0000 7fa6bbe00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7fa6bc14e870 0x7fa6bc0c4550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46954/0 (socket says 172.21.15.131:46954) 2024-04-12T20:08:54.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.517+0000 7fa6bb400640 1 -- 172.21.15.131:0/3581550428 learned_addr learned my addr 172.21.15.131:0/3581550428 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:54.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.517+0000 7fa6c1200640 1 --2- 172.21.15.131:0/3581550428 >> v2:172.21.15.171:3300/0 conn(0x7fa6bc06cdd0 0x7fa6bc15b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.517+0000 7fa6bb400640 1 -- 172.21.15.131:0/3581550428 >> v2:172.21.15.171:3300/0 conn(0x7fa6bc06cdd0 msgr2=0x7fa6bc15b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:54.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.517+0000 7fa6bb400640 1 --2- 172.21.15.131:0/3581550428 >> v2:172.21.15.171:3300/0 conn(0x7fa6bc06cdd0 0x7fa6bc15b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.517+0000 7fa6bb400640 1 -- 172.21.15.131:0/3581550428 >> v1:172.21.15.131:6789/0 conn(0x7fa6bc14e870 legacy=0x7fa6bc0c4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.517+0000 7fa6bb400640 1 -- 172.21.15.131:0/3581550428 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6bc151c60 con 0x7fa6bc06df60 2024-04-12T20:08:54.518 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.517+0000 7fa6baa00640 1 -- 172.21.15.131:0/3581550428 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1710828505 0 0) 0x7fa6bc06c0d0 con 0x7fa6bc14e870 2024-04-12T20:08:54.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.518+0000 7fa6bb400640 1 --2- 172.21.15.131:0/3581550428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6bc06df60 0x7fa6bc06c890 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0ac8a0 tx=0x7fa6ac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535cb38d08ae69dd server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:54.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.519+0000 7fa6baa00640 1 -- 172.21.15.131:0/3581550428 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac034070 con 0x7fa6bc06df60 2024-04-12T20:08:54.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.519+0000 7fa6baa00640 1 -- 172.21.15.131:0/3581550428 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6ac030860 con 0x7fa6bc06df60 2024-04-12T20:08:54.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.519+0000 7fa6baa00640 1 -- 172.21.15.131:0/3581550428 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac030c30 con 0x7fa6bc06df60 2024-04-12T20:08:54.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.520+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3581550428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6bc06df60 msgr2=0x7fa6bc06c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.520+0000 7fa6c1c00640 1 --2- 172.21.15.131:0/3581550428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6bc06df60 0x7fa6bc06c890 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc0ac8a0 tx=0x7fa6ac02b9a0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.520+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3581550428 shutdown_connections 2024-04-12T20:08:54.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.520+0000 7fa6c1c00640 1 --2- 172.21.15.131:0/3581550428 >> v2:172.21.15.171:3300/0 conn(0x7fa6bc06cdd0 0x7fa6bc15b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.520 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.520+0000 7fa6c1c00640 1 --2- 172.21.15.131:0/3581550428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6bc06df60 0x7fa6bc06c890 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.520+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3581550428 >> 172.21.15.131:0/3581550428 conn(0x7fa6bc0c6750 msgr2=0x7fa6bc0c6b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:54.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.520+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3581550428 shutdown_connections 2024-04-12T20:08:54.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.520+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3581550428 wait complete. 2024-04-12T20:08:54.521 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.522+0000 7fa6c1c00640 1 Processor -- start 2024-04-12T20:08:54.522 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.522+0000 7fa6c1c00640 1 -- start start 2024-04-12T20:08:54.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.524+0000 7fa6c1c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6bc06cdd0 0x7fa6bc1e9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.524 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.524+0000 7fa6c1c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6bc06df60 0x7fa6bc0bec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.524+0000 7fa6c1c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6bc14e870 0x7fa6bc0bf190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.524+0000 7fa6c1c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc151f40 con 0x7fa6bc14e870 2024-04-12T20:08:54.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.524+0000 7fa6c1c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7fa6bc0c4c60 con 0x7fa6bc06df60 2024-04-12T20:08:54.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.524+0000 7fa6c1c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa6bc06e800 con 0x7fa6bc06cdd0 2024-04-12T20:08:54.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.524+0000 7fa6c1200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6bc14e870 0x7fa6bc0bf190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.524+0000 7fa6c1200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6bc14e870 0x7fa6bc0bf190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40024/0 (socket says 172.21.15.131:40024) 2024-04-12T20:08:54.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.524+0000 7fa6c1200640 1 -- 172.21.15.131:0/3806671012 learned_addr learned my addr 172.21.15.131:0/3806671012 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:54.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.524+0000 7fa6bbe00640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6bc06cdd0 0x7fa6bc1e9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.524+0000 7fa6bb400640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6bc06df60 0x7fa6bc0bec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.525+0000 7fa6c1200640 1 -- 172.21.15.131:0/3806671012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6bc06cdd0 msgr2=0x7fa6bc1e9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.525+0000 7fa6c1200640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6bc06cdd0 0x7fa6bc1e9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.525+0000 7fa6c1200640 1 -- 172.21.15.131:0/3806671012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6bc06df60 msgr2=0x7fa6bc0bec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.526 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.525+0000 7fa6c1200640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6bc06df60 0x7fa6bc0bec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.525+0000 7fa6c1200640 1 -- 172.21.15.131:0/3806671012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6bc1e9a30 con 0x7fa6bc14e870 2024-04-12T20:08:54.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.525+0000 7fa6c1200640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6bc14e870 0x7fa6bc0bf190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4007e90 tx=0x7fa6b400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:54.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.525+0000 7fa6b3e00640 1 -- 172.21.15.131:0/3806671012 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4014420 con 0x7fa6bc14e870 2024-04-12T20:08:54.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.525+0000 7fa6b3e00640 1 -- 172.21.15.131:0/3806671012 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b4019070 con 0x7fa6bc14e870 2024-04-12T20:08:54.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.525+0000 7fa6b3e00640 1 -- 172.21.15.131:0/3806671012 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b4014800 con 0x7fa6bc14e870 2024-04-12T20:08:54.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.525+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3806671012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6bc1ea740 con 0x7fa6bc14e870 2024-04-12T20:08:54.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.525+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3806671012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6bc1ea9e0 con 0x7fa6bc14e870 2024-04-12T20:08:54.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.527+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3806671012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6bc075c30 con 0x7fa6bc14e870 2024-04-12T20:08:54.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.527+0000 7fa6b3e00640 1 -- 172.21.15.131:0/3806671012 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7fa6b40149a0 con 0x7fa6bc14e870 2024-04-12T20:08:54.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.528+0000 7fa6b3e00640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa69c06c8f0 0x7fa69c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.528+0000 7fa6b3e00640 1 -- 172.21.15.131:0/3806671012 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7fa6b408c800 con 0x7fa6bc14e870 2024-04-12T20:08:54.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.528+0000 7fa6bbe00640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa69c06c8f0 0x7fa69c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.529+0000 7fa6bbe00640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa69c06c8f0 0x7fa69c06edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8000f60 tx=0x7fa6a8007b50 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:54.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.533+0000 7fa6b3e00640 1 -- 172.21.15.131:0/3806671012 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7fa6b405a7b0 con 0x7fa6bc14e870 2024-04-12T20:08:54.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.602+0000 7f3251600640 1 -- 172.21.15.131:0/928670743 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f324c1e6cd0 con 0x7f324c06cd50 2024-04-12T20:08:54.601 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.602+0000 7f3243e00640 1 -- 172.21.15.131:0/928670743 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) ==== 100+0+11 (secure 0 0 0) 0x7f323c058d60 con 0x7f324c06cd50 2024-04-12T20:08:54.602 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-12T20:08:54.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.605+0000 7f3251600640 1 -- 172.21.15.131:0/928670743 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f322c06c8f0 msgr2=0x7f322c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.605+0000 7f3251600640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f322c06c8f0 0x7f322c06edb0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f324c1eb300 tx=0x7f3238008040 comp rx=0 tx=0).stop 2024-04-12T20:08:54.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.605+0000 7f3251600640 1 -- 172.21.15.131:0/928670743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f324c06cd50 msgr2=0x7f324c0bcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.605+0000 7f3251600640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f324c06cd50 0x7f324c0bcdd0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f323c00c430 tx=0x7f323c00c8f0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.605+0000 7f3251600640 1 -- 172.21.15.131:0/928670743 shutdown_connections 2024-04-12T20:08:54.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.605+0000 7f3251600640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f322c06c8f0 0x7f322c06edb0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.605+0000 7f3251600640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f324c0c4c90 0x7f324c0bead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.605+0000 7f3251600640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f324c14e8a0 0x7f324c0c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.605+0000 7f3251600640 1 --2- 172.21.15.131:0/928670743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f324c06cd50 0x7f324c0bcdd0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.605+0000 7f3251600640 1 -- 172.21.15.131:0/928670743 >> 172.21.15.131:0/928670743 conn(0x7f324c0c6780 msgr2=0x7f324c0c4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:54.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.605+0000 7f3251600640 1 -- 172.21.15.131:0/928670743 shutdown_connections 2024-04-12T20:08:54.606 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.605+0000 7f3251600640 1 -- 172.21.15.131:0/928670743 wait complete. 2024-04-12T20:08:54.622 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-12T20:08:54.743 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.744+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3806671012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6bc06dd40 con 0x7fa6bc14e870 2024-04-12T20:08:54.745 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.745+0000 7fa6b3e00640 1 -- 172.21.15.131:0/3806671012 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) ==== 74+0+19332 (secure 0 0 0) 0x7fa6b405a0b0 con 0x7fa6bc14e870 2024-04-12T20:08:54.745 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-04-12T20:08:54.745 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":53,"fsid":"7d934d91-9372-4a63-bf09-7016009c45b3","created":"2024-04-12T19:38:51.797907+0000","modified":"2024-04-12T20:04:46.991521+0000","last_up_change":"2024-04-12T19:39:03.295046+0000","last_in_change":"2024-04-12T19:38:55.344572+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-12T19:39:04.855067+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-12T19:39:09.370965+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-12T19:39:09.858079+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-12T19:39:13.479306+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"48","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":505,"snap_epoch":48,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"a4363c22-a82d-46d3-9a01-3dde8d069198","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6801","nonce":1197764671}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6803","nonce":1197764671}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6807","nonce":1197764671}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":1197764671},{"type":"v1","addr":"172.21.15.131:6805","nonce":1197764671}]},"public_addr":"172.21.15.131:6801/1197764671","cluster_addr":"172.21.15.131:6803/1197764671","heartbeat_back_addr":"172.21.15.131:6807/1197764671","heartbeat_front_addr":"172.21.15.131:6805/1197764671","state":["exists","up"]},{"osd":1,"uuid":"5eca569a-6a51-40af-92bf-9350b3d38127","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6809","nonce":3781331940}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6811","nonce":3781331940}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6815","nonce":3781331940}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3781331940},{"type":"v1","addr":"172.21.15.131:6813","nonce":3781331940}]},"public_addr":"172.21.15.131:6809/3781331940","cluster_addr":"172.21.15.131:6811/3781331940","heartbeat_back_addr":"172.21.15.131:6815/3781331940","heartbeat_front_addr":"172.21.15.131:6813/3781331940","state":["exists","up"]},{"osd":2,"uuid":"59a3d085-e2de-4ac1-9542-ccd13ade76bd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6817","nonce":1637719657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6819","nonce":1637719657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6823","nonce":1637719657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":1637719657},{"type":"v1","addr":"172.21.15.131:6821","nonce":1637719657}]},"public_addr":"172.21.15.131:6817/1637719657","cluster_addr":"172.21.15.131:6819/1637719657","heartbeat_back_addr":"172.21.15.131:6823/1637719657","heartbeat_front_addr":"172.21.15.131:6821/1637719657","state":["exists","up"]},{"osd":3,"uuid":"858f9338-1df7-427e-9636-7f5f839a81dc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6825","nonce":736798902}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6827","nonce":736798902}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6830","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6831","nonce":736798902}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6828","nonce":736798902},{"type":"v1","addr":"172.21.15.131:6829","nonce":736798902}]},"public_addr":"172.21.15.131:6825/736798902","cluster_addr":"172.21.15.131:6827/736798902","heartbeat_back_addr":"172.21.15.131:6831/736798902","heartbeat_front_addr":"172.21.15.131:6829/736798902","state":["exists","up"]},{"osd":4,"uuid":"2635fc65-cc14-4d65-b397-b1c7a38770a0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6821","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6823","nonce":22785163}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6825","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6827","nonce":22785163}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6831","nonce":22785163}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":22785163},{"type":"v1","addr":"172.21.15.171:6829","nonce":22785163}]},"public_addr":"172.21.15.171:6823/22785163","cluster_addr":"172.21.15.171:6827/22785163","heartbeat_back_addr":"172.21.15.171:6831/22785163","heartbeat_front_addr":"172.21.15.171:6829/22785163","state":["exists","up"]},{"osd":5,"uuid":"d7b86793-91e8-4d4b-85d9-997e6f72051c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6801","nonce":1706601782}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6803","nonce":1706601782}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6807","nonce":1706601782}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":1706601782},{"type":"v1","addr":"172.21.15.171:6805","nonce":1706601782}]},"public_addr":"172.21.15.171:6801/1706601782","cluster_addr":"172.21.15.171:6803/1706601782","heartbeat_back_addr":"172.21.15.171:6807/1706601782","heartbeat_front_addr":"172.21.15.171:6805/1706601782","state":["exists","up"]},{"osd":6,"uuid":"9c4f69e8-27c9-4efe-8f6b-367246841c7c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6817","nonce":54064703}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6819","nonce":54064703}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6826","nonce":54064703}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":54064703},{"type":"v1","addr":"172.21.15.171:6822","nonce":54064703}]},"public_addr":"172.21.15.171:6817/54064703","cluster_addr":"172.21.15.171:6819/54064703","heartbeat_back_addr":"172.21.15.171:6826/54064703","heartbeat_front_addr":"172.21.15.171:6822/54064703","state":["exists","up"]},{"osd":7,"uuid":"edaa1a24-13f4-419f-ba8e-d633d9a2f7c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6809","nonce":285879561}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6811","nonce":285879561}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6815","nonce":285879561}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":285879561},{"type":"v1","addr":"172.21.15.171:6813","nonce":285879561}]},"public_addr":"172.21.15.171:6809/285879561","cluster_addr":"172.21.15.171:6811/285879561","heartbeat_back_addr":"172.21.15.171:6815/285879561","heartbeat_front_addr":"172.21.15.171:6813/285879561","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.674252+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.650568+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.816693+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.811534+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.493109+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.696510+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.521314+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-12T19:39:00.827521+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.15","mappings":[{"from":3,"to":2}]},{"pgid":"3.28","mappings":[{"from":5,"to":2}]},{"pgid":"3.37","mappings":[{"from":7,"to":1}]},{"pgid":"3.3a","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.17","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.131:6837/2898590457":"2024-04-13T20:04:46.991422+0000","172.21.15.131:6835/2898590457":"2024-04-13T20:04:46.991422+0000","172.21.15.171:6835/373698102":"2024-04-13T20:04:21.983874+0000","172.21.15.171:6833/373698102":"2024-04-13T20:04:21.983874+0000","172.21.15.171:6834/1013642393":"2024-04-13T20:03:56.972117+0000","172.21.15.171:6832/1013642393":"2024-04-13T20:03:56.972117+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-12T20:08:54.747 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.748+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3806671012 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa69c06c8f0 msgr2=0x7fa69c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.748+0000 7fa6c1c00640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa69c06c8f0 0x7fa69c06edb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8000f60 tx=0x7fa6a8007b50 comp rx=0 tx=0).stop 2024-04-12T20:08:54.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.748+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3806671012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6bc14e870 msgr2=0x7fa6bc0bf190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.748+0000 7fa6c1c00640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6bc14e870 0x7fa6bc0bf190 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa6b4007e90 tx=0x7fa6b400e4b0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.748+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3806671012 shutdown_connections 2024-04-12T20:08:54.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.748+0000 7fa6c1c00640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7fa69c06c8f0 0x7fa69c06edb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.748+0000 7fa6c1c00640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7fa6bc06df60 0x7fa6bc0bec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.748+0000 7fa6c1c00640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6bc14e870 0x7fa6bc0bf190 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.748 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.748+0000 7fa6c1c00640 1 --2- 172.21.15.131:0/3806671012 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa6bc06cdd0 0x7fa6bc1e9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.748+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3806671012 >> 172.21.15.131:0/3806671012 conn(0x7fa6bc0c6750 msgr2=0x7fa6bc0c5d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:54.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.748+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3806671012 shutdown_connections 2024-04-12T20:08:54.749 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.748+0000 7fa6c1c00640 1 -- 172.21.15.131:0/3806671012 wait complete. 2024-04-12T20:08:54.767 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-12T19:39:04.855067+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-12T19:39:09.370965+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-12T19:39:09.858079+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-12T19:39:13.479306+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '48', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 505, 'snap_epoch': 48, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-12T20:08:54.768 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-12T20:08:54.862 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.863+0000 7f723ec00640 1 Processor -- start 2024-04-12T20:08:54.863 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.863+0000 7f723ec00640 1 -- start start 2024-04-12T20:08:54.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.864+0000 7f723ec00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723814faf0 0x7f72380bf3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.864+0000 7f723ec00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72380c0020 con 0x7f7238149240 2024-04-12T20:08:54.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.864+0000 7f723ec00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7238152970 con 0x7f72380ba190 2024-04-12T20:08:54.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.864+0000 7f723ec00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7238152c50 con 0x7f723814faf0 2024-04-12T20:08:54.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.864+0000 7f7237e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f7238149240 0x7f723814f3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46962/0 (socket says 172.21.15.131:46962) 2024-04-12T20:08:54.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.864+0000 7f7237e00640 1 -- 172.21.15.131:0/957819617 learned_addr learned my addr 172.21.15.131:0/957819617 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T20:08:54.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f722f400640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723814faf0 0x7f72380bf3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.865 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277322754 0 0) 0x7f72380c0020 con 0x7f7238149240 2024-04-12T20:08:54.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f721c003520 con 0x7f7238149240 2024-04-12T20:08:54.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2783614717 0 0) 0x7f721c003520 con 0x7f7238149240 2024-04-12T20:08:54.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723814faf0 msgr2=0x7f72380bf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:54.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723814faf0 0x7f72380bf3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 >> v1:172.21.15.171:6789/0 conn(0x7f72380ba190 legacy=0x7f72380bf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7238152f30 con 0x7f7238149240 2024-04-12T20:08:54.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f72280019f0 con 0x7f7238149240 2024-04-12T20:08:54.866 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 >> v1:172.21.15.131:6789/0 conn(0x7f7238149240 legacy=0x7f723814f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0039e0 0x7f721c003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f721c004800 0x7f721c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723814faf0 0x7f721c005290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7238152c50 con 0x7f721c0039e0 2024-04-12T20:08:54.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f721c00bb80 con 0x7f721c004800 2024-04-12T20:08:54.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.865+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f721c00bd80 con 0x7f723814faf0 2024-04-12T20:08:54.867 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.866+0000 7f7237e00640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0039e0 0x7f721c003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.866+0000 7f722f400640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f721c004800 0x7f721c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.869 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.866+0000 7f7237e00640 1 -- 172.21.15.131:0/957819617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723814faf0 msgr2=0x7f721c005290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:54.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.866+0000 7f723cc00640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723814faf0 0x7f721c005290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.866+0000 7f7237e00640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723814faf0 0x7f721c005290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.866+0000 7f7237e00640 1 -- 172.21.15.131:0/957819617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f721c004800 msgr2=0x7f721c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:54.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.866+0000 7f7237e00640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f721c004800 0x7f721c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.866+0000 7f7237e00640 1 -- 172.21.15.131:0/957819617 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f721c003520 con 0x7f721c0039e0 2024-04-12T20:08:54.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.866+0000 7f723cc00640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723814faf0 0x7f721c005290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:54.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.867+0000 7f7237e00640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0039e0 0x7f721c003e00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f722800a860 tx=0x7f721c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3de6dbf4074a3353 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:54.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.867+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722800a480 con 0x7f721c0039e0 2024-04-12T20:08:54.870 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.867+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7228034630 con 0x7f721c0039e0 2024-04-12T20:08:54.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.867+0000 7f7237400640 1 -- 172.21.15.131:0/957819617 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228034a40 con 0x7f721c0039e0 2024-04-12T20:08:54.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.868+0000 7f723ec00640 1 -- 172.21.15.131:0/957819617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0039e0 msgr2=0x7f721c003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.868+0000 7f723ec00640 1 --2- 172.21.15.131:0/957819617 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0039e0 0x7f721c003e00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f722800a860 tx=0x7f721c005830 comp rx=0 tx=0).stop 2024-04-12T20:08:54.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.868+0000 7f723cc00640 1 -- 172.21.15.131:0/957819617 reap_dead start 2024-04-12T20:08:54.871 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.868+0000 7f723ec00640 1 -- 172.21.15.131:0/957819617 shutdown_connections 2024-04-12T20:08:54.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.868+0000 7f723ec00640 1 -- 172.21.15.131:0/957819617 >> 172.21.15.131:0/957819617 conn(0x7f723806b9e0 msgr2=0x7f723806bdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:54.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.868+0000 7f723ec00640 1 -- 172.21.15.131:0/957819617 shutdown_connections 2024-04-12T20:08:54.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.868+0000 7f723ec00640 1 -- 172.21.15.131:0/957819617 wait complete. 2024-04-12T20:08:54.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.870+0000 7f723ec00640 1 Processor -- start 2024-04-12T20:08:54.872 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.870+0000 7f723ec00640 1 -- start start 2024-04-12T20:08:54.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f723ec00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0039e0 0x7f72380c2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f723ec00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f723806d390 0x7f723813ec00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f723ec00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723813f140 0x7f723806e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f723ec00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f7238152500 con 0x7f721c0039e0 2024-04-12T20:08:54.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f723ec00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f7238149620 con 0x7f723806d390 2024-04-12T20:08:54.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f723ec00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f7238152680 con 0x7f723813f140 2024-04-12T20:08:54.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f7237e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0039e0 0x7f72380c2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.875 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f7237e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0039e0 0x7f72380c2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40036/0 (socket says 172.21.15.131:40036) 2024-04-12T20:08:54.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f7237e00640 1 -- 172.21.15.131:0/1566661950 learned_addr learned my addr 172.21.15.131:0/1566661950 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:54.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f722f400640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f723806d390 0x7f723813ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f7237e00640 1 -- 172.21.15.131:0/1566661950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723813f140 msgr2=0x7f723806e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f7237e00640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723813f140 0x7f723806e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f7237e00640 1 -- 172.21.15.131:0/1566661950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f723806d390 msgr2=0x7f723813ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f7237e00640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f723806d390 0x7f723813ec00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.871+0000 7f7237e00640 1 -- 172.21.15.131:0/1566661950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72380c34f0 con 0x7f721c0039e0 2024-04-12T20:08:54.876 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.872+0000 7f7237e00640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0039e0 0x7f72380c2fb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7228001cf0 tx=0x7f72380bb8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:54.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.872+0000 7f7234c00640 1 -- 172.21.15.131:0/1566661950 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f722800a480 con 0x7f721c0039e0 2024-04-12T20:08:54.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.872+0000 7f7234c00640 1 -- 172.21.15.131:0/1566661950 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7228044070 con 0x7f721c0039e0 2024-04-12T20:08:54.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.872+0000 7f7234c00640 1 -- 172.21.15.131:0/1566661950 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7228034c10 con 0x7f721c0039e0 2024-04-12T20:08:54.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.872+0000 7f723ec00640 1 -- 172.21.15.131:0/1566661950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7238144590 con 0x7f721c0039e0 2024-04-12T20:08:54.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.872+0000 7f723ec00640 1 -- 172.21.15.131:0/1566661950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7238144a10 con 0x7f721c0039e0 2024-04-12T20:08:54.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.874+0000 7f723ec00640 1 -- 172.21.15.131:0/1566661950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7238151e40 con 0x7f721c0039e0 2024-04-12T20:08:54.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.874+0000 7f7234c00640 1 -- 172.21.15.131:0/1566661950 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f7228049460 con 0x7f721c0039e0 2024-04-12T20:08:54.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.875+0000 7f7234c00640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f721406c8f0 0x7f721406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.877 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.875+0000 7f7234c00640 1 -- 172.21.15.131:0/1566661950 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f72280ae690 con 0x7f721c0039e0 2024-04-12T20:08:54.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.876+0000 7f722f400640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f721406c8f0 0x7f721406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.878 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.876+0000 7f722f400640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f721406c8f0 0x7f721406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f72381eb320 tx=0x7f7220008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:54.879 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.880+0000 7f7234c00640 1 -- 172.21.15.131:0/1566661950 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f722807c5a0 con 0x7f721c0039e0 2024-04-12T20:08:54.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.961+0000 7f32af200640 1 Processor -- start 2024-04-12T20:08:54.961 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.961+0000 7f32af200640 1 -- start start 2024-04-12T20:08:54.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.962+0000 7f32af200640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f32a806cb10 0x7f32a8151970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.962+0000 7f32af200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32a8151eb0 0x7f32a815bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.962+0000 7f32af200640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32a80c1960 con 0x7f32a80c5ed0 2024-04-12T20:08:54.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.962+0000 7f32af200640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f32a80a6110 con 0x7f32a806cb10 2024-04-12T20:08:54.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.962+0000 7f32af200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f32a80c15d0 con 0x7f32a8151eb0 2024-04-12T20:08:54.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.962+0000 7f329f400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f32a806cb10 0x7f32a8151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.962+0000 7f329f400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f32a806cb10 0x7f32a8151970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40048/0 (socket says 172.21.15.131:40048) 2024-04-12T20:08:54.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.962+0000 7f329f400640 1 -- 172.21.15.131:0/4282782394 learned_addr learned my addr 172.21.15.131:0/4282782394 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:54.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.963+0000 7f32ad200640 1 --2- 172.21.15.131:0/4282782394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32a8151eb0 0x7f32a815bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.963+0000 7f329f400640 1 -- 172.21.15.131:0/4282782394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32a8151eb0 msgr2=0x7f32a815bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:54.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.963+0000 7f329f400640 1 --2- 172.21.15.131:0/4282782394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32a8151eb0 0x7f32a815bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.963+0000 7f329f400640 1 -- 172.21.15.131:0/4282782394 >> v1:172.21.15.171:6789/0 conn(0x7f32a80c5ed0 legacy=0x7f32a8151260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:54.964 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.963+0000 7f329f400640 1 -- 172.21.15.131:0/4282782394 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a80c2cb0 con 0x7f32a806cb10 2024-04-12T20:08:54.965 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.964+0000 7f329f400640 1 --2- 172.21.15.131:0/4282782394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32a806cb10 0x7f32a8151970 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f32a80c18b0 tx=0x7f329002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f31c45f5c06290 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:54.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.964+0000 7f32a7400640 1 -- 172.21.15.131:0/4282782394 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290035020 con 0x7f32a806cb10 2024-04-12T20:08:54.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.964+0000 7f32a7400640 1 -- 172.21.15.131:0/4282782394 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3290031830 con 0x7f32a806cb10 2024-04-12T20:08:54.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.964+0000 7f32a7400640 1 -- 172.21.15.131:0/4282782394 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3290031c00 con 0x7f32a806cb10 2024-04-12T20:08:54.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.965+0000 7f32af200640 1 -- 172.21.15.131:0/4282782394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32a806cb10 msgr2=0x7f32a8151970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.965+0000 7f32af200640 1 --2- 172.21.15.131:0/4282782394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32a806cb10 0x7f32a8151970 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f32a80c18b0 tx=0x7f329002b8d0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.965+0000 7f32af200640 1 -- 172.21.15.131:0/4282782394 shutdown_connections 2024-04-12T20:08:54.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.965+0000 7f32af200640 1 --2- 172.21.15.131:0/4282782394 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32a8151eb0 0x7f32a815bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.966 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.965+0000 7f32af200640 1 --2- 172.21.15.131:0/4282782394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32a806cb10 0x7f32a8151970 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.965+0000 7f32af200640 1 -- 172.21.15.131:0/4282782394 >> 172.21.15.131:0/4282782394 conn(0x7f32a80c6900 msgr2=0x7f32a80c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:54.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.965+0000 7f32af200640 1 -- 172.21.15.131:0/4282782394 shutdown_connections 2024-04-12T20:08:54.967 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.965+0000 7f32af200640 1 -- 172.21.15.131:0/4282782394 wait complete. 2024-04-12T20:08:54.968 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.967+0000 7f32af200640 1 Processor -- start 2024-04-12T20:08:54.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.967+0000 7f32af200640 1 -- start start 2024-04-12T20:08:54.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.967+0000 7f32af200640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32a806cb10 0x7f32a81e85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f32af200640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32a80c5ed0 0x7f32a80a7390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f32af200640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32a8151eb0 0x7f32a814f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f32af200640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f32a80c62b0 con 0x7f32a80c5ed0 2024-04-12T20:08:54.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f32af200640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f32a806c520 con 0x7f32a8151eb0 2024-04-12T20:08:54.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f32af200640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f32a80c1280 con 0x7f32a806cb10 2024-04-12T20:08:54.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f329f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32a80c5ed0 0x7f32a80a7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.969 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f329f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32a80c5ed0 0x7f32a80a7390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40056/0 (socket says 172.21.15.131:40056) 2024-04-12T20:08:54.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f329f400640 1 -- 172.21.15.131:0/4218904846 learned_addr learned my addr 172.21.15.131:0/4218904846 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:54.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f329f400640 1 -- 172.21.15.131:0/4218904846 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32a806cb10 msgr2=0x7f32a81e85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f329f400640 1 --2- 172.21.15.131:0/4218904846 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32a806cb10 0x7f32a81e85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f329f400640 1 -- 172.21.15.131:0/4218904846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32a8151eb0 msgr2=0x7f32a814f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:54.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f329f400640 1 --2- 172.21.15.131:0/4218904846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32a8151eb0 0x7f32a814f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:54.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f329f400640 1 -- 172.21.15.131:0/4218904846 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a80a78d0 con 0x7f32a80c5ed0 2024-04-12T20:08:54.970 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.968+0000 7f329f400640 1 --2- 172.21.15.131:0/4218904846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32a80c5ed0 0x7f32a80a7390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3290000c00 tx=0x7f32900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:54.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.969+0000 7f32a4c00640 1 -- 172.21.15.131:0/4218904846 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329003a9b0 con 0x7f32a80c5ed0 2024-04-12T20:08:54.971 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.969+0000 7f32a4c00640 1 -- 172.21.15.131:0/4218904846 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f329003ab50 con 0x7f32a80c5ed0 2024-04-12T20:08:54.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.969+0000 7f32a4c00640 1 -- 172.21.15.131:0/4218904846 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32900443f0 con 0x7f32a80c5ed0 2024-04-12T20:08:54.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.969+0000 7f32af200640 1 -- 172.21.15.131:0/4218904846 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a81d8610 con 0x7f32a80c5ed0 2024-04-12T20:08:54.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.969+0000 7f32af200640 1 -- 172.21.15.131:0/4218904846 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a81eab30 con 0x7f32a80c5ed0 2024-04-12T20:08:54.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.970+0000 7f32af200640 1 -- 172.21.15.131:0/4218904846 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a804fd50 con 0x7f32a80c5ed0 2024-04-12T20:08:54.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.971+0000 7f32a4c00640 1 -- 172.21.15.131:0/4218904846 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f329004b060 con 0x7f32a80c5ed0 2024-04-12T20:08:54.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.972+0000 7f32a4c00640 1 --2- 172.21.15.131:0/4218904846 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f328406c8f0 0x7f328406edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:54.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.972+0000 7f32a4c00640 1 -- 172.21.15.131:0/4218904846 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f32900adb60 con 0x7f32a80c5ed0 2024-04-12T20:08:54.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.972+0000 7f32a7e00640 1 --2- 172.21.15.131:0/4218904846 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f328406c8f0 0x7f328406edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:54.973 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.973+0000 7f32a7e00640 1 --2- 172.21.15.131:0/4218904846 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f328406c8f0 0x7f328406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3298006fd0 tx=0x7f3298006bc0 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:54.976 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:54.976+0000 7f32a4c00640 1 -- 172.21.15.131:0/4218904846 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f329003f070 con 0x7f32a80c5ed0 2024-04-12T20:08:55.080 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.080+0000 7f723ec00640 1 -- 172.21.15.131:0/1566661950 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f723804fd50 con 0x7f721c0039e0 2024-04-12T20:08:55.081 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.081+0000 7f7234c00640 1 -- 172.21.15.131:0/1566661950 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v53) ==== 103+0+11 (secure 0 0 0) 0x7f722807bea0 con 0x7f721c0039e0 2024-04-12T20:08:55.081 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T20:08:55.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.084+0000 7f723ec00640 1 -- 172.21.15.131:0/1566661950 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f721406c8f0 msgr2=0x7f721406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.084+0000 7f723ec00640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f721406c8f0 0x7f721406edb0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f72381eb320 tx=0x7f7220008040 comp rx=0 tx=0).stop 2024-04-12T20:08:55.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.084+0000 7f723ec00640 1 -- 172.21.15.131:0/1566661950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0039e0 msgr2=0x7f72380c2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.084+0000 7f723ec00640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0039e0 0x7f72380c2fb0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f7228001cf0 tx=0x7f72380bb8c0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.084+0000 7f723ec00640 1 -- 172.21.15.131:0/1566661950 shutdown_connections 2024-04-12T20:08:55.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.084+0000 7f723ec00640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f721406c8f0 0x7f721406edb0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.084+0000 7f723ec00640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f723806d390 0x7f723813ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.085 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.084+0000 7f723ec00640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f723813f140 0x7f723806e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.084+0000 7f723ec00640 1 --2- 172.21.15.131:0/1566661950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f721c0039e0 0x7f72380c2fb0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.084+0000 7f723ec00640 1 -- 172.21.15.131:0/1566661950 >> 172.21.15.131:0/1566661950 conn(0x7f723806b9e0 msgr2=0x7f7238070dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:55.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.084+0000 7f723ec00640 1 -- 172.21.15.131:0/1566661950 shutdown_connections 2024-04-12T20:08:55.086 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.084+0000 7f723ec00640 1 -- 172.21.15.131:0/1566661950 wait complete. 2024-04-12T20:08:55.102 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-12T20:08:55.173 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.173+0000 7f32af200640 1 -- 172.21.15.131:0/4218904846 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f32a80ac330 con 0x7f32a80c5ed0 2024-04-12T20:08:55.174 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.174+0000 7f32a4c00640 1 -- 172.21.15.131:0/4218904846 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) ==== 93+0+10 (secure 0 0 0) 0x7f329002f2e0 con 0x7f32a80c5ed0 2024-04-12T20:08:55.174 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 1 2024-04-12T20:08:55.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.176+0000 7f32af200640 1 -- 172.21.15.131:0/4218904846 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f328406c8f0 msgr2=0x7f328406edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.176+0000 7f32af200640 1 --2- 172.21.15.131:0/4218904846 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f328406c8f0 0x7f328406edb0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f3298006fd0 tx=0x7f3298006bc0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.176+0000 7f32af200640 1 -- 172.21.15.131:0/4218904846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32a80c5ed0 msgr2=0x7f32a80a7390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.176+0000 7f32af200640 1 --2- 172.21.15.131:0/4218904846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32a80c5ed0 0x7f32a80a7390 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f3290000c00 tx=0x7f32900046c0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.176+0000 7f32af200640 1 -- 172.21.15.131:0/4218904846 shutdown_connections 2024-04-12T20:08:55.177 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.176+0000 7f32af200640 1 --2- 172.21.15.131:0/4218904846 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f328406c8f0 0x7f328406edb0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.176+0000 7f32af200640 1 --2- 172.21.15.131:0/4218904846 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f32a8151eb0 0x7f32a814f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.176+0000 7f32af200640 1 --2- 172.21.15.131:0/4218904846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f32a80c5ed0 0x7f32a80a7390 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.176+0000 7f32af200640 1 --2- 172.21.15.131:0/4218904846 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f32a806cb10 0x7f32a81e85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.176+0000 7f32af200640 1 -- 172.21.15.131:0/4218904846 >> 172.21.15.131:0/4218904846 conn(0x7f32a80c6900 msgr2=0x7f32a80ab530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:55.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.177+0000 7f32af200640 1 -- 172.21.15.131:0/4218904846 shutdown_connections 2024-04-12T20:08:55.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.177+0000 7f32af200640 1 -- 172.21.15.131:0/4218904846 wait complete. 2024-04-12T20:08:55.193 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-12T20:08:55.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.293+0000 7f7256000640 1 Processor -- start 2024-04-12T20:08:55.293 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.293+0000 7f7256000640 1 -- start start 2024-04-12T20:08:55.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.294+0000 7f7256000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72500c17a0 0x7f72500c28c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.294+0000 7f7256000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f72501511e0 0x7f72500c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.295 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.294+0000 7f7256000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7250151670 0x7f72500c3730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.294+0000 7f7256000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f72500c59f0 con 0x7f72500c17a0 2024-04-12T20:08:55.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.294+0000 7f7256000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f72500c3c70 con 0x7f72501511e0 2024-04-12T20:08:55.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.294+0000 7f7256000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f72500c5e80 con 0x7f7250151670 2024-04-12T20:08:55.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.294+0000 7f724f400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72500c17a0 0x7f72500c28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.295+0000 7f724f400640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f72500c17a0 0x7f72500c28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40058/0 (socket says 172.21.15.131:40058) 2024-04-12T20:08:55.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.295+0000 7f724f400640 1 -- 172.21.15.131:0/37021375 learned_addr learned my addr 172.21.15.131:0/37021375 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:55.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.295+0000 7f724fe00640 1 --2- 172.21.15.131:0/37021375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7250151670 0x7f72500c3730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.296 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.295+0000 7f7247e00640 1 --2- 172.21.15.131:0/37021375 >> v2:172.21.15.171:3300/0 conn(0x7f72501511e0 0x7f72500c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.295+0000 7f724f400640 1 -- 172.21.15.131:0/37021375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7250151670 msgr2=0x7f72500c3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:55.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.295+0000 7f724f400640 1 --2- 172.21.15.131:0/37021375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7250151670 0x7f72500c3730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.295+0000 7f724f400640 1 -- 172.21.15.131:0/37021375 >> v2:172.21.15.171:3300/0 conn(0x7f72501511e0 msgr2=0x7f72500c31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:55.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.295+0000 7f724f400640 1 --2- 172.21.15.131:0/37021375 >> v2:172.21.15.171:3300/0 conn(0x7f72501511e0 0x7f72500c31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.297 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.295+0000 7f724f400640 1 -- 172.21.15.131:0/37021375 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72500c4020 con 0x7f72500c17a0 2024-04-12T20:08:55.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.296+0000 7f724f400640 1 --2- 172.21.15.131:0/37021375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72500c17a0 0x7f72500c28c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7250152310 tx=0x7f724002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965b7394c2970dd8 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:55.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.296+0000 7f724ea00640 1 -- 172.21.15.131:0/37021375 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240035020 con 0x7f72500c17a0 2024-04-12T20:08:55.298 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.296+0000 7f724ea00640 1 -- 172.21.15.131:0/37021375 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7240031870 con 0x7f72500c17a0 2024-04-12T20:08:55.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.296+0000 7f724ea00640 1 -- 172.21.15.131:0/37021375 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7240031c40 con 0x7f72500c17a0 2024-04-12T20:08:55.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.297+0000 7f7256000640 1 -- 172.21.15.131:0/37021375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72500c17a0 msgr2=0x7f72500c28c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.297+0000 7f7256000640 1 --2- 172.21.15.131:0/37021375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72500c17a0 0x7f72500c28c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7250152310 tx=0x7f724002b910 comp rx=0 tx=0).stop 2024-04-12T20:08:55.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.297+0000 7f7256000640 1 -- 172.21.15.131:0/37021375 shutdown_connections 2024-04-12T20:08:55.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.297+0000 7f7256000640 1 --2- 172.21.15.131:0/37021375 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7250151670 0x7f72500c3730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.297+0000 7f7256000640 1 --2- 172.21.15.131:0/37021375 >> v2:172.21.15.171:3300/0 conn(0x7f72501511e0 0x7f72500c31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.297+0000 7f7256000640 1 --2- 172.21.15.131:0/37021375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72500c17a0 0x7f72500c28c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.299 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.297+0000 7f7256000640 1 -- 172.21.15.131:0/37021375 >> 172.21.15.131:0/37021375 conn(0x7f72500a8490 msgr2=0x7f72500a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:55.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.297+0000 7f7256000640 1 -- 172.21.15.131:0/37021375 shutdown_connections 2024-04-12T20:08:55.300 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.297+0000 7f7256000640 1 -- 172.21.15.131:0/37021375 wait complete. 2024-04-12T20:08:55.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.299+0000 7f7256000640 1 Processor -- start 2024-04-12T20:08:55.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.299+0000 7f7256000640 1 -- start start 2024-04-12T20:08:55.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.300+0000 7f7256000640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72500c17a0 0x7f725014f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.300+0000 7f7256000640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72501511e0 0x7f72501e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.302 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.300+0000 7f7256000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7250151670 0x7f7250149840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.300+0000 7f7256000640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f72500c4760 con 0x7f72501511e0 2024-04-12T20:08:55.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.300+0000 7f7256000640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f72500c6540 con 0x7f72500c17a0 2024-04-12T20:08:55.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.300+0000 7f7256000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f72500c48e0 con 0x7f7250151670 2024-04-12T20:08:55.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.300+0000 7f7247e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72501511e0 0x7f72501e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.300+0000 7f7247e00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72501511e0 0x7f72501e6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40074/0 (socket says 172.21.15.131:40074) 2024-04-12T20:08:55.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.300+0000 7f7247e00640 1 -- 172.21.15.131:0/3020443575 learned_addr learned my addr 172.21.15.131:0/3020443575 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:55.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.300+0000 7f724f400640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72500c17a0 0x7f725014f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.303 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.300+0000 7f724fe00640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7250151670 0x7f7250149840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.301+0000 7f7247e00640 1 -- 172.21.15.131:0/3020443575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7250151670 msgr2=0x7f7250149840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.301+0000 7f7247e00640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7250151670 0x7f7250149840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.301+0000 7f7247e00640 1 -- 172.21.15.131:0/3020443575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72500c17a0 msgr2=0x7f725014f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.301+0000 7f7247e00640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72500c17a0 0x7f725014f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.301+0000 7f7247e00640 1 -- 172.21.15.131:0/3020443575 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f725014fa70 con 0x7f72501511e0 2024-04-12T20:08:55.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.301+0000 7f724f400640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72500c17a0 0x7f725014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:55.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.301+0000 7f7247e00640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72501511e0 0x7f72501e6c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f723800d800 tx=0x7f723800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:55.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.301+0000 7f7247400640 1 -- 172.21.15.131:0/3020443575 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238018020 con 0x7f72501511e0 2024-04-12T20:08:55.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.301+0000 7f7247400640 1 -- 172.21.15.131:0/3020443575 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7238009640 con 0x7f72501511e0 2024-04-12T20:08:55.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.301+0000 7f7247400640 1 -- 172.21.15.131:0/3020443575 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7238009a10 con 0x7f72501511e0 2024-04-12T20:08:55.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.301+0000 7f7256000640 1 -- 172.21.15.131:0/3020443575 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f725014c740 con 0x7f72501511e0 2024-04-12T20:08:55.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.301+0000 7f7256000640 1 -- 172.21.15.131:0/3020443575 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72501ea600 con 0x7f72501511e0 2024-04-12T20:08:55.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.303+0000 7f7256000640 1 -- 172.21.15.131:0/3020443575 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f725004fd50 con 0x7f72501511e0 2024-04-12T20:08:55.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.303+0000 7f7247400640 1 -- 172.21.15.131:0/3020443575 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f723801b020 con 0x7f72501511e0 2024-04-12T20:08:55.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.305+0000 7f7247400640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f722c06c8f0 0x7f722c06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.305+0000 7f7247400640 1 -- 172.21.15.131:0/3020443575 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f723808c280 con 0x7f72501511e0 2024-04-12T20:08:55.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.305+0000 7f724f400640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f722c06c8f0 0x7f722c06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.306+0000 7f724f400640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f722c06c8f0 0x7f722c06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7240036000 tx=0x7f7240008030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:55.309 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.309+0000 7f7247400640 1 -- 172.21.15.131:0/3020443575 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f7238022030 con 0x7f72501511e0 2024-04-12T20:08:55.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.379+0000 7f5316600640 1 Processor -- start 2024-04-12T20:08:55.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.379+0000 7f5316600640 1 -- start start 2024-04-12T20:08:55.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.380+0000 7f5316600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f53100c28c0 0x7f53100c31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.380+0000 7f5316600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c3730 0x7f531015ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.380+0000 7f5316600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53100c2d50 con 0x7f53100c17a0 2024-04-12T20:08:55.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.380+0000 7f5316600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f53100c59f0 con 0x7f53100c28c0 2024-04-12T20:08:55.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.380+0000 7f5316600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f53100c5e80 con 0x7f53100c3730 2024-04-12T20:08:55.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.380+0000 7f530ea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f53100c28c0 0x7f53100c31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.381+0000 7f530ea00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f53100c28c0 0x7f53100c31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40086/0 (socket says 172.21.15.131:40086) 2024-04-12T20:08:55.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.381+0000 7f530ea00640 1 -- 172.21.15.131:0/2369901302 learned_addr learned my addr 172.21.15.131:0/2369901302 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:55.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.381+0000 7f530fe00640 1 --2- 172.21.15.131:0/2369901302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c3730 0x7f531015ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.381+0000 7f530ea00640 1 -- 172.21.15.131:0/2369901302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c3730 msgr2=0x7f531015ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:55.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.381+0000 7f530ea00640 1 --2- 172.21.15.131:0/2369901302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c3730 0x7f531015ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.381+0000 7f530ea00640 1 -- 172.21.15.131:0/2369901302 >> v1:172.21.15.171:6789/0 conn(0x7f53100c17a0 legacy=0x7f53101511e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.381+0000 7f530ea00640 1 -- 172.21.15.131:0/2369901302 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53100c4020 con 0x7f53100c28c0 2024-04-12T20:08:55.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.382+0000 7f530ea00640 1 --2- 172.21.15.131:0/2369901302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53100c28c0 0x7f53100c31f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009870 tx=0x7f52f802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673abd36e5cf8908 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:55.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.382+0000 7f530e000640 1 -- 172.21.15.131:0/2369901302 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f8034070 con 0x7f53100c28c0 2024-04-12T20:08:55.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.383+0000 7f530e000640 1 -- 172.21.15.131:0/2369901302 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f52f8030840 con 0x7f53100c28c0 2024-04-12T20:08:55.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.383+0000 7f530e000640 1 -- 172.21.15.131:0/2369901302 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f8030c10 con 0x7f53100c28c0 2024-04-12T20:08:55.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.383+0000 7f5316600640 1 -- 172.21.15.131:0/2369901302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53100c28c0 msgr2=0x7f53100c31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.383+0000 7f5316600640 1 --2- 172.21.15.131:0/2369901302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53100c28c0 0x7f53100c31f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009870 tx=0x7f52f802b980 comp rx=0 tx=0).stop 2024-04-12T20:08:55.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.383+0000 7f5316600640 1 -- 172.21.15.131:0/2369901302 shutdown_connections 2024-04-12T20:08:55.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.383+0000 7f5316600640 1 --2- 172.21.15.131:0/2369901302 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c3730 0x7f531015ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.383+0000 7f5316600640 1 --2- 172.21.15.131:0/2369901302 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53100c28c0 0x7f53100c31f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.383+0000 7f5316600640 1 -- 172.21.15.131:0/2369901302 >> 172.21.15.131:0/2369901302 conn(0x7f53100a8490 msgr2=0x7f53100a88a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:55.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.383+0000 7f5316600640 1 -- 172.21.15.131:0/2369901302 shutdown_connections 2024-04-12T20:08:55.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.383+0000 7f5316600640 1 -- 172.21.15.131:0/2369901302 wait complete. 2024-04-12T20:08:55.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.386+0000 7f5316600640 1 Processor -- start 2024-04-12T20:08:55.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.386+0000 7f5316600640 1 -- start start 2024-04-12T20:08:55.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.387+0000 7f5316600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53100c17a0 0x7f53101e92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.387+0000 7f5316600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c28c0 0x7f53101e97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.388+0000 7f5316600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53100c3730 0x7f53101dbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.388+0000 7f5316600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f53100c3ba0 con 0x7f53100c17a0 2024-04-12T20:08:55.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.388+0000 7f5316600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f53100c6540 con 0x7f53100c3730 2024-04-12T20:08:55.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.388+0000 7f5316600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f53101518f0 con 0x7f53100c28c0 2024-04-12T20:08:55.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.388+0000 7f530f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53100c17a0 0x7f53101e92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.388+0000 7f530f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53100c17a0 0x7f53101e92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40092/0 (socket says 172.21.15.131:40092) 2024-04-12T20:08:55.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.388+0000 7f530f400640 1 -- 172.21.15.131:0/766497256 learned_addr learned my addr 172.21.15.131:0/766497256 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:55.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.388+0000 7f530ea00640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c28c0 0x7f53101e97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.388+0000 7f530f400640 1 -- 172.21.15.131:0/766497256 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c28c0 msgr2=0x7f53101e97e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.388+0000 7f530f400640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c28c0 0x7f53101e97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.389+0000 7f530f400640 1 -- 172.21.15.131:0/766497256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53100c3730 msgr2=0x7f53101dbfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.389+0000 7f530f400640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53100c3730 0x7f53101dbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.389+0000 7f530f400640 1 -- 172.21.15.131:0/766497256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53101e8200 con 0x7f53100c17a0 2024-04-12T20:08:55.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.389+0000 7f530f400640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53100c17a0 0x7f53101e92a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f530000c400 tx=0x7f530000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:55.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.389+0000 7f5307400640 1 -- 172.21.15.131:0/766497256 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53000052d0 con 0x7f53100c17a0 2024-04-12T20:08:55.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.389+0000 7f5307400640 1 -- 172.21.15.131:0/766497256 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5300005490 con 0x7f53100c17a0 2024-04-12T20:08:55.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.389+0000 7f5307400640 1 -- 172.21.15.131:0/766497256 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300007260 con 0x7f53100c17a0 2024-04-12T20:08:55.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.389+0000 7f5316600640 1 -- 172.21.15.131:0/766497256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53101e84e0 con 0x7f53100c17a0 2024-04-12T20:08:55.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.389+0000 7f5316600640 1 -- 172.21.15.131:0/766497256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53101e8aa0 con 0x7f53100c17a0 2024-04-12T20:08:55.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.390+0000 7f5316600640 1 -- 172.21.15.131:0/766497256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53100a5e60 con 0x7f53100c17a0 2024-04-12T20:08:55.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.391+0000 7f5307400640 1 -- 172.21.15.131:0/766497256 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f5300007400 con 0x7f53100c17a0 2024-04-12T20:08:55.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.393+0000 7f5307400640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f52ec06c8f0 0x7f52ec06edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.393+0000 7f5307400640 1 -- 172.21.15.131:0/766497256 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f530008b690 con 0x7f53100c17a0 2024-04-12T20:08:55.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.393+0000 7f530ea00640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f52ec06c8f0 0x7f52ec06edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.394+0000 7f530ea00640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f52ec06c8f0 0x7f52ec06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f52f8036000 tx=0x7f52f803b040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:55.397 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.397+0000 7f5307400640 1 -- 172.21.15.131:0/766497256 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f53100a5e60 con 0x7f53100c17a0 2024-04-12T20:08:55.528 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.528+0000 7f7256000640 1 -- 172.21.15.131:0/3020443575 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f72500a81f0 con 0x7f72501511e0 2024-04-12T20:08:55.529 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.529+0000 7f7247400640 1 -- 172.21.15.131:0/3020443575 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v53) ==== 80+0+370 (secure 0 0 0) 0x7f723805a190 con 0x7f72501511e0 2024-04-12T20:08:55.530 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131:6837/2898590457 2024-04-13T20:04:46.991422+0000 2024-04-12T20:08:55.530 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131:6835/2898590457 2024-04-13T20:04:46.991422+0000 2024-04-12T20:08:55.530 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6835/373698102 2024-04-13T20:04:21.983874+0000 2024-04-12T20:08:55.530 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6833/373698102 2024-04-13T20:04:21.983874+0000 2024-04-12T20:08:55.530 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6834/1013642393 2024-04-13T20:03:56.972117+0000 2024-04-12T20:08:55.530 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6832/1013642393 2024-04-13T20:03:56.972117+0000 2024-04-12T20:08:55.531 INFO:teuthology.orchestra.run.smithi131.stderr:listed 6 entries 2024-04-12T20:08:55.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.532+0000 7f7256000640 1 -- 172.21.15.131:0/3020443575 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f722c06c8f0 msgr2=0x7f722c06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.532+0000 7f7256000640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f722c06c8f0 0x7f722c06edb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7240036000 tx=0x7f7240008030 comp rx=0 tx=0).stop 2024-04-12T20:08:55.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.532+0000 7f7256000640 1 -- 172.21.15.131:0/3020443575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72501511e0 msgr2=0x7f72501e6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.532+0000 7f7256000640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72501511e0 0x7f72501e6c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f723800d800 tx=0x7f723800dcc0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.532+0000 7f7256000640 1 -- 172.21.15.131:0/3020443575 shutdown_connections 2024-04-12T20:08:55.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.532+0000 7f7256000640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f722c06c8f0 0x7f722c06edb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.532+0000 7f7256000640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f7250151670 0x7f7250149840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.532+0000 7f7256000640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f72501511e0 0x7f72501e6c80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.533 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.532+0000 7f7256000640 1 --2- 172.21.15.131:0/3020443575 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f72500c17a0 0x7f725014f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.532+0000 7f7256000640 1 -- 172.21.15.131:0/3020443575 >> 172.21.15.131:0/3020443575 conn(0x7f72500a8490 msgr2=0x7f72500a7ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:55.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.532+0000 7f7256000640 1 -- 172.21.15.131:0/3020443575 shutdown_connections 2024-04-12T20:08:55.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.532+0000 7f7256000640 1 -- 172.21.15.131:0/3020443575 wait complete. 2024-04-12T20:08:55.552 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi131.front.sepia.ceph.com... 2024-04-12T20:08:55.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T20:08:55.553 DEBUG:teuthology.orchestra.run.smithi131:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-12T20:08:55.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.604+0000 7f5316600640 1 -- 172.21.15.131:0/766497256 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f531004fd50 con 0x7f53100c17a0 2024-04-12T20:08:55.604 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.604+0000 7f5307400640 1 -- 172.21.15.131:0/766497256 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) ==== 104+0+11 (secure 0 0 0) 0x7f53100c2d50 con 0x7f53100c17a0 2024-04-12T20:08:55.605 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T20:08:55.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.607+0000 7f5316600640 1 -- 172.21.15.131:0/766497256 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f52ec06c8f0 msgr2=0x7f52ec06edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.607 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.607+0000 7f5316600640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f52ec06c8f0 0x7f52ec06edb0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f52f8036000 tx=0x7f52f803b040 comp rx=0 tx=0).stop 2024-04-12T20:08:55.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.607+0000 7f5316600640 1 -- 172.21.15.131:0/766497256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53100c17a0 msgr2=0x7f53101e92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.607+0000 7f5316600640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53100c17a0 0x7f53101e92a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f530000c400 tx=0x7f530000c8c0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.607+0000 7f5316600640 1 -- 172.21.15.131:0/766497256 shutdown_connections 2024-04-12T20:08:55.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.607+0000 7f5316600640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f52ec06c8f0 0x7f52ec06edb0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.607+0000 7f5316600640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f53100c3730 0x7f53101dbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.607+0000 7f5316600640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f53100c28c0 0x7f53101e97e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.607+0000 7f5316600640 1 --2- 172.21.15.131:0/766497256 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53100c17a0 0x7f53101e92a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.607+0000 7f5316600640 1 -- 172.21.15.131:0/766497256 >> 172.21.15.131:0/766497256 conn(0x7f53100a8490 msgr2=0x7f53100bee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:55.608 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.607+0000 7f5316600640 1 -- 172.21.15.131:0/766497256 shutdown_connections 2024-04-12T20:08:55.609 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.607+0000 7f5316600640 1 -- 172.21.15.131:0/766497256 wait complete. 2024-04-12T20:08:55.627 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-12T20:08:55.631 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:08:55.631 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T20:08:55.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-12T20:08:55.633 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-12T20:08:55.812 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.812+0000 7f8e37600640 1 Processor -- start 2024-04-12T20:08:55.813 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.812+0000 7f8e37600640 1 -- start start 2024-04-12T20:08:55.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.813+0000 7f8e37600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e300bf720 0x7f8e300a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.813+0000 7f8e37600640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8e300a4f80 0x7f8e3014eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.813+0000 7f8e37600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e300a7ae0 con 0x7f8e30073840 2024-04-12T20:08:55.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.813+0000 7f8e37600640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7f8e300a5c90 con 0x7f8e300a4f80 2024-04-12T20:08:55.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.813+0000 7f8e37600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8e300beed0 con 0x7f8e300bf720 2024-04-12T20:08:55.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.814+0000 7f8e2fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8e300a4f80 0x7f8e3014eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.814+0000 7f8e2fe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7f8e300a4f80 0x7f8e3014eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40104/0 (socket says 172.21.15.131:40104) 2024-04-12T20:08:55.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.814+0000 7f8e2fe00640 1 -- 172.21.15.131:0/3601806668 learned_addr learned my addr 172.21.15.131:0/3601806668 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:55.815 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.814+0000 7f8e34c00640 1 --2- 172.21.15.131:0/3601806668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e300bf720 0x7f8e300a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.814+0000 7f8e2fe00640 1 -- 172.21.15.131:0/3601806668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e300bf720 msgr2=0x7f8e300a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:55.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.814+0000 7f8e2fe00640 1 --2- 172.21.15.131:0/3601806668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e300bf720 0x7f8e300a6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.814+0000 7f8e2fe00640 1 -- 172.21.15.131:0/3601806668 >> v1:172.21.15.131:6789/0 conn(0x7f8e30073840 legacy=0x7f8e301524d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.814+0000 7f8e2fe00640 1 -- 172.21.15.131:0/3601806668 --> v2:172.21.15.131:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e300be2a0 con 0x7f8e300a4f80 2024-04-12T20:08:55.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.815+0000 7f8e2fe00640 1 --2- 172.21.15.131:0/3601806668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e300a4f80 0x7f8e3014eee0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009870 tx=0x7f8e1c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7e1feeb8cc9a081 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:55.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.816+0000 7f8e2f400640 1 -- 172.21.15.131:0/3601806668 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c035020 con 0x7f8e300a4f80 2024-04-12T20:08:55.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.816+0000 7f8e2f400640 1 -- 172.21.15.131:0/3601806668 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c031640 con 0x7f8e300a4f80 2024-04-12T20:08:55.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.816+0000 7f8e2f400640 1 -- 172.21.15.131:0/3601806668 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c02d040 con 0x7f8e300a4f80 2024-04-12T20:08:55.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.816+0000 7f8e37600640 1 -- 172.21.15.131:0/3601806668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e300a4f80 msgr2=0x7f8e3014eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.816+0000 7f8e37600640 1 --2- 172.21.15.131:0/3601806668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e300a4f80 0x7f8e3014eee0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c009870 tx=0x7f8e1c02b8f0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.817+0000 7f8e37600640 1 -- 172.21.15.131:0/3601806668 shutdown_connections 2024-04-12T20:08:55.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.817+0000 7f8e37600640 1 --2- 172.21.15.131:0/3601806668 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e300a4f80 0x7f8e3014eee0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.817+0000 7f8e37600640 1 --2- 172.21.15.131:0/3601806668 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e300bf720 0x7f8e300a6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.817+0000 7f8e37600640 1 -- 172.21.15.131:0/3601806668 >> 172.21.15.131:0/3601806668 conn(0x7f8e3006be00 msgr2=0x7f8e3006c210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:55.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.817+0000 7f8e37600640 1 -- 172.21.15.131:0/3601806668 shutdown_connections 2024-04-12T20:08:55.819 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.817+0000 7f8e37600640 1 -- 172.21.15.131:0/3601806668 wait complete. 2024-04-12T20:08:55.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.818+0000 7f8e37600640 1 Processor -- start 2024-04-12T20:08:55.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.818+0000 7f8e37600640 1 -- start start 2024-04-12T20:08:55.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.819+0000 7f8e37600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e30073840 0x7f8e30151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.821 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.819+0000 7f8e37600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e300a4f80 0x7f8e300ba350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.819+0000 7f8e37600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e300bf720 0x7f8e300ba890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.819+0000 7f8e37600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f8e300bfb00 con 0x7f8e300a4f80 2024-04-12T20:08:55.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.819+0000 7f8e37600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f8e300beba0 con 0x7f8e30073840 2024-04-12T20:08:55.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.819+0000 7f8e37600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f8e300bfc80 con 0x7f8e300bf720 2024-04-12T20:08:55.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.819+0000 7f8e2fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e300a4f80 0x7f8e300ba350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.820+0000 7f8e2fe00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e300a4f80 0x7f8e300ba350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40120/0 (socket says 172.21.15.131:40120) 2024-04-12T20:08:55.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.820+0000 7f8e2fe00640 1 -- 172.21.15.131:0/3321514107 learned_addr learned my addr 172.21.15.131:0/3321514107 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:55.822 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.820+0000 7f8e34c00640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e30073840 0x7f8e30151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.820+0000 7f8e35600640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e300bf720 0x7f8e300ba890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.820+0000 7f8e2fe00640 1 -- 172.21.15.131:0/3321514107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e300bf720 msgr2=0x7f8e300ba890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.820+0000 7f8e2fe00640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e300bf720 0x7f8e300ba890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.820+0000 7f8e2fe00640 1 -- 172.21.15.131:0/3321514107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e30073840 msgr2=0x7f8e30151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:55.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.820+0000 7f8e2fe00640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e30073840 0x7f8e30151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:55.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.820+0000 7f8e2fe00640 1 -- 172.21.15.131:0/3321514107 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e30152100 con 0x7f8e300a4f80 2024-04-12T20:08:55.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.820+0000 7f8e2fe00640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e300a4f80 0x7f8e300ba350 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c02b930 tx=0x7f8e1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:55.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.821+0000 7f8e2cc00640 1 -- 172.21.15.131:0/3321514107 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c040070 con 0x7f8e300a4f80 2024-04-12T20:08:55.823 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.821+0000 7f8e2cc00640 1 -- 172.21.15.131:0/3321514107 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e1c03e070 con 0x7f8e300a4f80 2024-04-12T20:08:55.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.821+0000 7f8e2cc00640 1 -- 172.21.15.131:0/3321514107 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e1c035040 con 0x7f8e300a4f80 2024-04-12T20:08:55.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.821+0000 7f8e37600640 1 -- 172.21.15.131:0/3321514107 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e300bc2f0 con 0x7f8e300a4f80 2024-04-12T20:08:55.824 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.821+0000 7f8e37600640 1 -- 172.21.15.131:0/3321514107 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e300bc8b0 con 0x7f8e300a4f80 2024-04-12T20:08:55.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.822+0000 7f8e37600640 1 -- 172.21.15.131:0/3321514107 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e3006d7e0 con 0x7f8e300a4f80 2024-04-12T20:08:55.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.823+0000 7f8e2cc00640 1 -- 172.21.15.131:0/3321514107 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f8e1c038020 con 0x7f8e300a4f80 2024-04-12T20:08:55.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.824+0000 7f8e2cc00640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8e1006c920 0x7f8e1006ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:55.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.824+0000 7f8e2cc00640 1 -- 172.21.15.131:0/3321514107 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f8e1c0ada20 con 0x7f8e300a4f80 2024-04-12T20:08:55.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.824+0000 7f8e34c00640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8e1006c920 0x7f8e1006ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:55.825 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.825+0000 7f8e34c00640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8e1006c920 0x7f8e1006ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8e24006fd0 tx=0x7f8e24008040 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:55.829 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:55.829+0000 7f8e2cc00640 1 -- 172.21.15.131:0/3321514107 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f8e3006d7e0 con 0x7f8e300a4f80 2024-04-12T20:08:56.027 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.027+0000 7f8e37600640 1 -- 172.21.15.131:0/3321514107 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8e3004fd50 con 0x7f8e300a4f80 2024-04-12T20:08:56.028 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.028+0000 7f8e2cc00640 1 -- 172.21.15.131:0/3321514107 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) ==== 100+0+11 (secure 0 0 0) 0x7f8e1c07b930 con 0x7f8e300a4f80 2024-04-12T20:08:56.028 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 64 2024-04-12T20:08:56.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.030+0000 7f8e37600640 1 -- 172.21.15.131:0/3321514107 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8e1006c920 msgr2=0x7f8e1006ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.030+0000 7f8e37600640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8e1006c920 0x7f8e1006ede0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8e24006fd0 tx=0x7f8e24008040 comp rx=0 tx=0).stop 2024-04-12T20:08:56.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.030+0000 7f8e37600640 1 -- 172.21.15.131:0/3321514107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e300a4f80 msgr2=0x7f8e300ba350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.030+0000 7f8e37600640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e300a4f80 0x7f8e300ba350 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8e1c02b930 tx=0x7f8e1c0046c0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.031 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.030+0000 7f8e37600640 1 -- 172.21.15.131:0/3321514107 shutdown_connections 2024-04-12T20:08:56.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.030+0000 7f8e37600640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f8e1006c920 0x7f8e1006ede0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.030+0000 7f8e37600640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f8e300bf720 0x7f8e300ba890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.030+0000 7f8e37600640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8e300a4f80 0x7f8e300ba350 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.030+0000 7f8e37600640 1 --2- 172.21.15.131:0/3321514107 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f8e30073840 0x7f8e30151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.030+0000 7f8e37600640 1 -- 172.21.15.131:0/3321514107 >> 172.21.15.131:0/3321514107 conn(0x7f8e3006be00 msgr2=0x7f8e3006c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:56.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.031+0000 7f8e37600640 1 -- 172.21.15.131:0/3321514107 shutdown_connections 2024-04-12T20:08:56.032 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.031+0000 7f8e37600640 1 -- 172.21.15.131:0/3321514107 wait complete. 2024-04-12T20:08:56.048 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-12T20:08:56.258 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.258+0000 7f500d600640 1 Processor -- start 2024-04-12T20:08:56.259 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.258+0000 7f500d600640 1 -- start start 2024-04-12T20:08:56.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.260+0000 7f500d600640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f50080a5ff0 0x7f50080bda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.260+0000 7f500d600640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500814fc80 con 0x7f500814f8a0 2024-04-12T20:08:56.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.260+0000 7f500d600640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f500814f130 con 0x7f500814ece0 2024-04-12T20:08:56.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.260+0000 7f500d600640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f5008073aa0 con 0x7f50080a5ff0 2024-04-12T20:08:56.260 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.260+0000 7f5007e00640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f500814f8a0 0x7f50080bf1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46980/0 (socket says 172.21.15.131:46980) 2024-04-12T20:08:56.261 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.260+0000 7f5007e00640 1 -- 172.21.15.131:0/791069367 learned_addr learned my addr 172.21.15.131:0/791069367 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T20:08:56.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.260+0000 7f5007400640 1 --2- 172.21.15.131:0/791069367 >> v2:172.21.15.171:3300/0 conn(0x7f50080a5ff0 0x7f50080bda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.260+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 234372009 0 0) 0x7f500814fc80 con 0x7f500814f8a0 2024-04-12T20:08:56.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.260+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fec003520 con 0x7f500814f8a0 2024-04-12T20:08:56.263 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4067141901 0 0) 0x7f4fec003520 con 0x7f500814f8a0 2024-04-12T20:08:56.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 >> v2:172.21.15.171:3300/0 conn(0x7f50080a5ff0 msgr2=0x7f50080bda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:56.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 --2- 172.21.15.131:0/791069367 >> v2:172.21.15.171:3300/0 conn(0x7f50080a5ff0 0x7f50080bda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 >> v1:172.21.15.171:6789/0 conn(0x7f500814ece0 legacy=0x7f5008159660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:56.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50080beb00 con 0x7f500814f8a0 2024-04-12T20:08:56.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f4ff8001670 con 0x7f500814f8a0 2024-04-12T20:08:56.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 >> v1:172.21.15.131:6789/0 conn(0x7f500814f8a0 legacy=0x7f50080bf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 --2- 172.21.15.131:0/791069367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fec0039b0 0x7f4fec003db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 --2- 172.21.15.131:0/791069367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fec004800 0x7f4fec004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 --2- 172.21.15.131:0/791069367 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fec0052e0 0x7f4fec00fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f5008073aa0 con 0x7f4fec0039b0 2024-04-12T20:08:56.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f4fec010640 con 0x7f4fec004800 2024-04-12T20:08:56.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f4fec010840 con 0x7f4fec0052e0 2024-04-12T20:08:56.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5007e00640 1 --2- 172.21.15.131:0/791069367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fec0039b0 0x7f4fec003db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.261+0000 7f5007400640 1 --2- 172.21.15.131:0/791069367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fec004800 0x7f4fec004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.262+0000 7f500cc00640 1 --2- 172.21.15.131:0/791069367 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fec0052e0 0x7f4fec00fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.265 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.262+0000 7f5007e00640 1 -- 172.21.15.131:0/791069367 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fec0052e0 msgr2=0x7f4fec00fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:56.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.262+0000 7f5007e00640 1 --2- 172.21.15.131:0/791069367 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f4fec0052e0 0x7f4fec00fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.262+0000 7f5007e00640 1 -- 172.21.15.131:0/791069367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fec004800 msgr2=0x7f4fec004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:56.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.262+0000 7f5007e00640 1 --2- 172.21.15.131:0/791069367 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fec004800 0x7f4fec004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.262+0000 7f5007e00640 1 -- 172.21.15.131:0/791069367 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fec003520 con 0x7f4fec0039b0 2024-04-12T20:08:56.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.262+0000 7f500cc00640 1 -- 172.21.15.131:0/791069367 reap_dead start 2024-04-12T20:08:56.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.263+0000 7f5007e00640 1 --2- 172.21.15.131:0/791069367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fec0039b0 0x7f4fec003db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800c210 tx=0x7f4fec005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=484e15cbdbbac016 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:56.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.263+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8007d30 con 0x7f4fec0039b0 2024-04-12T20:08:56.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.263+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff8030070 con 0x7f4fec0039b0 2024-04-12T20:08:56.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.263+0000 7f5006a00640 1 -- 172.21.15.131:0/791069367 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8005d70 con 0x7f4fec0039b0 2024-04-12T20:08:56.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.263+0000 7f500d600640 1 -- 172.21.15.131:0/791069367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fec0039b0 msgr2=0x7f4fec003db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.269 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.263+0000 7f500d600640 1 --2- 172.21.15.131:0/791069367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fec0039b0 0x7f4fec003db0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4ff800c210 tx=0x7f4fec005830 comp rx=0 tx=0).stop 2024-04-12T20:08:56.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.264+0000 7f500d600640 1 -- 172.21.15.131:0/791069367 shutdown_connections 2024-04-12T20:08:56.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.264+0000 7f500d600640 1 --2- 172.21.15.131:0/791069367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4fec0039b0 0x7f4fec003db0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.264+0000 7f500d600640 1 -- 172.21.15.131:0/791069367 >> 172.21.15.131:0/791069367 conn(0x7f500806bbc0 msgr2=0x7f500806bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:56.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.264+0000 7f500d600640 1 -- 172.21.15.131:0/791069367 shutdown_connections 2024-04-12T20:08:56.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.264+0000 7f500d600640 1 -- 172.21.15.131:0/791069367 wait complete. 2024-04-12T20:08:56.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.265+0000 7f500d600640 1 Processor -- start 2024-04-12T20:08:56.270 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.265+0000 7f500d600640 1 -- start start 2024-04-12T20:08:56.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.266+0000 7f500d600640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fec0039b0 0x7f50080b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.266+0000 7f500d600640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5008071180 0x7f50080b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.266+0000 7f500d600640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5008071c90 0x7f50081e5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.266+0000 7f500d600640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f50080bd130 con 0x7f5008071180 2024-04-12T20:08:56.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.266+0000 7f500d600640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f50080be110 con 0x7f4fec0039b0 2024-04-12T20:08:56.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.266+0000 7f500d600640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f50080bd2b0 con 0x7f5008071c90 2024-04-12T20:08:56.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.266+0000 7f5007400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5008071180 0x7f50080b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.271 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.266+0000 7f5007400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5008071180 0x7f50080b8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40148/0 (socket says 172.21.15.131:40148) 2024-04-12T20:08:56.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.266+0000 7f5007400640 1 -- 172.21.15.131:0/3048235664 learned_addr learned my addr 172.21.15.131:0/3048235664 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:56.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.267+0000 7f5007e00640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fec0039b0 0x7f50080b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.267+0000 7f500cc00640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5008071c90 0x7f50081e5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.267+0000 7f5007400640 1 -- 172.21.15.131:0/3048235664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5008071c90 msgr2=0x7f50081e5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.267+0000 7f5007400640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5008071c90 0x7f50081e5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.267+0000 7f5007400640 1 -- 172.21.15.131:0/3048235664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fec0039b0 msgr2=0x7f50080b76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.267+0000 7f5007400640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fec0039b0 0x7f50080b76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.267+0000 7f5007400640 1 -- 172.21.15.131:0/3048235664 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50080a4d70 con 0x7f5008071180 2024-04-12T20:08:56.272 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.267+0000 7f5007400640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5008071180 0x7f50080b8260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400f600 tx=0x7f4ff400fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:56.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.267+0000 7f4fffe00640 1 -- 172.21.15.131:0/3048235664 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4019020 con 0x7f5008071180 2024-04-12T20:08:56.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.267+0000 7f4fffe00640 1 -- 172.21.15.131:0/3048235664 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ff4014870 con 0x7f5008071180 2024-04-12T20:08:56.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.267+0000 7f4fffe00640 1 -- 172.21.15.131:0/3048235664 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ff4014c20 con 0x7f5008071180 2024-04-12T20:08:56.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.267+0000 7f500d600640 1 -- 172.21.15.131:0/3048235664 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5008147fd0 con 0x7f5008071180 2024-04-12T20:08:56.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.268+0000 7f500d600640 1 -- 172.21.15.131:0/3048235664 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5008073230 con 0x7f5008071180 2024-04-12T20:08:56.273 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.269+0000 7f500d600640 1 -- 172.21.15.131:0/3048235664 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50080a4f70 con 0x7f5008071180 2024-04-12T20:08:56.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.270+0000 7f4fffe00640 1 -- 172.21.15.131:0/3048235664 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f4ff401c020 con 0x7f5008071180 2024-04-12T20:08:56.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.270+0000 7f4fffe00640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f4fe806c8f0 0x7f4fe806edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.274 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.271+0000 7f4fffe00640 1 -- 172.21.15.131:0/3048235664 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f4ff408c780 con 0x7f5008071180 2024-04-12T20:08:56.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.271+0000 7f5007e00640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f4fe806c8f0 0x7f4fe806edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.271+0000 7f5007e00640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f4fe806c8f0 0x7f4fe806edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8034000 tx=0x7f4ff8009030 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:56.275 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.275+0000 7f4fffe00640 1 -- 172.21.15.131:0/3048235664 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f50080a4f70 con 0x7f5008071180 2024-04-12T20:08:56.476 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.475+0000 7f500d600640 1 -- 172.21.15.131:0/3048235664 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f500814f6c0 con 0x7f5008071180 2024-04-12T20:08:56.477 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.476+0000 7f4fffe00640 1 -- 172.21.15.131:0/3048235664 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v53) ==== 103+0+11 (secure 0 0 0) 0x7f500814f6c0 con 0x7f5008071180 2024-04-12T20:08:56.477 INFO:teuthology.orchestra.run.smithi131.stdout:pg_num: 32 2024-04-12T20:08:56.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.479+0000 7f500d600640 1 -- 172.21.15.131:0/3048235664 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f4fe806c8f0 msgr2=0x7f4fe806edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.479+0000 7f500d600640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f4fe806c8f0 0x7f4fe806edb0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8034000 tx=0x7f4ff8009030 comp rx=0 tx=0).stop 2024-04-12T20:08:56.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.479+0000 7f500d600640 1 -- 172.21.15.131:0/3048235664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5008071180 msgr2=0x7f50080b8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.479+0000 7f500d600640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5008071180 0x7f50080b8260 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4ff400f600 tx=0x7f4ff400fac0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.480 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.479+0000 7f500d600640 1 -- 172.21.15.131:0/3048235664 shutdown_connections 2024-04-12T20:08:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.479+0000 7f500d600640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f4fe806c8f0 0x7f4fe806edb0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.479+0000 7f500d600640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f5008071c90 0x7f50081e5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.479+0000 7f500d600640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5008071180 0x7f50080b8260 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.479+0000 7f500d600640 1 --2- 172.21.15.131:0/3048235664 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f4fec0039b0 0x7f50080b76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.479+0000 7f500d600640 1 -- 172.21.15.131:0/3048235664 >> 172.21.15.131:0/3048235664 conn(0x7f500806bbc0 msgr2=0x7f50080c10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.479+0000 7f500d600640 1 -- 172.21.15.131:0/3048235664 shutdown_connections 2024-04-12T20:08:56.481 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.480+0000 7f500d600640 1 -- 172.21.15.131:0/3048235664 wait complete. 2024-04-12T20:08:56.498 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-12T20:08:56.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.696+0000 7f3625c00640 1 Processor -- start 2024-04-12T20:08:56.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.697+0000 7f3625c00640 1 -- start start 2024-04-12T20:08:56.698 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.698+0000 7f3625c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7f362014e8a0 0x7f36200c4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.698+0000 7f3625c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36200c14d0 con 0x7f362006cf20 2024-04-12T20:08:56.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.698+0000 7f3625c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3620151b90 con 0x7f36200c4ac0 2024-04-12T20:08:56.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.698+0000 7f3625c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7f362006d370 con 0x7f362014e8a0 2024-04-12T20:08:56.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.698+0000 7f3625200640 1 --1- >> v1:172.21.15.131:6789/0 conn(0x7f362006cf20 0x7f362015b910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.131:6789/0 says I am v1:172.21.15.131:46982/0 (socket says 172.21.15.131:46982) 2024-04-12T20:08:56.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.698+0000 7f3625200640 1 -- 172.21.15.131:0/1716726680 learned_addr learned my addr 172.21.15.131:0/1716726680 (peer_addr_for_me v1:172.21.15.131:0/0) 2024-04-12T20:08:56.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.698+0000 7f361fe00640 1 --2- 172.21.15.131:0/1716726680 >> v2:172.21.15.171:3300/0 conn(0x7f362014e8a0 0x7f36200c4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 <== mon.0 v1:172.21.15.131:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 84144611 0 0) 0x7f36200c14d0 con 0x7f362006cf20 2024-04-12T20:08:56.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 --> v1:172.21.15.131:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3604003520 con 0x7f362006cf20 2024-04-12T20:08:56.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 <== mon.0 v1:172.21.15.131:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1630625857 0 0) 0x7f3604003520 con 0x7f362006cf20 2024-04-12T20:08:56.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 >> v2:172.21.15.171:3300/0 conn(0x7f362014e8a0 msgr2=0x7f36200c4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:56.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 --2- 172.21.15.131:0/1716726680 >> v2:172.21.15.171:3300/0 conn(0x7f362014e8a0 0x7f36200c4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 >> v1:172.21.15.171:6789/0 conn(0x7f36200c4ac0 legacy=0x7f362006c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 --> v1:172.21.15.131:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3620151e30 con 0x7f362006cf20 2024-04-12T20:08:56.702 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 <== mon.0 v1:172.21.15.131:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 796920437 0 0) 0x7f36180019f0 con 0x7f362006cf20 2024-04-12T20:08:56.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 >> v1:172.21.15.131:6789/0 conn(0x7f362006cf20 legacy=0x7f362015b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 --2- 172.21.15.131:0/1716726680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36040039b0 0x7f3604003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 --2- 172.21.15.131:0/1716726680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3604004800 0x7f3604004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 --2- 172.21.15.131:0/1716726680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36040051c0 0x7f360400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f362006d370 con 0x7f36040039b0 2024-04-12T20:08:56.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f360400c160 con 0x7f36040051c0 2024-04-12T20:08:56.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.699+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f360400c360 con 0x7f3604004800 2024-04-12T20:08:56.703 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.700+0000 7f361fe00640 1 --2- 172.21.15.131:0/1716726680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36040039b0 0x7f3604003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.700+0000 7f3625200640 1 --2- 172.21.15.131:0/1716726680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36040051c0 0x7f360400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.700+0000 7f361f400640 1 --2- 172.21.15.131:0/1716726680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3604004800 0x7f3604004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.700+0000 7f361fe00640 1 -- 172.21.15.131:0/1716726680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3604004800 msgr2=0x7f3604004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:56.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.700+0000 7f361fe00640 1 --2- 172.21.15.131:0/1716726680 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f3604004800 0x7f3604004c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.700+0000 7f361fe00640 1 -- 172.21.15.131:0/1716726680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36040051c0 msgr2=0x7f360400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-12T20:08:56.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.700+0000 7f361fe00640 1 --2- 172.21.15.131:0/1716726680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36040051c0 0x7f360400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.700+0000 7f361fe00640 1 -- 172.21.15.131:0/1716726680 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3604003520 con 0x7f36040039b0 2024-04-12T20:08:56.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.700+0000 7f3625200640 1 --2- 172.21.15.131:0/1716726680 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36040051c0 0x7f360400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:56.704 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.700+0000 7f3625200640 1 -- 172.21.15.131:0/1716726680 reap_dead start 2024-04-12T20:08:56.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.701+0000 7f361fe00640 1 --2- 172.21.15.131:0/1716726680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36040039b0 0x7f3604003dd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3610009ac0 tx=0x7f3604005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e9c5581f91695e server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:56.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.702+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610039070 con 0x7f36040039b0 2024-04-12T20:08:56.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.702+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f361002c6b0 con 0x7f36040039b0 2024-04-12T20:08:56.705 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.702+0000 7f361ea00640 1 -- 172.21.15.131:0/1716726680 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3610009690 con 0x7f36040039b0 2024-04-12T20:08:56.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.702+0000 7f3625c00640 1 -- 172.21.15.131:0/1716726680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36040039b0 msgr2=0x7f3604003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.702+0000 7f3625c00640 1 --2- 172.21.15.131:0/1716726680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36040039b0 0x7f3604003dd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3610009ac0 tx=0x7f3604005830 comp rx=0 tx=0).stop 2024-04-12T20:08:56.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.702+0000 7f3625c00640 1 -- 172.21.15.131:0/1716726680 shutdown_connections 2024-04-12T20:08:56.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.702+0000 7f3625c00640 1 --2- 172.21.15.131:0/1716726680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36040039b0 0x7f3604003dd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.702+0000 7f3625c00640 1 -- 172.21.15.131:0/1716726680 >> 172.21.15.131:0/1716726680 conn(0x7f36200c6780 msgr2=0x7f36200c6b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:56.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.702+0000 7f3625c00640 1 -- 172.21.15.131:0/1716726680 shutdown_connections 2024-04-12T20:08:56.708 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.702+0000 7f3625c00640 1 -- 172.21.15.131:0/1716726680 wait complete. 2024-04-12T20:08:56.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.704+0000 7f3625c00640 1 Processor -- start 2024-04-12T20:08:56.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.704+0000 7f3625c00640 1 -- start start 2024-04-12T20:08:56.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.705+0000 7f3625c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36040039b0 0x7f3620152440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.705+0000 7f3625c00640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36200a9750 0x7f36200a9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.705+0000 7f3625c00640 1 --2- >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36200b8ba0 0x7f36200b9020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.705+0000 7f3625c00640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 -- 0x7f362006c0a0 con 0x7f36200a9750 2024-04-12T20:08:56.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.705+0000 7f3625c00640 1 -- --> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] -- mon_getmap magic: 0 -- 0x7f36200c1950 con 0x7f36200b8ba0 2024-04-12T20:08:56.709 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.705+0000 7f3625c00640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7f362006c380 con 0x7f36040039b0 2024-04-12T20:08:56.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.705+0000 7f361f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36200a9750 0x7f36200a9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.705+0000 7f361f400640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36200a9750 0x7f36200a9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:40162/0 (socket says 172.21.15.131:40162) 2024-04-12T20:08:56.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.705+0000 7f361f400640 1 -- 172.21.15.131:0/1352550891 learned_addr learned my addr 172.21.15.131:0/1352550891 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-04-12T20:08:56.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f3625200640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36200b8ba0 0x7f36200b9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f361fe00640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36040039b0 0x7f3620152440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.710 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f361f400640 1 -- 172.21.15.131:0/1352550891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36040039b0 msgr2=0x7f3620152440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f361f400640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36040039b0 0x7f3620152440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f361f400640 1 -- 172.21.15.131:0/1352550891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36200b8ba0 msgr2=0x7f36200b9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f361f400640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36200b8ba0 0x7f36200b9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f361f400640 1 -- 172.21.15.131:0/1352550891 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3620152980 con 0x7f36200a9750 2024-04-12T20:08:56.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f3625200640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36200b8ba0 0x7f36200b9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-12T20:08:56.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f361f400640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36200a9750 0x7f36200a9bb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f360c00d570 tx=0x7f360c00da30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:56.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f3617e00640 1 -- 172.21.15.131:0/1352550891 <== mon.0 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c016070 con 0x7f36200a9750 2024-04-12T20:08:56.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f3617e00640 1 -- 172.21.15.131:0/1352550891 <== mon.0 v2:172.21.15.131:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f360c012800 con 0x7f36200a9750 2024-04-12T20:08:56.711 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f3625c00640 1 -- 172.21.15.131:0/1352550891 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36200aa0f0 con 0x7f36200a9750 2024-04-12T20:08:56.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f3617e00640 1 -- 172.21.15.131:0/1352550891 <== mon.0 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f360c012bb0 con 0x7f36200a9750 2024-04-12T20:08:56.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.706+0000 7f3625c00640 1 -- 172.21.15.131:0/1352550891 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36201dc930 con 0x7f36200a9750 2024-04-12T20:08:56.712 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.708+0000 7f3625c00640 1 -- 172.21.15.131:0/1352550891 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f362004fd50 con 0x7f36200a9750 2024-04-12T20:08:56.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.708+0000 7f3617e00640 1 -- 172.21.15.131:0/1352550891 <== mon.0 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 5) ==== 91040+0+0 (secure 0 0 0) 0x7f360c019070 con 0x7f36200a9750 2024-04-12T20:08:56.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.709+0000 7f3617e00640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f360006c8f0 0x7f360006edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:56.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.709+0000 7f3617e00640 1 -- 172.21.15.131:0/1352550891 <== mon.0 v2:172.21.15.131:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 6993+0+0 (secure 0 0 0) 0x7f360c08bf60 con 0x7f36200a9750 2024-04-12T20:08:56.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.710+0000 7f361fe00640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f360006c8f0 0x7f360006edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-12T20:08:56.713 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.710+0000 7f361fe00640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f360006c8f0 0x7f360006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3610036000 tx=0x7f3610030000 comp rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-12T20:08:56.714 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.714+0000 7f3617e00640 1 -- 172.21.15.131:0/1352550891 <== mon.0 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187246 (secure 0 0 0) 0x7f360c059de0 con 0x7f36200a9750 2024-04-12T20:08:56.926 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.926+0000 7f3625c00640 1 -- 172.21.15.131:0/1352550891 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f36200a9400 con 0x7f36200a9750 2024-04-12T20:08:56.927 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.927+0000 7f3617e00640 1 -- 172.21.15.131:0/1352550891 <== mon.0 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v53) ==== 80+0+370 (secure 0 0 0) 0x7f360c0596e0 con 0x7f36200a9750 2024-04-12T20:08:56.927 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131:6837/2898590457 2024-04-13T20:04:46.991422+0000 2024-04-12T20:08:56.928 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.131:6835/2898590457 2024-04-13T20:04:46.991422+0000 2024-04-12T20:08:56.928 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6835/373698102 2024-04-13T20:04:21.983874+0000 2024-04-12T20:08:56.928 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6833/373698102 2024-04-13T20:04:21.983874+0000 2024-04-12T20:08:56.928 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6834/1013642393 2024-04-13T20:03:56.972117+0000 2024-04-12T20:08:56.928 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.15.171:6832/1013642393 2024-04-13T20:03:56.972117+0000 2024-04-12T20:08:56.928 INFO:teuthology.orchestra.run.smithi131.stderr:listed 6 entries 2024-04-12T20:08:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.930+0000 7f3625c00640 1 -- 172.21.15.131:0/1352550891 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f360006c8f0 msgr2=0x7f360006edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.930+0000 7f3625c00640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f360006c8f0 0x7f360006edb0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3610036000 tx=0x7f3610030000 comp rx=0 tx=0).stop 2024-04-12T20:08:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.930+0000 7f3625c00640 1 -- 172.21.15.131:0/1352550891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36200a9750 msgr2=0x7f36200a9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-12T20:08:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.930+0000 7f3625c00640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36200a9750 0x7f36200a9bb0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f360c00d570 tx=0x7f360c00da30 comp rx=0 tx=0).stop 2024-04-12T20:08:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.930+0000 7f3625c00640 1 -- 172.21.15.131:0/1352550891 shutdown_connections 2024-04-12T20:08:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.930+0000 7f3625c00640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.131:6832/873500205,v1:172.21.15.131:6833/873500205] conn(0x7f360006c8f0 0x7f360006edb0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.930+0000 7f3625c00640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] conn(0x7f36200b8ba0 0x7f36200b9020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.931 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.930+0000 7f3625c00640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36200a9750 0x7f36200a9bb0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.930+0000 7f3625c00640 1 --2- 172.21.15.131:0/1352550891 >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7f36040039b0 0x7f3620152440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:08:56.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.930+0000 7f3625c00640 1 -- 172.21.15.131:0/1352550891 >> 172.21.15.131:0/1352550891 conn(0x7f36200c6780 msgr2=0x7f36200c50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-12T20:08:56.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.930+0000 7f3625c00640 1 -- 172.21.15.131:0/1352550891 shutdown_connections 2024-04-12T20:08:56.932 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:56.930+0000 7f3625c00640 1 -- 172.21.15.131:0/1352550891 wait complete. 2024-04-12T20:08:56.950 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/mount.py", line 197, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType 2024-04-12T20:08:56.955 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-12T20:08:56.966 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-12T20:08:56.967 DEBUG:teuthology.orchestra.run.smithi131:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-12T20:08:57.025 INFO:tasks.ceph.osd.0:Sent signal 15 2024-04-12T20:08:57.026 INFO:tasks.ceph.osd.1:Sent signal 15 2024-04-12T20:08:57.026 INFO:tasks.ceph.osd.2:Sent signal 15 2024-04-12T20:08:57.026 INFO:tasks.ceph.osd.3:Sent signal 15 2024-04-12T20:08:57.027 INFO:tasks.ceph.osd.4:Sent signal 15 2024-04-12T20:08:57.027 INFO:tasks.ceph.osd.5:Sent signal 15 2024-04-12T20:08:57.027 INFO:tasks.ceph.osd.6:Sent signal 15 2024-04-12T20:08:57.027 INFO:tasks.ceph.osd.7:Sent signal 15 2024-04-12T20:08:57.028 INFO:tasks.ceph.mon.a:Sent signal 15 2024-04-12T20:08:57.028 INFO:tasks.ceph.mon.b:Sent signal 15 2024-04-12T20:08:57.028 INFO:tasks.ceph.mon.c:Sent signal 15 2024-04-12T20:08:57.029 INFO:tasks.ceph.mgr.y:Sent signal 15 2024-04-12T20:08:57.029 INFO:tasks.ceph.mgr.x:Sent signal 15 2024-04-12T20:08:57.030 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-12T20:08:57.029+0000 7f72b0200640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 37561) UID: 0 2024-04-12T20:08:57.030 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-12T20:08:57.029+0000 7f72b0200640 -1 osd.4 53 *** Got signal Terminated *** 2024-04-12T20:08:57.030 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-12T20:08:57.029+0000 7f72b0200640 -1 osd.4 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T20:08:57.030 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-04-12T20:08:57.026+0000 7ff5e1400640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 36897) UID: 0 2024-04-12T20:08:57.031 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-04-12T20:08:57.026+0000 7ff5e1400640 -1 osd.0 53 *** Got signal Terminated *** 2024-04-12T20:08:57.031 INFO:tasks.ceph.osd.0.smithi131.stderr:2024-04-12T20:08:57.026+0000 7ff5e1400640 -1 osd.0 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T20:08:57.031 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-12T20:08:57.029+0000 7f1130400640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 37562) UID: 0 2024-04-12T20:08:57.031 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-12T20:08:57.029+0000 7f1130400640 -1 osd.5 53 *** Got signal Terminated *** 2024-04-12T20:08:57.031 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-12T20:08:57.029+0000 7f1130400640 -1 osd.5 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T20:08:57.032 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-12T20:08:57.027+0000 7f1bc5e00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 36902) UID: 0 2024-04-12T20:08:57.032 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-12T20:08:57.027+0000 7f1bc5e00640 -1 osd.1 53 *** Got signal Terminated *** 2024-04-12T20:08:57.032 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-12T20:08:57.029+0000 7f9c35800640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 37566) UID: 0 2024-04-12T20:08:57.032 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-12T20:08:57.029+0000 7f9c35800640 -1 osd.6 53 *** Got signal Terminated *** 2024-04-12T20:08:57.033 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-04-12T20:08:57.029+0000 7f9c35800640 -1 osd.6 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T20:08:57.033 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-12T20:08:57.027+0000 7fa3bd400640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 36910) UID: 0 2024-04-12T20:08:57.033 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-12T20:08:57.027+0000 7fa3bd400640 -1 osd.2 53 *** Got signal Terminated *** 2024-04-12T20:08:57.033 INFO:tasks.ceph.osd.2.smithi131.stderr:2024-04-12T20:08:57.027+0000 7fa3bd400640 -1 osd.2 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T20:08:57.033 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-04-12T20:08:57.029+0000 7f0175c00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 37565) UID: 0 2024-04-12T20:08:57.033 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-04-12T20:08:57.029+0000 7f0175c00640 -1 osd.7 53 *** Got signal Terminated *** 2024-04-12T20:08:57.034 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-04-12T20:08:57.029+0000 7f0175c00640 -1 osd.7 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T20:08:57.034 INFO:tasks.ceph.mon.b.smithi171.stderr:2024-04-12T20:08:57.030+0000 7f3aa4a00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 36992) UID: 0 2024-04-12T20:08:57.034 INFO:tasks.ceph.mon.b.smithi171.stderr:2024-04-12T20:08:57.030+0000 7f3aa4a00640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2024-04-12T20:08:57.035 INFO:tasks.ceph.mon.c.smithi171.stderr:2024-04-12T20:08:57.030+0000 7f9d5ee00640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 36993) UID: 0 2024-04-12T20:08:57.035 INFO:tasks.ceph.mon.c.smithi171.stderr:2024-04-12T20:08:57.030+0000 7f9d5ee00640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2024-04-12T20:08:57.035 INFO:tasks.ceph.osd.1.smithi131.stderr:2024-04-12T20:08:57.027+0000 7f1bc5e00640 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T20:08:57.035 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-12T20:08:57.027+0000 7f1654200640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 36912) UID: 0 2024-04-12T20:08:57.036 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-12T20:08:57.028+0000 7f1654200640 -1 osd.3 53 *** Got signal Terminated *** 2024-04-12T20:08:57.036 INFO:tasks.ceph.osd.3.smithi131.stderr:2024-04-12T20:08:57.028+0000 7f1654200640 -1 osd.3 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-04-12T20:08:57.036 INFO:tasks.ceph.mon.a.smithi131.stderr:2024-04-12T20:08:57.029+0000 7f621a800640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 36638) UID: 0 2024-04-12T20:08:57.036 INFO:tasks.ceph.mon.a.smithi131.stderr:2024-04-12T20:08:57.029+0000 7f621a800640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-04-12T20:08:57.036 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T20:08:57.030+0000 7fedb2800640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i y (PID: 36660) UID: 0 2024-04-12T20:08:57.037 INFO:tasks.ceph.mgr.y.smithi131.stderr:2024-04-12T20:08:57.030+0000 7fedb2800640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-04-12T20:08:57.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.178+0000 7fa9f6c00640 1 Processor -- start 2024-04-12T20:08:57.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.178+0000 7fa9f6c00640 1 -- start start 2024-04-12T20:08:57.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.179+0000 7fa9f6c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9f00a8500 0x7fa9f01526f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:08:57.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.179+0000 7fa9f6c00640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f01531a0 con 0x7fa9f00a8120 2024-04-12T20:08:57.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.179+0000 7fa9f6c00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9f00a4e60 2024-04-12T20:08:57.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.179+0000 7fa9f6c00640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9f00a8500 2024-04-12T20:08:57.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.179+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9f00a8120 legacy=0x7fa9f00728d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:08:57.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.179+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9f00a8500 msgr2=0x7fa9f01526f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:08:57.180 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.179+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9f00a4e60 legacy=0x7fa9f0159a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:08:57.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.179+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9f00a8500 0x7fa9f01526f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:08:57.231 INFO:tasks.ceph.mgr.x.smithi171.stderr:daemon-helper: command crashed with signal 15 2024-04-12T20:08:57.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.380+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9f00a8500 msgr2=0x7fa9f01526f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:08:57.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.380+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9f00a4e60 legacy=0x7fa9f0159a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:08:57.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.380+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9f00a8120 legacy=0x7fa9f00728d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:08:57.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.380+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9f00a8500 0x7fa9f01526f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:08:57.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.781+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9f00a8120 legacy=0x7fa9f00728d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:08:57.781 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.781+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9f00a8500 msgr2=0x7fa9f01526f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:08:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.781+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9f00a4e60 legacy=0x7fa9f0159a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:08:57.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:57.781+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9f00a8500 0x7fa9f01526f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:08:58.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:58.582+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9f00a8120 legacy=0x7fa9f00728d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:08:58.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:58.582+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9f00a4e60 legacy=0x7fa9f0159a80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:08:58.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:58.582+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9f00a8500 msgr2=0x7fa9f01526f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:08:58.583 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:08:58.582+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9f00a8500 0x7fa9f01526f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:00.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.180+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9f00a8500 msgr2=0x7fa9f01526f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:00.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.180+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9f00a8500 0x7fa9f01526f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:00.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.180+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9f00a4e60 legacy=0x7fa9f0159a80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:00.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.180+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9f00a8120 legacy=0x7fa9f00728d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:00.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.180+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0036a0 0x7fa9cc005af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:00.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.180+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc006130 0x7fa9cc0085f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:00.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.180+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc006130 2024-04-12T20:09:00.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.180+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc0036a0 2024-04-12T20:09:00.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.180+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc006130 msgr2=0x7fa9cc0085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:00.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.180+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0036a0 msgr2=0x7fa9cc005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:00.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.180+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc006130 0x7fa9cc0085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:00.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.180+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0036a0 0x7fa9cc005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:00.381 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.381+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc006130 msgr2=0x7fa9cc0085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:00.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.381+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc006130 0x7fa9cc0085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:00.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.381+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0036a0 msgr2=0x7fa9cc005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:00.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.381+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0036a0 0x7fa9cc005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:00.782 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.782+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc006130 msgr2=0x7fa9cc0085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:00.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.782+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc006130 0x7fa9cc0085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:00.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.782+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0036a0 msgr2=0x7fa9cc005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:00.783 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:00.782+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0036a0 0x7fa9cc005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:01.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:01.583+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0036a0 msgr2=0x7fa9cc005af0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:01.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:01.583+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc006130 msgr2=0x7fa9cc0085f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:01.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:01.583+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0036a0 0x7fa9cc005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:01.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:01.583+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc006130 0x7fa9cc0085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0036a0 msgr2=0x7fa9cc005af0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0036a0 0x7fa9cc005af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:03.181 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc006130 msgr2=0x7fa9cc0085f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc006130 0x7fa9cc0085f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:09:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9f00a8120 2024-04-12T20:09:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9f00a8120 legacy=0x7fa9cc00b130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f01531a0 con 0x7fa9f00a4e60 2024-04-12T20:09:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc003ae0 2024-04-12T20:09:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:03.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9f00a4e60 legacy=0x7fa9cc00e860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:03.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.181+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.382+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9f00a8120 legacy=0x7fa9cc00b130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.382+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.382+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9f00a4e60 legacy=0x7fa9cc00e860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:03.382 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.382+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:03.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.783+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9f00a8120 legacy=0x7fa9cc00b130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:03.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.783+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:03.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.783+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9f00a4e60 legacy=0x7fa9cc00e860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:03.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:03.783+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:04.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:04.585+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9f00a8120 legacy=0x7fa9cc00b130 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:04.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:04.585+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:04.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:04.585+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9f00a4e60 legacy=0x7fa9cc00e860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:04.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:04.585+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:06.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.182+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:06.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.182+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:06.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.182+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9f00a4e60 legacy=0x7fa9cc00e860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:06.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.182+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9f00a8120 legacy=0x7fa9cc00b130 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:06.182 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.182+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007da0 0x7fa9cc008210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:06.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.182+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006bb0 0x7fa9cc006fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:06.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.182+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc007da0 2024-04-12T20:09:06.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.182+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc006bb0 2024-04-12T20:09:06.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.182+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007da0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:06.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.182+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007da0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:06.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.182+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006bb0 msgr2=0x7fa9cc006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:06.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.182+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006bb0 0x7fa9cc006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:06.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.383+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007da0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:06.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.383+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007da0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:06.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.383+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006bb0 msgr2=0x7fa9cc006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:06.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.383+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006bb0 0x7fa9cc006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:06.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.784+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007da0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:06.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.784+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007da0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:06.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.784+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006bb0 msgr2=0x7fa9cc006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:06.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:06.784+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006bb0 0x7fa9cc006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:07.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:07.585+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007da0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:07.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:07.585+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007da0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:07.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:07.585+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006bb0 msgr2=0x7fa9cc006fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:07.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:07.585+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006bb0 0x7fa9cc006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:09.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006bb0 msgr2=0x7fa9cc006fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:09.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006bb0 0x7fa9cc006fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:09.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007da0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:09.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007da0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:09.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:09:09.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc015fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:09.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:09.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:09.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc007500 2024-04-12T20:09:09.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc006fc0 2024-04-12T20:09:09.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc0078e0 con 0x7fa9cc003ae0 2024-04-12T20:09:09.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc015fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:09.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc015fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:09.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9f4c00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:09.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:09.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:09.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.182+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:09.383 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.383+0000 7fa9f4c00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:09.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.383+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc015fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:09.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.383+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:09.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.383+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc015fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:09.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.383+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:09.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.383+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:09.784 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.784+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc015fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:09.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.784+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc015fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:09.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.784+0000 7fa9f4c00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:09.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.784+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:09.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.784+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:09.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:09.784+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:10.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:10.586+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc015fb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:10.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:10.586+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc015fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:10.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:10.586+0000 7fa9f4c00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:10.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:10.586+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:10.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:10.586+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:10.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:10.586+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:12.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.183+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:12.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.183+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:12.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.183+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:12.183 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.183+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:12.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.183+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc015fb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:12.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.183+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc015fb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:12.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.183+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9cc005a00 2024-04-12T20:09:12.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.183+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc003f00 2024-04-12T20:09:12.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.183+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:12.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.183+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc005a00 legacy=0x7fa9cc00d140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:12.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.384+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:12.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.384+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc005a00 legacy=0x7fa9cc00d140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:12.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.785+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc005a00 legacy=0x7fa9cc00d140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:12.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:12.785+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:13.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:13.586+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc005a00 legacy=0x7fa9cc00d140 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:13.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:13.586+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:15.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.183+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:15.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.183+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc005a00 legacy=0x7fa9cc00d140 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:15.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.183+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:15.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.183+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:09:15.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.183+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc00f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:15.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.183+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:15.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.183+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc007500 2024-04-12T20:09:15.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.183+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc006fc0 2024-04-12T20:09:15.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.183+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc0078e0 con 0x7fa9cc003ae0 2024-04-12T20:09:15.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.184+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:15.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.184+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:15.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.184+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:15.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.184+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc00f9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:15.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.184+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:15.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.184+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc00f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:15.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.385+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc00f9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:15.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.385+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc00f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:15.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.385+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:15.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.385+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:15.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.385+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:15.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.385+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:15.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.786+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc00f9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:15.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.786+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc00f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:15.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.786+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:15.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.786+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:15.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.786+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:15.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:15.786+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:16.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:16.587+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc00f9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:16.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:16.587+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc00f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:16.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:16.587+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:16.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:16.587+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:16.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:16.587+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:16.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:16.587+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:18.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.184+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:18.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.184+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:18.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.184+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:18.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.184+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc006fc0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:18.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.184+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc00f9a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:18.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.184+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc00f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:18.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.184+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f01531a0 con 0x7fa9cc003f00 2024-04-12T20:09:18.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.184+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9cc004a50 2024-04-12T20:09:18.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.184+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:18.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.184+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc004a50 legacy=0x7fa9cc004e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:18.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.385+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:18.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.385+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc004a50 legacy=0x7fa9cc004e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:18.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.786+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:18.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:18.786+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc004a50 legacy=0x7fa9cc004e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:19.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:19.587+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:19.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:19.587+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc004a50 legacy=0x7fa9cc004e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:21.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.184+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc004a50 legacy=0x7fa9cc004e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:21.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.184+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:21.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.184+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc00f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:21.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.184+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:21.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.184+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:09:21.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.184+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc003f00 2024-04-12T20:09:21.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.184+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc007500 2024-04-12T20:09:21.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.184+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc003ae0 2024-04-12T20:09:21.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.184+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc00f9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:21.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.184+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc00f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:21.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.185+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:21.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.185+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:21.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.185+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:21.384 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.385+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc00f9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:21.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.385+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc00f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:21.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.386+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:21.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.386+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:21.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.386+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:21.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.786+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc00f9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:21.785 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.786+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc00f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:21.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.787+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:21.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.787+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:21.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:21.787+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:22.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:22.587+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc00f9a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:22.587+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc00f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:22.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:22.588+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:22.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:22.588+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:22.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:22.588+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:23.885 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:09:23.893 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:09:24.184 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.185+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:24.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.185+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:24.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.185+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 msgr2=0x7fa9cc00f9a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:24.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.185+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc007500 0x7fa9cc00f9a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:24.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.185+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc003f00 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:24.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.185+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc007030 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:24.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.185+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f01531a0 con 0x7fa9cc004bb0 2024-04-12T20:09:24.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.185+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc007030 2024-04-12T20:09:24.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.185+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:24.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.185+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc007030 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:24.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.185+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc007030 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:24.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.386+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:24.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.386+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc007030 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:24.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.386+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc007030 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:24.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.787+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:24.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.787+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc007030 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:24.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:24.787+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc007030 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:25.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:25.588+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:25.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:25.588+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc007030 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:25.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:25.588+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc007030 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:27.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.185+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc007030 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:27.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.185+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc007030 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:27.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.185+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:27.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.185+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 0x7fa9cc017fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:27.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.185+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:09:27.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.185+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:27.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.185+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc004bb0 2024-04-12T20:09:27.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.185+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc00f160 2024-04-12T20:09:27.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.185+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc003ae0 2024-04-12T20:09:27.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.185+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:27.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.185+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:27.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.186+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 msgr2=0x7fa9cc017fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:27.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.186+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:27.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.186+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 0x7fa9cc017fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:27.385 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.386+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:27.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.387+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:27.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.387+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 msgr2=0x7fa9cc017fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:27.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.387+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 0x7fa9cc017fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:27.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.387+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:27.786 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.787+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.788+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 msgr2=0x7fa9cc017fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.788+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:27.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.788+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 0x7fa9cc017fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:27.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:27.788+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:28.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:28.588+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:28.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:28.589+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 msgr2=0x7fa9cc017fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:28.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:28.589+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:28.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:28.589+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 0x7fa9cc017fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:28.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:28.589+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:30.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.185+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc008210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:30.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.185+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc008210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:30.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.185+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 msgr2=0x7fa9cc017fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:30.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.185+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 0x7fa9cc017fc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:30.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.185+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:30.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.185+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:30.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.185+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f01531a0 con 0x7fa9cc007500 2024-04-12T20:09:30.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.185+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc003f00 2024-04-12T20:09:30.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.186+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:30.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.186+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:30.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.186+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc007500 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:30.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.387+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:30.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.387+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:30.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.387+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc007500 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:30.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.788+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:30.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.788+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:30.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:30.788+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc007500 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:31.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:31.589+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:31.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:31.589+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:31.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:31.589+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc007500 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:33.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:33.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:33.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc007500 legacy=0x7fa9cc004340 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:33.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc0081e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:33.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:09:33.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 0x7fa9cc0159d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:33.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc004bb0 2024-04-12T20:09:33.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc00f160 2024-04-12T20:09:33.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc003ae0 2024-04-12T20:09:33.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:33.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9f4c00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:33.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:33.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:33.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.186+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc0081e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:33.386 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.387+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:33.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.387+0000 7fa9f4c00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:33.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.387+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:33.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.387+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:33.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.387+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc0081e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:33.787 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.788+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:33.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.788+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:33.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.788+0000 7fa9f4c00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:33.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.788+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:33.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:33.788+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc0081e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:34.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:34.589+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:34.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:34.589+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0081e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:34.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:34.589+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc0081e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:34.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:34.589+0000 7fa9f4c00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:34.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:34.589+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:36.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.186+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0081e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:36.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.186+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc003ae0 0x7fa9cc0081e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:36.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.186+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:36.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.186+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc00f160 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:36.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.186+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:36.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.186+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:36.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.186+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f01531a0 con 0x7fa9cc007500 2024-04-12T20:09:36.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.186+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc003f00 2024-04-12T20:09:36.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.186+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:36.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.187+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc007500 legacy=0x7fa9cc004300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:36.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.187+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:36.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.388+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.388+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:36.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.388+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc007500 legacy=0x7fa9cc004300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:36.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.789+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:36.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.789+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:36.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:36.789+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc007500 legacy=0x7fa9cc004300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:37.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:37.590+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:37.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:37.590+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:37.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:37.590+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc007500 legacy=0x7fa9cc004300 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:39.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.187+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:39.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.187+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:39.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.187+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc007500 legacy=0x7fa9cc004300 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:39.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.187+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:39.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.187+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:09:39.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.187+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc004bb0 2024-04-12T20:09:39.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.187+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f01531a0 con 0x7fa9cc017f20 2024-04-12T20:09:39.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.187+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc003f00 2024-04-12T20:09:39.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.187+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:39.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.187+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:39.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.187+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc01c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:39.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.187+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:39.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.388+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:39.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.388+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:39.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.388+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc01c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:39.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.388+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:39.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.789+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:39.788 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.789+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:39.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.789+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc01c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:39.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:39.789+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:40.589 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:40.590+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:40.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:40.590+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:40.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:40.590+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:40.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:40.590+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc01c910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:42.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.187+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:42.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.187+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:42.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.187+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc01c910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:42.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.187+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004bb0 legacy=0x7fa9cc004fc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:42.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.187+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0179e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:42.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.187+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:42.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.187+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc003ae0 2024-04-12T20:09:42.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.187+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc0081e0 2024-04-12T20:09:42.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.187+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:42.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.187+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:42.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.187+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:42.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.187+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:42.387 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.387+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:42.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.387+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:42.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.387+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:42.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.387+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:42.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.788+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:42.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.788+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:42.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.788+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:42.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:42.788+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:43.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:43.589+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:43.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:43.589+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:43.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:43.589+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:43.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:43.589+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:45.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.186+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:45.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.186+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:45.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.186+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:45.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.186+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:45.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.186+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:09:45.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.186+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:45.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.186+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:45.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.186+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9cc017f20 2024-04-12T20:09:45.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.186+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc003f00 2024-04-12T20:09:45.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.186+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc0081e0 2024-04-12T20:09:45.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.186+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:45.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.187+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:45.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.187+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:45.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.187+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:45.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.187+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:45.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.388+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:45.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.388+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:45.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.388+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:45.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.388+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:45.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.388+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:45.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.789+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:45.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.789+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:45.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.789+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:45.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.789+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:45.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:45.789+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:46.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:46.591+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:46.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:46.591+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:46.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:46.591+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:46.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:46.591+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:46.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:46.591+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:48.187 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.187+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:48.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.187+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:48.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.187+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:48.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.187+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:48.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.187+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc009100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:48.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.187+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0052c0 0x7fa9cc0179e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:48.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.187+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc003ae0 2024-04-12T20:09:48.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.187+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc0052c0 2024-04-12T20:09:48.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.187+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:48.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.187+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0052c0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:48.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.187+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0052c0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:48.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.388+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:48.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.388+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0052c0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:48.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.388+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0052c0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:48.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.789+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:48.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.789+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0052c0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:48.789 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:48.789+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0052c0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:49.590 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:49.590+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:49.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:49.590+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0052c0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:49.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:49.590+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0052c0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:51.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.187+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0052c0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:51.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.187+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0052c0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:51.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.187+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:51.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.187+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:51.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.187+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:09:51.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.187+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9cc003ae0 2024-04-12T20:09:51.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.187+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc017f20 2024-04-12T20:09:51.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.187+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc0081e0 2024-04-12T20:09:51.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.187+0000 7fa9f4c00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:51.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.187+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:51.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.187+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:51.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.187+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:51.388 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.388+0000 7fa9f4c00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:51.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.388+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:51.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.388+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:51.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.388+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:51.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.789+0000 7fa9f4c00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:51.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.789+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:51.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.789+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:51.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:51.789+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:52.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:52.591+0000 7fa9f4c00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:52.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:52.591+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc009100 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:52.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:52.591+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:09:52.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:52.591+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:54.045 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:09:54.053 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:09:54.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.187+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0042e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:54.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.187+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0042e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:54.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.187+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc009100 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:54.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.187+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:54.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.187+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:54.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.187+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0052c0 0x7fa9cc0179e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:54.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.187+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc0052c0 2024-04-12T20:09:54.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.187+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc003f00 2024-04-12T20:09:54.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.187+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0052c0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:54.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.188+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0052c0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:54.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.188+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:54.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.188+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:54.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.389+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0052c0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:54.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.389+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0052c0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:54.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.389+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:54.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.389+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:54.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.790+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0052c0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:54.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.790+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0052c0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:54.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.790+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:54.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:54.790+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:55.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:55.592+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0052c0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:55.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:55.592+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0052c0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:55.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:55.592+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:09:55.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:55.592+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:57.188 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:57.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:57.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0052c0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:09:57.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0052c0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:09:57.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:09:57.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:09:57.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f01531a0 con 0x7fa9cc003ae0 2024-04-12T20:09:57.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9cc017f20 2024-04-12T20:09:57.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc00d840 2024-04-12T20:09:57.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:57.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:57.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:09:57.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.188+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc0090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:57.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.389+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:57.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.389+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:57.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.389+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc0090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:57.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.389+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:09:57.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.790+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:57.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.790+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:57.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.790+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc0090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:09:57.790 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:57.790+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:09:58.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:58.591+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:09:58.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:58.591+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:09:58.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:58.591+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:09:58.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:09:58.591+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc0090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:00.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.189+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:00.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.189+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:00.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.189+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc0090e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:00.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.189+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004bb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.189+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.189+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 0x7fa9cc00e160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.189+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc003f00 2024-04-12T20:10:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.189+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc0081e0 2024-04-12T20:10:00.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.189+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc00e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.189+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.189+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 0x7fa9cc00e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:00.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.189+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:00.389 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.390+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc00e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:00.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.390+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:00.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.390+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 0x7fa9cc00e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:00.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.390+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:00.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.791+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc00e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:00.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.791+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:00.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.791+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 0x7fa9cc00e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:00.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:00.791+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:01.593+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc00e160 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:01.593+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:01.593+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 0x7fa9cc00e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:01.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:01.593+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:03.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 msgr2=0x7fa9cc00e160 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003f00 0x7fa9cc00e160 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0043b0 0x7fa9cc0179e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:10:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc017f20 2024-04-12T20:10:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc00d840 2024-04-12T20:10:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc0043b0 2024-04-12T20:10:03.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9f4c00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0043b0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc0090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.189+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:03.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.190+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0043b0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:03.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.391+0000 7fa9f4c00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:03.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.391+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0043b0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:03.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.391+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc0090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:03.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.391+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:03.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.391+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0043b0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:03.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.792+0000 7fa9f4c00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:03.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.792+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0043b0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:03.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.792+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc0090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:03.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.792+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:03.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:03.792+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0043b0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:04.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:04.593+0000 7fa9f4c00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:04.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:04.593+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0043b0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:04.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:04.593+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc0090e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:04.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:04.593+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:04.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:04.593+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0043b0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:06.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.189+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0043b0 msgr2=0x7fa9cc0179e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:06.189 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.189+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc0043b0 0x7fa9cc0179e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:06.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.189+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:06.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.189+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:06.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.189+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017f20 legacy=0x7fa9cc0090e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:06.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.189+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:06.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.189+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f01531a0 con 0x7fa9cc003ae0 2024-04-12T20:10:06.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.189+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc0081e0 2024-04-12T20:10:06.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.190+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:06.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.190+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:06.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.190+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:06.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.391+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:06.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.391+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:06.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.391+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:06.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.792+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:06.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.792+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:06.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:06.792+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:07.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:07.593+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:07.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:07.593+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:07.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:07.593+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:09.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:09.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:09.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc003ae0 legacy=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:09.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:09.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:10:09.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:09.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:09.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc00d840 2024-04-12T20:10:09.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc003ae0 2024-04-12T20:10:09.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc0078e0 con 0x7fa9cc0081e0 2024-04-12T20:10:09.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:09.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:09.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:09.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:09.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:09.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.190+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:09.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.391+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:09.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.391+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:09.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.391+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:09.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.391+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:09.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.391+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:09.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.391+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:09.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.792+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:09.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.792+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:09.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.792+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:09.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.792+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:09.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.792+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:09.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:09.792+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:10.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:10.593+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:10.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:10.593+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:10.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:10.593+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:10.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:10.593+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:10.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:10.594+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:10.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:10.594+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:12.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.190+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:12.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.190+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:12.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.190+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:12.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.190+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:12.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.190+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:12.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.190+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:12.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.190+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc00f170 2024-04-12T20:10:12.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.190+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f01531a0 con 0x7fa9cc0043b0 2024-04-12T20:10:12.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.190+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc00f170 legacy=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:12.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.191+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0043b0 legacy=0x7fa9cc00b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:12.390 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.391+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc00f170 legacy=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:12.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.392+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0043b0 legacy=0x7fa9cc00b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:12.791 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.792+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc00f170 legacy=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:12.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:12.793+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0043b0 legacy=0x7fa9cc00b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:13.592 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:13.593+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc00f170 legacy=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:13.593 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:13.594+0000 7fa9efe00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0043b0 legacy=0x7fa9cc00b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:15.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.190+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0043b0 legacy=0x7fa9cc00b0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:15.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.190+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc00f170 legacy=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:15.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.190+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:15.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.190+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:10:15.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.190+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:15.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.190+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9cc0170f0 2024-04-12T20:10:15.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.190+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc00d840 2024-04-12T20:10:15.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.190+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc003ae0 2024-04-12T20:10:15.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.191+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:15.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.191+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:15.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.191+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:15.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.191+0000 7fa9f4c00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:15.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.191+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:15.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.392+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:15.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.392+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:15.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.392+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:15.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.392+0000 7fa9f4c00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:15.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.392+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:15.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.793+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:15.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.793+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:15.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.793+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:15.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.793+0000 7fa9f4c00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:15.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:15.793+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:16.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:16.594+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:16.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:16.594+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:16.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:16.594+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:16.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:16.594+0000 7fa9f4c00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:16.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:16.594+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:18.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.191+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:18.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.191+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:18.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.191+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:18.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.191+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:18.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.191+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:18.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.191+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:18.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.191+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc0043b0 2024-04-12T20:10:18.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.191+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc0081e0 2024-04-12T20:10:18.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.191+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0043b0 legacy=0x7fa9cc00b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:18.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.191+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:18.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.191+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:18.391 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.392+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0043b0 legacy=0x7fa9cc00b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:18.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.392+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:18.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.392+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:18.792 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.793+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0043b0 legacy=0x7fa9cc00b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:18.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.793+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:18.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:18.793+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:19.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:19.594+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0043b0 legacy=0x7fa9cc00b0f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:19.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:19.594+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:19.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:19.594+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:21.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.191+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:21.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.191+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:21.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.191+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0043b0 legacy=0x7fa9cc00b0f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:21.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.191+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:21.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.191+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:21.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.191+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:10:21.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.191+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9cc017be0 2024-04-12T20:10:21.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.191+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc00d840 2024-04-12T20:10:21.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.191+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc003ae0 2024-04-12T20:10:21.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.191+0000 7fa9f4c00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:21.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.191+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017be0 legacy=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:21.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.191+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:21.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.192+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:21.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.192+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:21.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.393+0000 7fa9f4c00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:21.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.393+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:21.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.393+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017be0 legacy=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:21.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.393+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:21.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.393+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:21.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.794+0000 7fa9f4c00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:21.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.794+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:21.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.794+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017be0 legacy=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:21.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.794+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:21.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:21.794+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:22.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:22.595+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:22.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:22.595+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:22.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:22.595+0000 7fa9f4c00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:22.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:22.595+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017be0 legacy=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:22.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:22.595+0000 7fa9f4c00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:24.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.192+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:24.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.192+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:24.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.192+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:24.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.192+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:24.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.192+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017be0 legacy=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:24.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.192+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:24.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.192+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc0170f0 2024-04-12T20:10:24.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.192+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc0081e0 2024-04-12T20:10:24.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.192+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:24.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.192+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:24.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.192+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:24.193 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:10:24.201 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:10:24.392 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.393+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:24.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.393+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:24.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.393+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:24.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.794+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:24.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.794+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:24.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:24.794+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:25.594 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:25.595+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:25.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:25.595+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:25.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:25.595+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:27.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc004b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:27.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc004b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:27.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:27.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:10:27.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:27.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9cc0170f0 2024-04-12T20:10:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc00d840 2024-04-12T20:10:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc003ae0 2024-04-12T20:10:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9f4c00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:27.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.192+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.393+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.393+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.393+0000 7fa9f4c00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.393+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:27.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.393+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:27.793 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.794+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.794+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.794+0000 7fa9f4c00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.794+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:27.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:27.794+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:28.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:28.595+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:28.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:28.595+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:28.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:28.595+0000 7fa9f4c00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:28.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:28.595+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:28.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:28.595+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:30.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.191+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:30.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.191+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:30.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.191+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 msgr2=0x7fa9cc00dc20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:30.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.191+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00d840 0x7fa9cc00dc20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:30.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.191+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0170f0 legacy=0x7fa9cc0174d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:30.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.191+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:30.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.191+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc017be0 2024-04-12T20:10:30.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.191+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc0081e0 2024-04-12T20:10:30.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.191+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:30.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.191+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017be0 legacy=0x7fa9cc004b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:30.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.192+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:30.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.393+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017be0 legacy=0x7fa9cc004b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:30.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.393+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:30.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.393+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:30.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.794+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017be0 legacy=0x7fa9cc004b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:30.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.794+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:30.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:30.794+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:31.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:31.595+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017be0 legacy=0x7fa9cc004b50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:31.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:31.595+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:31.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:31.595+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:33.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:33.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:33.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc017be0 legacy=0x7fa9cc004b50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:33.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:33.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:10:33.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:33.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9cc0169e0 2024-04-12T20:10:33.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc003ae0 2024-04-12T20:10:33.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc0081e0 2024-04-12T20:10:33.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:33.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0169e0 legacy=0x7fa9cc01e920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:33.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:33.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:33.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.192+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:33.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.393+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:33.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.393+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0169e0 legacy=0x7fa9cc01e920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:33.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.393+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:33.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.393+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:33.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.393+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:33.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.794+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:33.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.794+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0169e0 legacy=0x7fa9cc01e920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:33.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.794+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:33.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.794+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:33.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:33.794+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:34.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:34.595+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:34.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:34.595+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:34.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:34.595+0000 7fa9f4c00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:34.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:34.595+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0169e0 legacy=0x7fa9cc01e920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:34.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:34.595+0000 7fa9f4c00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.192+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.192+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.192+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.192+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.192+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0169e0 legacy=0x7fa9cc01e920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:36.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.192+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0174d0 0x7fa9cc00e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:36.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.192+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc004b50 2024-04-12T20:10:36.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.192+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc0174d0 2024-04-12T20:10:36.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.192+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0174d0 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:36.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.192+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0174d0 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:36.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.192+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004b50 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:36.393 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.393+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0174d0 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:36.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.393+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0174d0 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:36.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.393+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004b50 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:36.794 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.794+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0174d0 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:36.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.794+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004b50 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:36.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:36.794+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0174d0 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:37.595 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:37.595+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0174d0 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:37.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:37.595+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004b50 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:37.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:37.595+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0174d0 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:39.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0174d0 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:39.193 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc0174d0 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:39.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004b50 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:39.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:39.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:39.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:10:39.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9cc0169e0 2024-04-12T20:10:39.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc00ec10 2024-04-12T20:10:39.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc003ae0 2024-04-12T20:10:39.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:39.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:39.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0169e0 legacy=0x7fa9cc015f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:39.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:39.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.193+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:39.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.394+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:39.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.394+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:39.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.394+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:39.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.394+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0169e0 legacy=0x7fa9cc015f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:39.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.394+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:39.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.795+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:39.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.795+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:39.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.795+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:39.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.795+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0169e0 legacy=0x7fa9cc015f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:39.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:39.795+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:40.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:40.597+0000 7fa9efe00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:40.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:40.597+0000 7fa9efe00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:40.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:40.597+0000 7fa9e7e00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:40.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:40.597+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0169e0 legacy=0x7fa9cc015f10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:40.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:40.597+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:42.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.193+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:42.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.193+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:42.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.193+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:42.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.193+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:42.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.193+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc0169e0 legacy=0x7fa9cc015f10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:42.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.193+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 0x7fa9cc00e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:42.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.193+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc0081e0 2024-04-12T20:10:42.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.193+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc004b50 2024-04-12T20:10:42.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.193+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0081e0 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:42.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.193+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:42.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.193+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:42.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.394+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0081e0 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:42.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.394+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:42.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.394+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:42.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.795+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0081e0 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:42.795 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.795+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:42.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:42.795+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:43.596 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:43.596+0000 7fa9efe00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0081e0 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:43.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:43.596+0000 7fa9e7e00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:43.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:43.596+0000 7fa9e7e00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:45.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:45.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:45.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0081e0 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:45.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:45.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:10:45.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:45.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9cc0081e0 2024-04-12T20:10:45.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc00ec10 2024-04-12T20:10:45.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc003ae0 2024-04-12T20:10:45.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:45.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9f4c00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0081e0 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:45.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:45.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:45.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.194+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:45.394 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.395+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:45.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.395+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:45.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.395+0000 7fa9f4c00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0081e0 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:45.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.395+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:45.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.395+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:45.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.796+0000 7fa9f4c00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0081e0 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:45.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.796+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:45.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.796+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:45.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.796+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:45.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:45.796+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:46.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:46.597+0000 7fa9f4c00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0081e0 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:46.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:46.597+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:46.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:46.597+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:46.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:46.597+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:46.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:46.597+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:48.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.194+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:48.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.194+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:48.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.194+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:48.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.194+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:48.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.194+0000 7fa9ee000640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc0081e0 legacy=0x7fa9cc016dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:48.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.194+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 0x7fa9cc00b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:48.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.194+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc015f10 2024-04-12T20:10:48.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.194+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc004b50 2024-04-12T20:10:48.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.194+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc015f10 legacy=0x7fa9cc0162f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:48.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.194+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:48.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.194+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:48.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.395+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc015f10 legacy=0x7fa9cc0162f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:48.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.395+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:48.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.395+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:48.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.796+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc015f10 legacy=0x7fa9cc0162f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:48.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.796+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:48.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:48.796+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:49.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:49.598+0000 7fa9e7e00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc015f10 legacy=0x7fa9cc0162f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:49.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:49.598+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:49.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:49.598+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:51.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.194+0000 7fa9ee000640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 msgr2=0x7fa9cc00b0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:51.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.194+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc004b50 0x7fa9cc00b0d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:51.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.194+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc015f10 legacy=0x7fa9cc0162f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:51.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.195+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:51.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.195+0000 7fa9f4c00640 1 -- reap_dead start 2024-04-12T20:10:51.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.195+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:51.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.195+0000 7fa9ee000640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f0071df0 con 0x7fa9cc015f10 2024-04-12T20:10:51.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.195+0000 7fa9ee000640 1 -- --> v2:172.21.15.131:3300/0 -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc00ec10 2024-04-12T20:10:51.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.195+0000 7fa9ee000640 1 -- --> v2:172.21.15.171:3300/0 -- mon_getmap magic: 0 -- 0x7fa9cc008ca0 con 0x7fa9cc003ae0 2024-04-12T20:10:51.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.195+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:51.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.195+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:51.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.195+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:51.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.195+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc015f10 legacy=0x7fa9cc0162f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:51.197 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.195+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:51.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.396+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:51.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.396+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:51.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.396+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc015f10 legacy=0x7fa9cc0162f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:51.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.396+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:51.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.396+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:51.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.797+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:51.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.797+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:51.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.797+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc015f10 legacy=0x7fa9cc0162f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:51.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.797+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:51.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:51.797+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:52.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:52.598+0000 7fa9e7e00640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.131:3300/0 2024-04-12T20:10:52.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:52.598+0000 7fa9efe00640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3300/0 2024-04-12T20:10:52.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:52.598+0000 7fa9f4c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc015f10 legacy=0x7fa9cc0162f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-12T20:10:52.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:52.598+0000 7fa9e7e00640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:52.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:52.598+0000 7fa9efe00640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:54.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.195+0000 7fa9ee000640 1 -- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 msgr2=0x7fa9cc0065e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:54.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.195+0000 7fa9ee000640 1 --2- >> v2:172.21.15.171:3300/0 conn(0x7fa9cc003ae0 0x7fa9cc0065e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:54.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.195+0000 7fa9ee000640 1 -- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 msgr2=0x7fa9cc0159d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:54.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.195+0000 7fa9ee000640 1 --2- >> v2:172.21.15.131:3300/0 conn(0x7fa9cc00ec10 0x7fa9cc0159d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-12T20:10:54.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.195+0000 7fa9ee000640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa9cc015f10 legacy=0x7fa9cc0162f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-12T20:10:54.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.195+0000 7fa9ee000640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-12T20:10:54.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.195+0000 7fa9ee000640 1 -- --> v1:172.21.15.131:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa9f00720d0 con 0x7fa9cc004b50 2024-04-12T20:10:54.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.195+0000 7fa9ee000640 1 -- --> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] -- mon_getmap magic: 0 -- 0x7fa9f0153680 con 0x7fa9cc0081e0 2024-04-12T20:10:54.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.195+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004b50 legacy=0x7fa9cc016a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:54.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.195+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:54.196 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.196+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-12T20:10:54.338 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:10:54.346 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:10:54.395 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.396+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004b50 legacy=0x7fa9cc016a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:54.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.397+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:54.396 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.397+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-12T20:10:54.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.797+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004b50 legacy=0x7fa9cc016a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:54.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.798+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:54.797 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:54.798+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-12T20:10:55.597 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:55.598+0000 7fa9e7e00640 1 -- >> v1:172.21.15.131:6789/0 conn(0x7fa9cc004b50 legacy=0x7fa9cc016a00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.131:6789/0 2024-04-12T20:10:55.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:55.599+0000 7fa9efe00640 1 -- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 msgr2=0x7fa9cc00e6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v2:172.21.15.171:3301/0 2024-04-12T20:10:55.598 INFO:teuthology.orchestra.run.smithi131.stderr:2024-04-12T20:10:55.599+0000 7fa9efe00640 1 --2- >> [v2:172.21.15.171:3301/0,v1:172.21.15.171:6790/0] conn(0x7fa9cc0081e0 0x7fa9cc00e6d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-12T20:10:57.072 DEBUG:teuthology.orchestra.run:got remote process result: 124 2024-04-12T20:10:57.073 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/mount.py", line 197, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2822, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2654, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-04-12T20:10:57.088 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-12T20:10:57.088 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-12T20:10:57.088 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.091 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T20:10:57.092 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/mount.py", line 197, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2822, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2654, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a' 2024-04-12T20:10:57.105 INFO:tasks.ceph.mds.a:Stopped 2024-04-12T20:10:57.105 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-12T20:10:57.106 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T20:10:57.106 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/mount.py", line 197, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2822, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2654, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c' 2024-04-12T20:10:57.119 INFO:tasks.ceph.mds.c:Stopped 2024-04-12T20:10:57.119 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-12T20:10:57.119 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.119 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T20:10:57.120 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/mount.py", line 197, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2822, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2654, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi171 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b' 2024-04-12T20:10:57.132 INFO:tasks.ceph.mds.b:Stopped 2024-04-12T20:10:57.133 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-12T20:10:57.133 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.133 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T20:10:57.133 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/mount.py", line 197, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2822, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2654, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi171 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d' 2024-04-12T20:10:57.146 INFO:tasks.ceph.mds.d:Stopped 2024-04-12T20:10:57.146 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-12T20:10:57.147 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-12T20:10:57.147 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.147 INFO:tasks.ceph.osd.0:Stopped 2024-04-12T20:10:57.147 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-12T20:10:57.147 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.147 INFO:tasks.ceph.osd.1:Stopped 2024-04-12T20:10:57.147 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-12T20:10:57.148 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.148 INFO:tasks.ceph.osd.2:Stopped 2024-04-12T20:10:57.148 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-12T20:10:57.148 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.148 INFO:tasks.ceph.osd.3:Stopped 2024-04-12T20:10:57.148 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-12T20:10:57.148 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.149 INFO:tasks.ceph.osd.4:Stopped 2024-04-12T20:10:57.149 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-12T20:10:57.149 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.149 INFO:tasks.ceph.osd.5:Stopped 2024-04-12T20:10:57.149 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-12T20:10:57.149 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.150 INFO:tasks.ceph.osd.6:Stopped 2024-04-12T20:10:57.150 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-12T20:10:57.150 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.150 INFO:tasks.ceph.osd.7:Stopped 2024-04-12T20:10:57.150 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-12T20:10:57.150 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-12T20:10:57.151 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.151 INFO:tasks.ceph.mgr.y:Stopped 2024-04-12T20:10:57.151 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-12T20:10:57.151 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.151 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T20:10:57.151 ERROR:teuthology.orchestra.daemon.state:Error while waiting for process to exit Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/mount.py", line 197, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1447, in run_daemon yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2822, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2654, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/daemon/state.py", line 139, in stop run.wait([self.proc], timeout=timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi171 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x' 2024-04-12T20:10:57.165 INFO:tasks.ceph.mgr.x:Stopped 2024-04-12T20:10:57.165 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-12T20:10:57.165 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-12T20:10:57.165 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.166 INFO:tasks.ceph.mon.a:Stopped 2024-04-12T20:10:57.166 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-12T20:10:57.166 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.168 INFO:tasks.ceph.mon.b:Stopped 2024-04-12T20:10:57.168 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-12T20:10:57.168 INFO:teuthology.orchestra.run:waiting for 300 2024-04-12T20:10:57.169 INFO:tasks.ceph.mon.c:Stopped 2024-04-12T20:10:57.169 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-12T20:10:57.169 DEBUG:teuthology.orchestra.run.smithi131:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | head -n 1 2024-04-12T20:10:57.287 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T20:10:57.287 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-12T20:10:57.505 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T20:10:57.506 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-12T20:10:57.688 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T20:10:57.688 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-12T20:10:57.846 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T20:10:57.846 DEBUG:teuthology.orchestra.run.smithi131:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-12T20:10:58.007 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-12T20:10:58.007 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-12T20:10:58.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-12T20:10:58.221 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-12T20:10:58.379 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-12T20:10:58.379 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-12T20:10:58.544 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-12T20:10:58.545 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-12T20:10:58.727 INFO:tasks.ceph:Archiving mon data... 2024-04-12T20:10:58.729 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524/data/mon.a.tgz 2024-04-12T20:10:58.730 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-04-12T20:10:58.784 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.qYmP715uSL 2024-04-12T20:10:58.785 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.qYmP715uSL 2024-04-12T20:10:58.972 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.qYmP715uSL 2024-04-12T20:10:59.122 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.qYmP715uSL is 302KB 2024-04-12T20:10:59.227 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.qYmP715uSL 2024-04-12T20:10:59.283 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524/data/mon.b.tgz 2024-04-12T20:10:59.284 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-04-12T20:10:59.340 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.fA4G2ZnLye 2024-04-12T20:10:59.341 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.fA4G2ZnLye 2024-04-12T20:10:59.524 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.fA4G2ZnLye 2024-04-12T20:10:59.665 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.fA4G2ZnLye is 310KB 2024-04-12T20:10:59.771 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.fA4G2ZnLye 2024-04-12T20:10:59.828 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524/data/mon.c.tgz 2024-04-12T20:10:59.828 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-04-12T20:10:59.879 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.H1m2OcbyTZ 2024-04-12T20:10:59.880 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.H1m2OcbyTZ 2024-04-12T20:11:00.045 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.H1m2OcbyTZ 2024-04-12T20:11:00.192 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.H1m2OcbyTZ is 310KB 2024-04-12T20:11:00.300 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.H1m2OcbyTZ 2024-04-12T20:11:00.357 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-12T20:11:00.357 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-12T20:11:00.365 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-12T20:11:00.510 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-12T20:11:00.563 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-12T20:11:00.563 INFO:tasks.ceph:Archiving crash dumps... 2024-04-12T20:11:00.566 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524/remote/smithi131/crash 2024-04-12T20:11:00.566 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-12T20:11:00.771 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524/remote/smithi171/crash 2024-04-12T20:11:00.772 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-12T20:11:00.971 INFO:tasks.ceph:Shutting down logrotate 2024-04-12T20:11:00.971 DEBUG:teuthology.orchestra.run.smithi131:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:11:00.979 DEBUG:teuthology.orchestra.run.smithi171:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-12T20:11:01.133 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-12T20:11:01.234 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-12T20:11:01.334 INFO:tasks.ceph:Compressing logs... 2024-04-12T20:11:01.335 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-12T20:11:01.342 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-12T20:11:01.428 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50404.log 2024-04-12T20:11:01.429 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42317.log 2024-04-12T20:11:01.430 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50404.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-12T20:11:01.430 INFO:teuthology.orchestra.run.smithi131.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.50404.log.gz 2024-04-12T20:11:01.431 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42831.log 2024-04-12T20:11:01.431 INFO:teuthology.orchestra.run.smithi131.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42317.log.gz 2024-04-12T20:11:01.432 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45045.log 2024-04-12T20:11:01.433 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42831.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42831.log.gz 2024-04-12T20:11:01.433 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42275.log 2024-04-12T20:11:01.434 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40819.log 2024-04-12T20:11:01.435 INFO:teuthology.orchestra.run.smithi131.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.45045.log.gz 2024-04-12T20:11:01.436 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42275.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42401.log 2024-04-12T20:11:01.436 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42275.log.gz 2024-04-12T20:11:01.436 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37390.log 2024-04-12T20:11:01.437 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44331.log 2024-04-12T20:11:01.437 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.40819.log.gz 2024-04-12T20:11:01.439 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42401.log: gzip 88.9% -- replaced with /var/log/ceph/ceph-client.admin.42401.log.gz 2024-04-12T20:11:01.439 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.50608.log 2024-04-12T20:11:01.440 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-12T20:11:01.440 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37430.log 2024-04-12T20:11:01.440 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37390.log.gz 2024-04-12T20:11:01.440 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37470.log 2024-04-12T20:11:01.443 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37430.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-12T20:11:01.443 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.37430.log.gz 2024-04-12T20:11:01.443 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37470.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-12T20:11:01.443 INFO:teuthology.orchestra.run.smithi171.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37470.log.gz 2024-04-12T20:11:01.444 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-12T20:11:01.444 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44331.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44331.log.gz 2024-04-12T20:11:01.445 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43154.log 2024-04-12T20:11:01.445 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50608.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.50608.log.gz 2024-04-12T20:11:01.445 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41231.log 2024-04-12T20:11:01.445 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44919.log 2024-04-12T20:11:01.445 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43154.log.gz 2024-04-12T20:11:01.445 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41231.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41231.log.gz 2024-04-12T20:11:01.446 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43461.log 2024-04-12T20:11:01.446 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44919.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44919.log.gz 2024-04-12T20:11:01.446 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45003.log 2024-04-12T20:11:01.449 INFO:teuthology.orchestra.run.smithi171.stderr: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-12T20:11:01.449 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37270.log 2024-04-12T20:11:01.449 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-12T20:11:01.449 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37270.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37270.log.gz 2024-04-12T20:11:01.449 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-12T20:11:01.449 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37230.log 2024-04-12T20:11:01.451 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43457.log 2024-04-12T20:11:01.451 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43461.log.gz 2024-04-12T20:11:01.451 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45003.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.45003.log.gz 2024-04-12T20:11:01.451 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41401.log 2024-04-12T20:11:01.451 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44129.log 2024-04-12T20:11:01.451 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43457.log.gz 2024-04-12T20:11:01.452 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41033.log 2024-04-12T20:11:01.452 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41401.log.gz 2024-04-12T20:11:01.452 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44129.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44129.log.gz 2024-04-12T20:11:01.452 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40738.log 2024-04-12T20:11:01.454 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.7.log: /var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-12T20:11:01.454 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37230.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-12T20:11:01.454 INFO:teuthology.orchestra.run.smithi171.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37230.log.gz 2024-04-12T20:11:01.455 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41033.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41033.log.gz 2024-04-12T20:11:01.455 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50276.log 2024-04-12T20:11:01.455 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41145.log 2024-04-12T20:11:01.455 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40738.log.gz 2024-04-12T20:11:01.455 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50276.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50276.log.gz 2024-04-12T20:11:01.456 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41189.log 2024-04-12T20:11:01.459 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37310.log 2024-04-12T20:11:01.459 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-12T20:11:01.459 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37310.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37310.log.gz 2024-04-12T20:11:01.460 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42443.log 2024-04-12T20:11:01.460 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41145.log.gz 2024-04-12T20:11:01.460 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41189.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41189.log.gz 2024-04-12T20:11:01.460 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50520.log 2024-04-12T20:11:01.460 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49666.log 2024-04-12T20:11:01.460 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42443.log.gz 2024-04-12T20:11:01.461 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50520.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50520.log.gz 2024-04-12T20:11:01.461 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43462.log 2024-04-12T20:11:01.462 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43797.log 2024-04-12T20:11:01.462 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.49666.log.gz 2024-04-12T20:11:01.462 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43462.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45173.log 2024-04-12T20:11:01.462 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43462.log.gz 2024-04-12T20:11:01.463 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43797.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30739.log 2024-04-12T20:11:01.463 INFO:teuthology.orchestra.run.smithi131.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43797.log.gz 2024-04-12T20:11:01.464 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.45173.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41359.log 2024-04-12T20:11:01.464 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.45173.log.gz 2024-04-12T20:11:01.465 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.tmp-client.admin.30739.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30739.log.gz 2024-04-12T20:11:01.465 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37350.log 2024-04-12T20:11:01.466 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44122.log 2024-04-12T20:11:01.466 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42359.log 2024-04-12T20:11:01.466 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41359.log.gz 2024-04-12T20:11:01.467 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50054.log 2024-04-12T20:11:01.467 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44122.log.gz 2024-04-12T20:11:01.468 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-12T20:11:01.469 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37350.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37350.log.gz 2024-04-12T20:11:01.469 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42359.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42359.log.gz 2024-04-12T20:11:01.470 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42711.log 2024-04-12T20:11:01.470 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42999.log 2024-04-12T20:11:01.470 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50054.log.gz 2024-04-12T20:11:01.473 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49566.log 2024-04-12T20:11:01.473 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42711.log.gz 2024-04-12T20:11:01.473 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41273.log 2024-04-12T20:11:01.473 INFO:teuthology.orchestra.run.smithi131.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.42999.log.gz 2024-04-12T20:11:01.473 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49566.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49566.log.gz 2024-04-12T20:11:01.474 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42915.log 2024-04-12T20:11:01.474 INFO:teuthology.orchestra.run.smithi171.stderr: 93.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-12T20:11:01.474 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37190.log 2024-04-12T20:11:01.474 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-12T20:11:01.475 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.37190.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37190.log.gz 2024-04-12T20:11:01.476 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43783.log 2024-04-12T20:11:01.476 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41273.log.gz 2024-04-12T20:11:01.476 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37031.log 2024-04-12T20:11:01.477 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42915.log.gz 2024-04-12T20:11:01.477 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43783.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43783.log.gz 2024-04-12T20:11:01.477 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50566.log 2024-04-12T20:11:01.478 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.c.log: 94.9% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-12T20:11:01.479 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.37031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42957.log 2024-04-12T20:11:01.479 INFO:teuthology.orchestra.run.smithi131.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.37031.log.gz 2024-04-12T20:11:01.479 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43450.log 2024-04-12T20:11:01.480 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50566.log.gz 2024-04-12T20:11:01.480 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42957.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.42957.log.gz 2024-04-12T20:11:01.480 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40991.log 2024-04-12T20:11:01.481 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42543.log 2024-04-12T20:11:01.481 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43450.log.gz 2024-04-12T20:11:01.482 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49970.log 2024-04-12T20:11:01.482 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.40991.log.gz 2024-04-12T20:11:01.483 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42543.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.42543.log.gz 2024-04-12T20:11:01.483 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41569.log 2024-04-12T20:11:01.484 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44751.log 2024-04-12T20:11:01.484 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.49970.log.gz 2024-04-12T20:11:01.485 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41569.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.41569.log.gz 2024-04-12T20:11:01.485 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43799.log 2024-04-12T20:11:01.486 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44751.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-12T20:11:01.486 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44751.log.gz 2024-04-12T20:11:01.487 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43042.log 2024-04-12T20:11:01.487 INFO:teuthology.orchestra.run.smithi131.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.43799.log.gz 2024-04-12T20:11:01.488 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44709.log 2024-04-12T20:11:01.488 INFO:teuthology.orchestra.run.smithi131.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-12T20:11:01.489 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44130.log 2024-04-12T20:11:01.490 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43042.log.gz 2024-04-12T20:11:01.490 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44709.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44709.log.gz 2024-04-12T20:11:01.491 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50342.log 2024-04-12T20:11:01.491 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44130.log: gzip 88.6% -5 -- replaced with /var/log/ceph/ceph-client.admin.44130.log.gz --verbose 2024-04-12T20:11:01.492 INFO:teuthology.orchestra.run.smithi131.stderr: -- /var/log/ceph/ceph-client.admin.41677.log 2024-04-12T20:11:01.492 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36663.log 2024-04-12T20:11:01.493 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50342.log.gz 2024-04-12T20:11:01.493 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41677.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.41677.log.gz 2024-04-12T20:11:01.494 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45582.log 2024-04-12T20:11:01.495 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.36663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44877.log 2024-04-12T20:11:01.495 INFO:teuthology.orchestra.run.smithi131.stderr: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.36663.log.gz 2024-04-12T20:11:01.496 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.0.45582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41527.log 2024-04-12T20:11:01.497 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44877.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44877.log.gz 2024-04-12T20:11:01.497 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44091.log 2024-04-12T20:11:01.498 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44125.log 2024-04-12T20:11:01.498 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.41527.log.gz 2024-04-12T20:11:01.499 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44091.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.44091.log.gz 2024-04-12T20:11:01.499 INFO:teuthology.orchestra.run.smithi131.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.43782.log 2024-04-12T20:11:01.500 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40642.log 2024-04-12T20:11:01.500 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44125.log.gz 2024-04-12T20:11:01.501 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43782.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43782.log.gz 2024-04-12T20:11:01.501 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44415.log 2024-04-12T20:11:01.502 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43105.log 2024-04-12T20:11:01.502 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.40642.log.gz 2024-04-12T20:11:01.503 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42873.log 2024-04-12T20:11:01.503 INFO:teuthology.orchestra.run.smithi131.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44415.log.gz 2024-04-12T20:11:01.504 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42102.log 2024-04-12T20:11:01.504 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43105.log.gz 2024-04-12T20:11:01.505 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42873.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42873.log.gz 2024-04-12T20:11:01.505 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42485.log 2024-04-12T20:11:01.506 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42102.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40882.log 2024-04-12T20:11:01.507 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42485.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.42485.log.gz 2024-04-12T20:11:01.508 INFO:teuthology.orchestra.run.smithi131.stderr:gzip 92.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.42102.log.gz --verbose 2024-04-12T20:11:01.508 INFO:teuthology.orchestra.run.smithi131.stderr: -- /var/log/ceph/ceph-client.admin.42627.log 2024-04-12T20:11:01.509 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-12T20:11:01.509 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40882.log: /var/log/ceph/ceph-client.admin.42627.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.40882.log.gz 2024-04-12T20:11:01.510 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44961.log 2024-04-12T20:11:01.510 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42627.log.gz 2024-04-12T20:11:01.511 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49764.log 2024-04-12T20:11:01.513 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49506.log 2024-04-12T20:11:01.513 INFO:teuthology.orchestra.run.smithi131.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44961.log.gz 2024-04-12T20:11:01.514 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44625.log 2024-04-12T20:11:01.514 INFO:teuthology.orchestra.run.smithi131.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.49764.log.gz 2024-04-12T20:11:01.515 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43789.log 2024-04-12T20:11:01.515 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49506.log.gz 2024-04-12T20:11:01.516 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44625.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43456.log 2024-04-12T20:11:01.517 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44625.log.gz 2024-04-12T20:11:01.518 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44126.log 2024-04-12T20:11:01.518 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43789.log.gz 2024-04-12T20:11:01.519 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49722.log 2024-04-12T20:11:01.519 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43456.log.gz 2024-04-12T20:11:01.520 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43460.log 2024-04-12T20:11:01.521 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44126.log.gz 2024-04-12T20:11:01.522 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44499.log 2024-04-12T20:11:01.522 INFO:teuthology.orchestra.run.smithi131.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49722.log.gz 2024-04-12T20:11:01.523 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43196.log 2024-04-12T20:11:01.523 INFO:teuthology.orchestra.run.smithi131.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43460.log.gz 2024-04-12T20:11:01.525 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44499.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43239.log 2024-04-12T20:11:01.525 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44499.log.gz 2024-04-12T20:11:01.526 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50220.log 2024-04-12T20:11:01.526 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43196.log.gz 2024-04-12T20:11:01.527 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41485.log 2024-04-12T20:11:01.528 INFO:teuthology.orchestra.run.smithi131.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.43239.log.gz 2024-04-12T20:11:01.528 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42669.log 2024-04-12T20:11:01.529 INFO:teuthology.orchestra.run.smithi131.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50220.log.gz 2024-04-12T20:11:01.530 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41317.log 2024-04-12T20:11:01.530 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41485.log.gz 2024-04-12T20:11:01.531 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42669.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50169.log 2024-04-12T20:11:01.532 INFO:teuthology.orchestra.run.smithi131.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.42669.log.gz 2024-04-12T20:11:01.533 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50123.log 2024-04-12T20:11:01.533 INFO:teuthology.orchestra.run.smithi131.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.41317.log.gz 2024-04-12T20:11:01.534 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50169.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-12T20:11:01.534 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50169.log.gz 2024-04-12T20:11:01.535 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43281.log 2024-04-12T20:11:01.536 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50123.log.gz 2024-04-12T20:11:01.537 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50424.log 2024-04-12T20:11:01.538 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44373.log 2024-04-12T20:11:01.538 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43281.log.gz 2024-04-12T20:11:01.539 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50034.log 2024-04-12T20:11:01.540 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50424.log.gz 2024-04-12T20:11:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44135.log 2024-04-12T20:11:01.541 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44373.log.gz 2024-04-12T20:11:01.542 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44131.log 2024-04-12T20:11:01.543 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50034.log.gz 2024-04-12T20:11:01.543 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43796.log 2024-04-12T20:11:01.544 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44135.log.gz 2024-04-12T20:11:01.545 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44131.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49787.log 2024-04-12T20:11:01.545 INFO:teuthology.orchestra.run.smithi131.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44131.log.gz 2024-04-12T20:11:01.546 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44835.log 2024-04-12T20:11:01.546 INFO:teuthology.orchestra.run.smithi131.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43796.log.gz 2024-04-12T20:11:01.547 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43451.log 2024-04-12T20:11:01.548 INFO:teuthology.orchestra.run.smithi131.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49787.log.gz 2024-04-12T20:11:01.549 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44583.log 2024-04-12T20:11:01.549 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44835.log.gz 2024-04-12T20:11:01.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50320.log 2024-04-12T20:11:01.550 INFO:teuthology.orchestra.run.smithi131.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43451.log.gz 2024-04-12T20:11:01.551 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44583.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-12T20:11:01.551 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44583.log.gz 2024-04-12T20:11:01.553 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44793.log 2024-04-12T20:11:01.553 INFO:teuthology.orchestra.run.smithi131.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50320.log.gz 2024-04-12T20:11:01.554 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41101.log 2024-04-12T20:11:01.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44793.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41611.log 2024-04-12T20:11:01.556 INFO:teuthology.orchestra.run.smithi131.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.44793.log.gz 2024-04-12T20:11:01.556 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50650.log 2024-04-12T20:11:01.557 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.41101.log.gz 2024-04-12T20:11:01.557 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36919.log 2024-04-12T20:11:01.558 INFO:teuthology.orchestra.run.smithi131.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.41611.log.gz 2024-04-12T20:11:01.559 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.50650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40944.log 2024-04-12T20:11:01.561 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.36919.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36919.log.gz 2024-04-12T20:11:01.562 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.40944.log: 95.7% -- replaced with /var/log/ceph/ceph-client.admin.50650.log.gz 2024-04-12T20:11:01.562 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44667.log 2024-04-12T20:11:01.562 INFO:teuthology.orchestra.run.smithi131.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.40944.log.gz 2024-04-12T20:11:01.564 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-12T20:11:01.565 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44667.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44667.log.gz 2024-04-12T20:11:01.565 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49870.log 2024-04-12T20:11:01.566 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49956.log 2024-04-12T20:11:01.568 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49870.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49870.log.gz 2024-04-12T20:11:01.569 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49956.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49956.log.gz 2024-04-12T20:11:01.569 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49608.log 2024-04-12T20:11:01.571 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49850.log 2024-04-12T20:11:01.572 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49608.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49608.log.gz 2024-04-12T20:11:01.573 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.49850.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49850.log.gz 2024-04-12T20:11:01.574 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42585.log 2024-04-12T20:11:01.576 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-12T20:11:01.577 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42585.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42585.log.gz 2024-04-12T20:11:01.580 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42753.log 2024-04-12T20:11:01.583 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-12T20:11:01.583 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.42753.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-12T20:11:01.583 INFO:teuthology.orchestra.run.smithi131.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.42753.log.gz 2024-04-12T20:11:01.584 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-osd.2.log: 88.4% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-12T20:11:01.585 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41443.log 2024-04-12T20:11:01.587 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44541.log 2024-04-12T20:11:01.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.41443.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.41443.log.gz 2024-04-12T20:11:01.588 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44541.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44541.log.gz 2024-04-12T20:11:01.589 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43788.log 2024-04-12T20:11:01.592 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43463.log 2024-04-12T20:11:01.593 INFO:teuthology.orchestra.run.smithi131.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43788.log.gz 2024-04-12T20:11:01.595 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44457.log 2024-04-12T20:11:01.597 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43463.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43463.log.gz 2024-04-12T20:11:01.599 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.44457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43798.log 2024-04-12T20:11:01.600 INFO:teuthology.orchestra.run.smithi131.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44457.log.gz 2024-04-12T20:11:01.601 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-12T20:11:01.606 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/ceph-client.admin.43798.log: /var/log/ceph/ceph-mds.a.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43798.log.gz 2024-04-12T20:11:01.835 INFO:teuthology.orchestra.run.smithi131.stderr: 91.9% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-12T20:11:01.902 INFO:teuthology.orchestra.run.smithi171.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-12T20:11:02.063 INFO:teuthology.orchestra.run.smithi171.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-12T20:11:02.728 INFO:teuthology.orchestra.run.smithi131.stderr: 90.4% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-12T20:11:06.411 INFO:teuthology.orchestra.run.smithi171.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-12T20:11:08.546 INFO:teuthology.orchestra.run.smithi131.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-12T20:11:08.634 INFO:teuthology.orchestra.run.smithi131.stderr: 95.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-12T20:11:14.640 INFO:teuthology.orchestra.run.smithi131.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-12T20:11:16.551 INFO:teuthology.orchestra.run.smithi171.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-12T20:11:17.810 INFO:teuthology.orchestra.run.smithi171.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-12T20:11:18.717 INFO:teuthology.orchestra.run.smithi171.stderr: 92.1% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-12T20:11:21.562 INFO:teuthology.orchestra.run.smithi131.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-12T20:11:22.518 INFO:teuthology.orchestra.run.smithi131.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-12T20:11:28.629 INFO:teuthology.orchestra.run.smithi171.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-12T20:11:29.204 INFO:teuthology.orchestra.run.smithi131.stderr: 92.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-12T20:11:48.710 INFO:teuthology.orchestra.run.smithi131.stderr: 94.8% -- replaced with /var/log/ceph/ceph-client.0.45582.log.gz 2024-04-12T20:11:48.714 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-04-12T20:11:48.714 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m47.326s 2024-04-12T20:11:48.715 INFO:teuthology.orchestra.run.smithi131.stderr:user 2m13.788s 2024-04-12T20:11:48.715 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m10.772s 2024-04-12T20:12:18.540 INFO:teuthology.orchestra.run.smithi171.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-12T20:12:18.545 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-12T20:12:18.545 INFO:teuthology.orchestra.run.smithi171.stderr:real 1m17.149s 2024-04-12T20:12:18.545 INFO:teuthology.orchestra.run.smithi171.stderr:user 2m27.896s 2024-04-12T20:12:18.545 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m10.900s 2024-04-12T20:12:18.546 INFO:tasks.ceph:Archiving logs... 2024-04-12T20:12:18.547 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524/remote/smithi131/log 2024-04-12T20:12:18.548 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-12T20:12:36.389 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524/remote/smithi171/log 2024-04-12T20:12:36.390 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-12T20:12:58.197 ERROR:teuthology.run_tasks:Manager failed: ceph Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1918, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/mount.py", line 197, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph.py", line 1928, in task ctx.managers[config['cluster']].wait_for_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2822, in wait_for_clean num_active_clean = self.get_num_active_clean() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2654, in get_num_active_clean pgs = self.get_pg_stats() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 2420, in get_pg_stats out = self.raw_cluster_cmd('pg', 'dump', '--format=json') File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1656, in raw_cluster_cmd return self.run_cluster_cmd(**kwargs).stdout.getvalue() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_manager.py", line 1647, in run_cluster_cmd return self.controller.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json' 2024-04-12T20:12:58.214 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-12T20:12:58.224 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/mount.py", line 197, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType 2024-04-12T20:12:58.237 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-12T20:12:58.237 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-12T20:12:58.249 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-12T20:12:58.399 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-12T20:12:58.408 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-12T20:12:58.409 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-12T20:12:58.417 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-12T20:12:58.465 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-04-12T20:12:58.471 INFO:teuthology.orchestra.run.smithi171.stderr:bash: line 1: ntpq: command not found 2024-04-12T20:12:58.474 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-12T20:12:58.474 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-04-12T20:12:58.475 INFO:teuthology.orchestra.run.smithi131.stdout:^- hv01.front.sepia.ceph.com 2 7 377 63 +1320us[+1320us] +/- 519ms 2024-04-12T20:12:58.475 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv02.front.sepia.ceph.com 3 6 377 63 -518us[ -507us] +/- 61ms 2024-04-12T20:12:58.475 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 61 +636us[ +636us] +/- 73ms 2024-04-12T20:12:58.475 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T20:12:58.481 INFO:teuthology.orchestra.run.smithi171.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-12T20:12:58.481 INFO:teuthology.orchestra.run.smithi171.stdout:=============================================================================== 2024-04-12T20:12:58.481 INFO:teuthology.orchestra.run.smithi171.stdout:^- hv01.front.sepia.ceph.com 2 6 377 62 +1225us[+1227us] +/- 519ms 2024-04-12T20:12:58.481 INFO:teuthology.orchestra.run.smithi171.stdout:^* hv02.front.sepia.ceph.com 3 6 377 1 -518us[ -511us] +/- 62ms 2024-04-12T20:12:58.481 INFO:teuthology.orchestra.run.smithi171.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 1 +644us[ +652us] +/- 74ms 2024-04-12T20:12:58.481 INFO:teuthology.orchestra.run.smithi171.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-04-12T20:12:58.482 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-12T20:12:58.492 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-12T20:12:58.492 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-12T20:12:58.541 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-12T20:12:58.755 DEBUG:teuthology.orchestra.run.smithi171:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-12T20:12:58.965 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-12T20:12:59.066 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T20:12:59.067 DEBUG:teuthology.orchestra.run.smithi171:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-04-12T20:12:59.171 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T20:12:59.171 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-12T20:12:59.181 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-12T20:12:59.195 INFO:teuthology.task.internal:Duration was 2638.375985 seconds 2024-04-12T20:12:59.195 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-12T20:12:59.278 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-12T20:12:59.278 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-12T20:12:59.286 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-12T20:12:59.447 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-12T20:12:59.450 INFO:teuthology.orchestra.run.smithi171.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-12T20:12:59.862 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-12T20:12:59.862 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-04-12T20:12:59.862 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-12T20:12:59.933 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-04-12T20:12:59.933 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-12T20:13:00.004 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-12T20:13:00.004 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-12T20:13:00.012 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-12T20:13:00.100 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-12T20:13:00.101 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-12T20:13:00.106 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-12T20:13:00.296 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-12T20:13:00.309 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-12T20:13:00.309 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-12T20:13:00.404 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-12T20:13:00.504 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-12T20:13:00.515 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-12T20:13:00.523 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-12T20:13:00.623 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-04-12T20:13:00.627 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-04-12T20:13:00.704 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-12T20:13:00.750 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi131.front.sepia.ceph.com, flagging run as failed 2024-04-12T20:13:00.750 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-12T20:13:00.804 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi171.front.sepia.ceph.com, flagging run as failed 2024-04-12T20:13:00.804 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-12T20:13:00.815 INFO:teuthology.task.internal:Transferring archived files... 2024-04-12T20:13:00.816 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524/remote/smithi131 2024-04-12T20:13:00.816 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-12T20:13:50.103 INFO:teuthology.task.internal:Transferring binaries for coredumps... 2024-04-12T20:13:50.126 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524/remote/smithi131/coredump/1712952530.49253.core: ELF 64-bit LSB core file, x86-64, version 1 (SYSV), SVR4-style, from 'git reset --hard v0.27', real uid: 1000, effective uid: 1000, real gid: 1301, effective gid: 1301, execfn: '/usr/bin/git', platform: 'x86_64' 2024-04-12T20:13:50.127 INFO:teuthology.task.internal: dump_program: git reset --hard v0.27 2024-04-12T20:13:50.127 DEBUG:teuthology.orchestra.run.smithi131:> which 'git reset --hard v0.27' 2024-04-12T20:13:50.186 INFO:teuthology.orchestra.run.smithi131.stderr:/usr/bin/which: unrecognized option '--hard' 2024-04-12T20:13:50.186 INFO:teuthology.orchestra.run.smithi131.stderr:/usr/bin/which: no v0.27 in (/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin) 2024-04-12T20:13:50.187 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T20:13:50.187 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/git 2024-04-12T20:13:50.188 INFO:teuthology.orchestra.run.smithi131.stdout:/usr/bin/reset 2024-04-12T20:13:50.188 ERROR:teuthology.run_tasks:Manager failed: internal.archive Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 392, in archive yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/mount.py", line 197, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 420, in archive fetch_binaries_for_coredumps(path, rem) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 345, in fetch_binaries_for_coredumps remote_path = remote.sh(['which', dump_program]).rstrip() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 97, in sh proc = self.run(**kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: "which 'git reset --hard v0.27'" 2024-04-12T20:13:50.202 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-12T20:13:50.213 INFO:teuthology.task.internal:Not uploading archives. 2024-04-12T20:13:50.213 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-12T20:13:50.235 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-12T20:13:50.235 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-12T20:13:50.248 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-12T20:13:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: 524301 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 12 20:12 /home/ubuntu/cephtest 2024-04-12T20:13:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: 524302 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Apr 12 20:12 /home/ubuntu/cephtest/archive 2024-04-12T20:13:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: 524304 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 12 20:13 /home/ubuntu/cephtest/archive/syslog 2024-04-12T20:13:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: 524473 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 12 19:28 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-12T20:13:50.300 INFO:teuthology.orchestra.run.smithi131.stdout: 524314 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 12 19:28 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-12T20:13:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: 524313 196 -rw-r--r-- 1 ubuntu ubuntu 197374 Apr 12 20:13 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-12T20:13:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: 655361 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 12 20:12 /home/ubuntu/cephtest/archive/audit 2024-04-12T20:13:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: 655363 144 -rw------- 1 ubuntu ubuntu 147169 Apr 12 20:12 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-12T20:13:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: 524303 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 12 20:08 /home/ubuntu/cephtest/archive/coredump 2024-04-12T20:13:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: 552425 972 -rw------- 1 ubuntu ubuntu 4161536 Apr 12 20:08 /home/ubuntu/cephtest/archive/coredump/1712952530.49253.core 2024-04-12T20:13:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: 552423 94212 -rw------- 1 root root 391475200 Apr 12 20:04 /home/ubuntu/cephtest/archive/coredump/1712952273.40740.core 2024-04-12T20:13:50.301 INFO:teuthology.orchestra.run.smithi131.stdout: 552424 92896 -rw------- 1 root root 392654848 Apr 12 20:04 /home/ubuntu/cephtest/archive/coredump/1712952297.40739.core 2024-04-12T20:13:50.302 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-12T20:13:50.303 INFO:teuthology.orchestra.run.smithi131.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-12T20:13:50.303 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 399, in umount_wait self.umount(cleanup=False) File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/fuse_mount.py", line 320, in umount if self.is_blocked(): File "/home/teuthworker/src/git.ceph.com_ceph-c_324baf8ddb91dea46cac50cb535c306115791355/qa/tasks/cephfs/mount.py", line 197, in is_blocked return self.addr in output TypeError: 'in ' requires string as left operand, not NoneType During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_6c637841c215537a4502385240412f1966e0faab/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi131 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-04-12T20:13:50.314 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-12T20:13:50.325 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-12T20:13:50.356 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: TypeError: 'in ' requires string as left operand, not NoneType 2024-04-12T20:13:50.356 INFO:teuthology.nuke:Checking targets against current locks 2024-04-12T20:13:50.364 INFO:teuthology.orchestra.run.smithi171.stdout: 524301 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Apr 12 20:12 /home/ubuntu/cephtest 2024-04-12T20:13:50.364 INFO:teuthology.orchestra.run.smithi171.stdout: 524302 4 drwxr-xr-x 5 ubuntu ubuntu 4096 Apr 12 20:12 /home/ubuntu/cephtest/archive 2024-04-12T20:13:50.365 INFO:teuthology.orchestra.run.smithi171.stdout: 524304 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 12 20:13 /home/ubuntu/cephtest/archive/syslog 2024-04-12T20:13:50.365 INFO:teuthology.orchestra.run.smithi171.stdout: 524473 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 12 19:29 /home/ubuntu/cephtest/archive/syslog/misc.log.gz 2024-04-12T20:13:50.365 INFO:teuthology.orchestra.run.smithi171.stdout: 524314 4 -rw-rw-rw- 1 ubuntu ubuntu 29 Apr 12 19:28 /home/ubuntu/cephtest/archive/syslog/kern.log.gz 2024-04-12T20:13:50.365 INFO:teuthology.orchestra.run.smithi171.stdout: 524313 188 -rw-r--r-- 1 ubuntu ubuntu 189692 Apr 12 20:13 /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-12T20:13:50.365 INFO:teuthology.orchestra.run.smithi171.stdout: 655363 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 12 20:12 /home/ubuntu/cephtest/archive/audit 2024-04-12T20:13:50.365 INFO:teuthology.orchestra.run.smithi171.stdout: 655646 124 -rw------- 1 ubuntu ubuntu 126167 Apr 12 20:12 /home/ubuntu/cephtest/archive/audit/audit.log.gz 2024-04-12T20:13:50.365 INFO:teuthology.orchestra.run.smithi171.stdout: 524303 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 12 20:04 /home/ubuntu/cephtest/archive/coredump 2024-04-12T20:13:50.365 INFO:teuthology.orchestra.run.smithi171.stdout: 524497 103208 -rw------- 1 root root 392658944 Apr 12 20:04 /home/ubuntu/cephtest/archive/coredump/1712952247.41063.core 2024-04-12T20:13:50.365 INFO:teuthology.orchestra.run.smithi171.stdout: 524496 141412 -rw------- 1 root root 391876608 Apr 12 20:03 /home/ubuntu/cephtest/archive/coredump/1712952222.41064.core 2024-04-12T20:13:50.367 INFO:teuthology.orchestra.run.smithi171.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-04-12T20:13:50.394 DEBUG:teuthology.nuke:shortname: smithi131 2024-04-12T20:13:50.394 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-12T20:13:50.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-12 19:18:43.133524', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEunQAr+mGP/HJ4UiBcFPtfWszRJn0NkjvRCdiM2iZAhJ8qjKSWSXfPNO3BbSBEdxwNQWrNrgQb8ewHiwcJvvMU='} 2024-04-12T20:13:50.424 DEBUG:teuthology.nuke:shortname: smithi171 2024-04-12T20:13:50.424 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-12T20:13:50.448 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-04-12_03:11:38-fs-wip-vshankar-testing-20240411.061452-testing-default-smithi/7653524', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-12 19:18:43.134782', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNE3b2hN+giYQQr4Tq4s/n48RFH667cMjgJRUH55dHBcTJrQ2wedifR1B7qlqhbjO8uDauGT5qGu5WeKZV+Pe5Y='} 2024-04-12T20:13:50.481 INFO:teuthology.orchestra.console.smithi131:Power off 2024-04-12T20:13:50.481 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-12T20:13:50.503 DEBUG:teuthology.orchestra.console.smithi131:power off output: Chassis Power Control: Down/Off 2024-04-12T20:13:50.503 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T20:13:50.521 INFO:teuthology.orchestra.console.smithi171:Power off 2024-04-12T20:13:50.521 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-04-12T20:13:50.531 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-04-12T20:13:50.542 DEBUG:teuthology.orchestra.console.smithi171:power off output: Chassis Power Control: Down/Off 2024-04-12T20:13:50.542 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T20:13:50.564 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-04-12T20:13:54.532 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T20:13:54.565 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T20:13:54.643 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-04-12T20:13:54.675 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is on 2024-04-12T20:13:58.646 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T20:13:58.675 DEBUG:teuthology.orchestra.console.smithi171:pexpect command: ipmitool -H smithi171.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T20:13:58.757 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is on 2024-04-12T20:13:58.786 DEBUG:teuthology.orchestra.console.smithi171:check power output: Chassis Power is off 2024-04-12T20:13:58.887 INFO:teuthology.orchestra.console.smithi171:Power off completed 2024-04-12T20:14:02.762 DEBUG:teuthology.orchestra.console.smithi131:pexpect command: ipmitool -H smithi131.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-04-12T20:14:02.872 DEBUG:teuthology.orchestra.console.smithi131:check power output: Chassis Power is off 2024-04-12T20:14:02.973 INFO:teuthology.orchestra.console.smithi131:Power off completed 2024-04-12T20:14:03.083 INFO:teuthology.run:Summary data: description: fs/snaps/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a3s-mds-1c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore-ec/bluestore-comp-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down pg_health} tasks/workunit/snaps} duration: 2638.375985145569 failure_reason: 'Command failed (workunit test fs/snaps/snaptest-git-ceph.sh) on smithi131 with status 135: ''mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=324baf8ddb91dea46cac50cb535c306115791355 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/snaps/snaptest-git-ceph.sh''' flavor: default mon.a-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 mon.b-kernel-sha1: 3f60ed14f7c110c7ce3c8d83dd2ed0d08e80d0c8 owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=7f8068191fff4719bfadc19ce4d58bd0 status: fail success: false 2024-04-12T20:14:03.083 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-12T20:14:03.167 INFO:teuthology.run:FAIL